Born in Mountain Lakes, New Jersey, Elmes studied photography at the Rochester Institute of Technology, then attended the American Film Institute in Los Angeles, graduating in 1972. He enrolled in the Graduate Film Program at New York University's Department of Film and Television and graduated in 1975.