Smith was of Jewish religion. He briefly attended Brandeis University, where he met and married his first wife, Norma Kalman. They had one son, Elliot. Paul and Norma were divorced in 1960. Smith married Eve Smith. In February 2006, they immigrated to Israel, adopting Ra'anana as their new home. After taking Israeli citizenship, the couple adopted Hebrew names: Adam and Aviva Eden.