Ivanov was married to Natalya Rousanova; they have one daughter, Ani (born 1967), until 1982 when they divorced. Now he is married to Lidia and they have one son, Ivan (born 1984). His hobbies include skiing, fishing and golf. Ivanov is a Member of the ASE — Association of the Space Explorers. He founded the Future in Space Foundation.