Pritzker was born in 1953 in Oberlin, Ohio, the second of three children born to Jewish-American businessman, Robert Pritzker, and Audrey Gilbert. She has two siblings: Jennifer N. Pritzker (b. James, 1950), a retired lieutenant colonel in the U.S. Army and founder of the Pritzker Military Library, and Karen Pritzker (b. 1958).