Morley was born in the town of Woodbridge in Suffolk, England. His parents were Elizabeth Muskett and Joseph Roberts Morley, Quakers who ran a china shop. After being educated at Woodbridge School, Morley went on to King's College, Cambridge (B.A., 1884).