De Forest was elected to the Fifty-second and Fifty-third Congresses (March 4, 1891 – March 3, 1895). He served as chairman of the Committee on Reform in the Civil Service (Fifty-third Congress). He was an unsuccessful candidate for reelection in 1894 to the Fifty-fourth Congress.