Brian was married to Bonita Fiedler; they divorced in 1948. In 1950, she filed a paternity suit against him, seeking his support for a son born to her. The suit claimed that Brian had admitted to being the baby's father. Brian's attorney, on the other hand, said that Brian did not think he was the child's father. At the time of the suit, Brian was married to Adrian Booth, an Actress who was also known as Lorna Gray. On August 11, 1951, a jury found in Brian's favor after another man testified to having been intimate with the mother "several times during the year before the child was born".