He had two sons with his first wife, Mabel: Dwight and
Bryant Washburn Jr.. He also had a daughter, Roberta Catherine (born c. October 1930), with his second wife, Virginia. His daughter was later known as Sister Mary Luke of St. John's Convent, King City, CA.