He is the father of singers Rufus Wainwright , Martha Wainwright and Lucy Wainwright Roche , and the former husband of Kate McGarrigle . He is the father of musicians Rufus Wainwright , Martha Wainwright and Lucy Wainwright Roche , brother of Sloan Wainwright , and the former husband of the late folk singer Kate McGarrigle .