 Downer is a member of the Chamber of Commerce, the Louisiana Trial Lawyers Association, the Association of Trial Lawyers of America, and the United States Court of Military Appeals.He is married to the former Linda Faye Lee.In 2007, Downer was inducted into the Louisiana Political Museum and Hall of Fame in Winnfield.