The former head of the 4th Chief of the Ministry of Health, Academician Yevgeniy Chazov wrote about Ustinov: "I met him for the first time thanks to Andropov, who was his close friend.
Ustinov was married to Taisa Alekseevna Briekalova-Ustinova (1903-1975).