Lillian Lee "Lilly" McKim was born to socialites Robert V. McKim and his wife, Lillian (née Bostwick) in Roslyn, New York in 1931, the middle daughter of three.
She attended the Chapin School in New York City, along with Bouvier sister Jacqueline Lee.