 The couple separated while their son was young, and they were amicably divorced in 1942.In 1934, Lee began a love affair with publisher and peace activist Caresse Crosby, despite the threat of miscegenation laws.They often had lunch in uptown New York in Harlem at the then-new restaurant "Franks", where they could maintain their secret relationship.