Lancaster vigorously guarded his private life.
Lancaster was a vocal supporter of liberal political causes, and frequently spoke out in support of racial minorities, including at the March on Washington in 1963.