Adams lived for a time in Connecticut where his father, Frank, was the manager and huntsman of the Watertown Hunt.
The family returned East in the mid-1940s, settling in Southern Pines, North Carolina.