Rindge moved to Los Angeles, California, in 1887.
He was President of the Harvard Club of Los Angeles and a member of many historical, archaeological, patriotic, and religious organizations which mirrored his interests.