Rifenburg was born in Petoskey, Michigan, and raised in Kalamazoo, Michigan before his family moved to Saginaw, Michigan.
It is ironic that Rifenburg was born in Petoskey, Michigan in 1926 for several reasons.