 The brother of Collingwood footballer Albert Pannam, he was the father of Collingwood and Richmond footballer and Richmond coach Alby Pannam, and of Collingwood and South Melbourne footballer and South Melbourne coach Charlie Pannam.Collingwood captain Lou Richards and Collingwood footballer (and interim coach for two matches in 1974) Ron Richards were his grandsons.He played for three seasons with the Collingwood club in the VFA competition from 1894 to 1896.