it was different for the rest of the family , harry had kept up a loose connection with teddy and even contacted his mother from time to time , he saw tom once a year and he would have seen sylvia , if she had allowed it .