he forced himself occasionally to join in the games going on in the street , but because he was away at school most of the time , he hardly knew the other children and felt that they considered him to be different from them .