justin kept his expression neutral so as not to upset his grandmother ; his reluctance to live at royston house was due more to the fact that he associated this house with the frequent absences of his parents during his childhood , and his subsequent loneliness , than because he feared his grandmother would put a crimp in any supposed excesses of his in gambling and wenching , as she put it .