oh , he was certain that many of the ton referred to him , behind his back , as being 'arrogantly haughty ' or 'coldly disdainful ' , and even on occasion as being 'harsh and imperious ' just like his grandmother was , but they would not have dared to do so to his face .