it would have seemed odd to leave the room , so grey remained , but in deference to what he assumed to be fraser 's sensibilities , he stood back and allowed tom to help fraser remove his breeches , averting his own gaze without being obvious about it .