a fight between him and i did not ensue that day simply because ( i realize now ) that he was from a very good family who i guess must have taught him that the bigger man need only to walk away and not to get involved with horrible children ( like myself at the time ) .