his stepfather wanted to formally adopt him and tony was bright enough to realise that if he followed his inclination and said no , his mother , his brother and three sisters as well as he himself , would cop hell during the ensuing fallout .