Is surrounding yourself with good people a form of aversion?
An analogy, in martial arts, when one needs to train and toughen up their knuckles, he wouldn't just start out punching bricks right away. He has to start with punching paper stacks, then move on to punching beans, then to sands, etc. Only after a period when his knuckles become strong enough then he'd practice on bricks. Similarly, your mind isn't conditioned to handle bad evil people with peace and equanimity. So first you have to start with good people to build up the needed strength. This doesn't mean you should completely avoid bad people. Try your best to treat them kindly and compassionately until the day your mind is strong enough to handle any kind of person or any kind of situation with peace and equanimity.