Servos: attach() and write()
attach tells the servo library which pin it should be writing to, this is stored somewhere in ram and write will look it up and communicate with the correct pin. 

It's possible that you are using the other pwm capable pins for other purposes and suddenly having that library interfere with that is not a good thing.