Remove or replace exhaust fan assembly
You will most likely have to open the ceiling, remove the fan housing which was presumably nailed or screwed in place from the outside before the ceiling was fitted, install the new fan and repair the ceiling.
Drywall repair is a fact of life for getting things done, many times.