Level-shifted push-pull gate driver speed problems
Yes, turn-off delay is your big problem. Try







simulate this circuit &ndash; Schematic created using CircuitLab

Part (but only part) of your problem is the low current levels you're using, and dropping the resistor values (especially the base resistor) helps speed things up.