load switch capacitance constraint
Another solution is to add an RC circuit to the gate of the MOSFET to slow the turn-on, which limits the drain current and reduces the risk of causing a glitch at the supply end. Here from On Semi AND9093/D: 



The detailed calculations for the value of R1 and C1 are in the application note, but you need to estimate the gfs of the MOSFET. 

The part you have chosen also recommends a similar circuit (not quite the same, since it has Q1 and the load switch internally connected)



If you go beyond the 1000pF recommendation for C1, the switch will operate more slowly and you'll probably have to significantly derate the current handling capability to account for the transient heating during switching.