How to make particles fall straight down instead of initially going up?
This is the result of the direction that the normals are facing. If you rotate your plane 180° on the Y or X axis (upside down), it will be resolved.

Also you can flip your normals by going into edit mode and select all faces. Then press CtrlShiftN to flip the normals.