Any way to use N-channel mosfet in P-channel configuration?
As Olin says, the definition of ON can mean a few things - for instance, do you mean current flowing from drain to source? Or a "high" voltage at the drain in a common source setup?

If you mean a way of switching an N-ch MOSFET off when a positive voltage relative to the source is applied to the gate, the answer is no, there is nothing "clever" that can be done.  

However, there are a couple of options depending on what it is you need to do:

If it's a voltage signal you want to drive a load (.e. current gain needed), a simple way to achieve this would be to put another N-ch common drain MOSFET in front of it to invert the signal, for example something like this:



If the current gain is unimportant, but you wish to switch a larger voltage, then a common gate setup could be used:



Simulation: