How do I fix a Well Pump that is on Constantly?
There's trouble with the pressure tank.  You are right to be concerned.  Its bad for the pump to be running constantly.  

Is there a pressure gauge? What does it read?   Is the P-Tank full of water?  

It could be simply needs to be charged with air compressor.  When was last time?