Problems starting PIC18F4680
It sounds like you have it set up in MPLAB to use the PICkit as a debugger, not a programmer.  That will allow it to work with the PICkit connected and running MPLAB, but not stand alone.  Make sure the debug config bit is off and that you program the part with the PICkit as a programmer, not as a debugger.