External oscillator problem
OK, the picture tells the big story - it's a layout problem - the xtal needs to be mounted right up at the pic pins and the two capacitors need to connect to 0V via the shortest possible route. At the moment, the wires to the xtal and caps has too much inductance and not surprising this will not work correctly.