Switching and protecting batteries from external power supplies
This circuit should do what you want.  

The two diodes steer either the output of the boost regulator or the external supply to the load.  The typical V\$_{F}\$ of the diodes is 100 mV at a 100 mA load, which should not have much of an effect on your circuitry.

The two diodes are available in surface mount.