How do I join an existing outlet into PVC electrical boxes and conduit?
Get a cover plate with a knockout and a 90 degree connector to your NMT.  That should get you started.  If doing it for myself I'd use PVC conduit and an entrance ell, but that's just personal preference.