Is there such a thing as a backless junction box/conduit fitting?
Try using an 11b extension ring or a 1900 extension ring.  Actually made to deepen a junction box, but should work for this application.