Is it possible to take control of Blender with a standalone Python instance?
You'll have to build it yourself, but you can build Blender as a Python module. You can then do import bpy and use it as if you're inside Blender.