Control Fly Mode With Joystick?
I just started doing research on this subject. I would try a program like "Gopher360" you can do custom keyboard and mouse binds with a Xbox controller. It's not through Blender but it should get the job done in theory.