Bones don't respond to rigid body
Found your problem, there's a magic 90 degrees on one of your empty objects, if you reset to 0 it works like you wanted.

You can see the other empty that connects the other leg, doesn't have that 90 degrees on the X Axis.
Cheers,