How do I get rigidbody physics + constraints to interact with a mesh animated with an armature?
Got an answer over discord but I figured I'd post it here to help anyone who finds this in the future.

Connect the "stick" to the armature using object constraints instead of the armature modifier.