Pose mirroring wrong
I solved my problem.
For every bone in Edit Mode, I had to set the Roll value to 0.
Then, for some bones with Bone Constraints, I had to set the Pole Angle to 0 or 180.
Finally, I had to clear parents for my meshes and parent them to the bones again.