Hair Particle Objects change size and angle when parent object's bones are rotated
After a lot of searching the web I found the root cause of the problem: I have to apply Ctrl +  A Scale, Rotation, Size. This fixes the problem.
Frankly, I don't really understand what Ctrl +  A does, but it works.