Parenting Object to Bone not Working
The answer to the problem is that I was trying to parent the object in REST mode. In order for this to work it has to be POSE mode.

If anyone wants to contribute an understanding of what REST mode is even for, that would be helpful for anyone getting to grips with this problem.