Hand is not glued to gun as expected
Solution: The gun and body armatures were separate, so I deleted the original gun armature and created one inside the body armature. Using IK that targets the last bone of the gun and uses the gun mesh as a pole. I could achieve an almost, if not completely perfect result.
Took me way too long to find it myself, so I'll leave it here for others, who suffer from the same problem.