How to rig the fingers
Looks like your space is set to world instead of local for your "copy rotation" constraint. I would also recommend changing the bone roll of the fingers bones to bend along the x axis.

Then tweak the amount of influence for the bones with the constraints applied.