Should Word Replacement work on button text?
Yes, Word Replacements does work for this. I replicated your issue as it is case sensitive. The helper text says:

IMPORTANT: Replacements are case-sensitive whether 'Exact Match' is checked or not.

To get it to work you need to enter it as Contribute in Propercase.

I referenced the value of it below as custom CSS styling could differ from the value: