I cannot modify entity values
I finally managed to get this working. Under show available tokens, I previously had selected -- All --.

I have since changed this to be just the fields that I'm interested in having edited and it works as expected now.

My theory is that I have a lot of content types with a lot of fields and it was hitting some sort of memory error. However, I never saw an error reported.