Remove Quotes from Text Fields
As it happens, this solved my issue: {{ personfirstandlastname|replace({'\'':''}) }}

EDIT

To clarify, this isn't a valid Twig object:

{'\'',''}


... while this is:

{'\'':''}