Unable to update/replace existing keyframe
So of course I find the answer a few minutes after I write up the question. I was selecting the entire armature, pressing I to insert keyframe and selecting "position". When I tried using "whole character" instead it worked as I'd hoped.