Print of fine hole seems to twist
This looks like a shift rather than a twist.

Looking closely at the "+" opening, it doesn't look as much twisted as it looks as if the top and bottom halves are sheared, with the top half shifted slightly right and the bottom shifted slightly left.  The horizontal part of the plus seems aligned on the left and right halves.

When you press-fit the keycaps, you will "average" the displacement forces and the keycap will twist.

I am suspicious of a backlash problem in the X axis (left to right).  Perhaps the belt isn't tight enough, or some part shifts differently.  It could be in the rails, the belt, a loose drive pulley, the hot end being slightly loose on the carriage, or any uncontrolled movement.  It could be a high-friction x-axis which causes spring wind-up in the drive system.

I recommend carefully examining the printer for any excess friction or movement, and taking action to fix that first before tweaking the model to compensate for what can not be fixed.

If it is a twist, use more cooling.

If the photos have misled me, and the vertical "+" shaft if actually twisting, you may need to use higher cooling.  The drag of the filament as the head traces the perimeter can create a torque on the shaft, and if the plastic is not sufficiently cooled it could be dragged around.  I consider this more of a theoretical problem than a real one, and have not yet seen it in practice.

This is a beautiful design

This is a wonderful application of 3D printing.  With a multi-material printer it would be tempting to label the keys similar to old-style multi-shot keycaps.