Do you load before paying?
In fact, you cannot load and move at the same moment, and as payment can only happen after a move, the problem you describe never occurs.
First you make the morning action (move and eventually pay or load) then the evening action (move and eventually pay or load).

it's explained on the "island" #2 (Action Types) in the rules.