Switching regulator startup voltage and sag
@DKNguyen was spot on. Thank you very much for taking the time to point out the mistake.
L1 above should have been connected to SW but was connected to the other pad of Cboot1, BOOT.
The whole time the entire circuit was running off the bootstrap voltage.