High current usage from LDO when not hooked up to VIN
Now I hook up a 3.3V supply directly to the VOUT of the MCP and let the VIN floating

You are misusing the regulator outside of its intended regime of operation; the answer is not to do that; not only does it yield undesired results, it may over time cause damage.
One specific specification you are violating is the statement in the Absolute Maximum Ratings that the voltage on any pin may not exceed that on Vin by more than 0.3 volts.  Naturally, with nothing on Vin this is violated.
Your diagram shows the /shutdown input wired to Vin, so if you have the &quot;A&quot; rather than &quot;B&quot; version of the chip, you have possibly also activated the regulator's &quot;discharge transistor&quot; which shunts the output pin to ground with the intent of draining downstream capacitors.  I'd actually have expected a yet higher load from this, so maybe that isn't happening and you're only seeing a violation of the first concern.
Generally speaking, outputs are for output and should not be driven but something else.  There do exist regulators which do allow backdriving the output, but it may take some searching to find one meeting your other needs.  If may be simpler if you just use a 5v supply to the input on the bench; you may have headroom for diode voting on the input if you need to support multiple inputs.