TST: Fix flaky import test
I'm not sure why, but the missing dependency test is
causing issues. Now we check that things work by running
it in a subprocess with site-packages disabled.

Closes https://github.com/pandas-dev/pandas/issues/26952