Mining on Linux with an USB hard-deive
That would probably work fine.  Mining doesn't generally require fast disk access, especially if you are mining in a pool.

Of course, you'll have to reboot into your Ubuntu installation each time you want to start mining, and you won't be able to use your "daily" operating system at the same time as mining.