I am really stumped with this one.

It seems that my laptop, while it has a USB in any of the ports, won't go past BIOS splash, no matter if I try to do a regular boot or try to use the "Novo" or OneKey rescue button it will just hang in the Lenovo Splash screen.

To start it is a Lenovo G500 laptop with one of those OneKey rescue buttons that lead you into boot selection (what device to boot from) or BIOS setup. Without the USB in it will go just fine and everything works. But I need to boot from my USB so that I can install Linux from it.

The steps I tried so far:

I disabled secure boot. It gets me stuck in an infinite boot cycle.

I tried every setting and every modification to BIOS (excluding flashing BIOS or clearing CMOS) to no avail, including: 

Setting Legacy boot (instead of UEFI). Nothing. 

Setting Legacy boot + usb boot enabled + Legacy usb support disabled, nothing.

It will boot into BIOS if I disable boot form USB. Making it impossible to boot from one, but that won't do because I need the USB to install the new OS.

The USB works fine, I tried it on another pc and It worked fine.
Now I've installed Linux on this machine before, in fact I did it 3 times this year alone, and it has always gone without a hitch... It has been 2 days now, and I don't know what else to try.