Is it true that only UTXOs can be used as Transaction Inputs?
This question makes no sense.

Of course you can make an invalid transaction that doesn't spend an unspent output. If you're fine with calling invalid things transactions, I could just take a piece of random data and call it a transaction.

A valid transaction can only spend unspent outputs.