Ok to hook up water filters to a regular kitchen faucet?
Good idea. There's really no problem with that approach aside from the stagnant water that will accumulate in the faucet's hot water stub, which could be a health concern (or just gross). 

Instead, split your filtered water supply and run it to both the hot and cold sides of the faucet. This has the additional benefit of making the faucet flow full in all temperature modes.