Coaxial/UTP Equalization Circuit
I think you'll do just fine with equalization. RG59 (Belden 8212) is pretty good coax and you can find the attenuation figures HERE for virtually any commonly available coax - it's a calculator so just plug the numbers in i.e. frequency, cable length etc. and bingo out pops the attenuation: -



It's really not a hard cable to equalize up to 10MHz (attenuation about 6.5 dB at 10 MHz and I would suggest that pre-emphasis is the best way to go (then your receiver isn't going to be too upset).

So, plot out the counter-response you need and make a peaking filter that roughly matches the emphasis you need to apply. Use (free) LTSpice for this or any PSpise software to hand.

I've had to do this for 660 Mbps over 50m of very good coax but it still benefitted from a bit of emphasis. In the end we decided to use CAT7 but the idea was proven as far as I am concerned.