Does MAX3665 amplifier have a minimum operating frequency?
The small signal response starts to drop significantly after 100kHz, flat from 500kHz to 700MHz. You should be able to see signals of a 100MHz. It could be something else. I would test the transmitter with a detector that you know that works to make sure that it's not the transmitter.