Can a magnet be an antenna?
The field from a permanent magnet is the magnetic equivalent of DC; zero frequency. It shouldn't bother a bit, in terms of receiving. Now if you were transmitting through it, you might degauss it, but the power levels in receiving are so low as to not be a concern.