802.11 G & B routers transmit at 2.4 ghz.  802.11a routers transmit at 5 ghz.  You may be able to pick up your router signal with an old school cordless phone where you can change channels, but you won't hear anything but fuzz really.
What radio frequency does my wireless router transmit at?  Would I be able to hear it with a scanner.?