Are there any hardware privkey/pubkey generators out there? I don't mean hardware wallet like Trezor but simply a device that is non-programmable, and not network connectable but will generate key pairs (+ the associated address would be handy but that could be done in software on only the pubkey without too much risk?) at the push of a button.

I'm wondering if this is one way to create a paper wallet and have it receive a number of BTC:

1.Generate a privkey/pubkey pair

2.Write the privkey down, duplicate it and store the copies safely. I guess this could potentially be split into pieces and stored in several separate places so that breach or loss of one does not give away the full privkey or lose the information needed to recreate it (like a paper RAID array implemented with three familiy members?) [and write recovery instructions in your testament]

3.Generate the bitcoin address associated with the pubkey (not so risky, afaict)

4.Receive the payment at this address

Until it comes to spending the BTC (which could be quite some time in the future) there would be no need for a software wallet, and certainly no need to use an online key generator.

In the absence of a hardware key generator I suppose downloading trusted code from sourceforge or somewhere and running it yourself on a non-networked computer is pretty much as secure?

(I realize rolling dice is fine to generate a privkey but the associated pubkey pretty much has to be done in code somewhere, no?).

Does this sound feasible?
There are no devices I know of which are dedicated to nothing but generating secp256k1 key pairs.  I suspect there never will be---that's a super-niche market possibly consisting of just you.  Moreover, I think you should be suspicious of any hardware designed to generate private keys for Bitcoin: corrupting such hardware to produce predictable keys could be highly profitable---at your expense.

In general, messing around with private keys directly has a high probability of ending in lost bitcoins.  A $50 USD used netbook from eBay to use as an offline signing-only wallet will be much easier to use and at least as secure as any system you think up yourself, provided you choose a secure wallet.