Full tv out for iPhone 3GS or iPhone 4
Based on your question, I think you might be referring to mirroring, which is only supported by the iPad 2.

For other devices, it'll do video out as long as the app itself supports it, as you suggest.