iPhone 4 doesn't prompt password verification when attempting to connect to AirPlay
I spent a while recently pondering what I think is the same issue.

Eventually I found that AirPlay Mirroring requires an iPhone 4S or later.

So audio should play wirelessly from the iPhone 4, but screen mirroring won't work.

Hope that helps.