Standard email Android 4 client doesn't keep local copy of emails
Are you really using POP3? It's a behaviour of IMAP... not POP3. If yes, it's certainly a bug. Better, use different email client like K9-mail.