Podcasts stay on iPhone even when asking to synch 0 episodes
Turning off the sync options will stop your phone syncing new episodes, but it won't remove the episodes that have already synced.

If there are episodes on your iPhone that you want to remove just drag the entry for the episode to the right to reveal a Delete button. Tap the Delete button and it will remove the episode from your phone.