iTunes Smart Playlist - currently playing track
I think there's a two-step solution to this:

First create a smart playlist for tracks that are unrated or have 3-5 stars.

Second, set that playlist as the source for iTunes DJ, and play tracks using that. Last I checked, tracks would play through even if they wound up getting tagged in mid-play in a way that would remove them from the smart playlist.