Can iTunes find all songs with no Album Art?
You can do this by creating a Smart Playlist:

(I'm using a Mac, but it will be similar for you)



Set the "Album Artwork" rule to "false":


This will update automatically as you add artwork to your albums. And you can simply delete this playlist when you're done.