Does Drupal detect if the user register email could not be delivered and removes the account?
Drupal doesn't know about the status of the email. I'm not sure how Drupal 5 does it, but it would be possible to setup Drupal to delete accounts older than X that has never logged in.