RSS Icon at browser's address bar
If you have a custom module, you can use drupal_add_feed, should work for both D6 and D7:

function CUSTOM_preprocess_page(&amp;$vars) {
  drupal_add_feed(url('path/to/feed'), 'Feed Title');
  $vars['head'] = drupal_get_html_head();
}