Remove the login that appears at the bottom of a registration profile
I suspect it's the Drupal login block - so to not show that on your civicrm pages - get into your blocks configuration and in the visibility settings make it such that it does not display on civicm/* (or make that less generic if you like).