Is it safe to delete multiple membership records after ensuring the Contact record has been merged?
It is okay to delete a duplicate membership, but if there is a payment associated with that membership record, that payment will also be deleted. If that is an issue, you may want to consider creating a new membership status to reflect these duplicate memberships, you'll be able to easily filter them from reports that way.