I have a dataset where I have a large number of addresses. The problem lies in the fact that many addresses although they are same but haven't been noted down in the same manner. So I want to find these addresses which are similar and clean my data from the duplicate data. Is there any standard approach or algorithms that can help me? How should I go about this problem? 
How to perform Cleaning of a very large set of addresses
bigdata;data cleaning