Yosemite Storage Analysis
Finally found it :)

Under home directory Library has all the data and most of them came from mail app which includes downloaded imap copies and attachments. I erased them by using mail app and everything is fine for now.