Can OS X users get locked on OS X similar to on ubuntu when using git?
I just had to delete the entry from known_hosts file on my MAC(client) to remove the traces of old config for that particular gitlab server. And also I regenerated my ssh keys back which seemed to work! :)

I used githubs awesome article to regenerate the ssh-keys.