Login menu which I added in main menu still displaying even after logged-in
You need two have two menu items, login and logout.

For the login link the path is: user/login
and for logout the path is: user/logout

Make sure you don't enter a absolute URL to the links, just user/login and user/logout.

I have just tested this by adding two menu items to the primary menu.