What does this SQL Server icon mean?
It's definitely SQL Azure. You can easily recognize it as the icon is azure, unlike the green one for a regular SQL Server instance

You can see the the video by Thomas LaRock here

How To Connect to SQL Azure database using SSMS