What does this SQL Server icon mean? What does the icon of a server with a blue database symbol mean?
It's definitely SQL Azure. You can easily recognize it as the icon is azure, unlike the green one for a regular SQL Server instance

You can see the the video by Thomas LaRock here

How To Connect to SQL Azure database using SSMS