is the only way to create a user for an azure database, to use SQL query?
Thats correct. Only via the Create User query. The GUI is not supported to create user and permissions for Azure sql database.
You can do that via any client (ssms) or the query editor in portal