How to change owner of a table within a PostgreSQL Database on Azure?
That doesn't seem to be specific to Azure. It's a general rule in Postgres: Only the owner or a superuser can use ALTER TABLE.

To verify your role is a superuser (or not), run in the current session:

SELECT rolsuper FROM pg_roles WHERE rolname = current_user;


Related:


Give particular privileges for a table to existing role