Manage Postgres user permissions with many databases and users
You use roles that have privileges on the objects.

The end users have no privileges assigned, but are members of those roles whose privileges they should inherit.

Then you can simply drop end users, and adding them just means adding them to a couple of roles.