What SQL query can I run to remove all users assigned to a particular group?
You've done it the correct way.  Assuming all of Craft's foreign keys and cascading deletes are all still in place, removing the user's element ID from the craft_elements table is the way to go and all related data will cascade delete from there.