Is there a better way to exclude all "not actively created by a human" indexes than what I'm doing?
This will return a list of indexes that are used to implement a constraint:
SELECT conindid::regclass
FROM pg_constraint
WHERE contype IN ('p', 'u', 'x');

Exclude these indexes from your query result, and you have thr list you desire.