Renaming a column in a materialized view with an unknown name
I just remembered you can quote table names, and I guess this works to escape the question marks.

ALTER MATERIALIZED VIEW temp_name_relationships RENAME COLUMN "?column?" TO score;