What is the best way to upload custom-parsed data into AWS Aurora PostgreSQL
I could write to a CSV file and use COPY, but the size would be astronomical


You could write the CSV data stream to a pipe rather than a file:

geneate_csv | psql -c '\copy tablename from stdin'


or

\copy tablename from program 'generate_csv'