Bypass server memory_limits for Cloud Asset resources
I don't think there is anything native in Craft that is going to help you here.

FTP is probably the best bet.  Only images get downloaded from external sources during indexing, so it's a simple as FTP'ing up the files and rebuild the asset source indexes (which could be automated via cron job).