How could I load content from one Craft install into a template of another
I think your idea of RSS or JSON would work fine.

The only reason I can think of to use RSS over JSON would be if there was a possibility you wanted RSS readers to be able to consume the content as well.  Otherwise, I'd just stick with JSON and expose it over a web accessible API.