LangChain is probably the wrong paradigm for AI agents. The right solution:
- Wrap all of your ML models in a Flask http endpoint
- Run a web server in a fast, type safe, good concurrency language
- Send http requests over localhost, Ethernet, or infiniband