Custom Layer 4 Load Balancer
Historically, F5's Application Delivery Controller has been the enterprise-grade industry solution for doing this. With this solution you can:


Use iRules LX to communicate with other software to auto-scale on an as-needed basis
Load balance at Layer 4 (to achieve better throughput/acceleration) or Layer 7
Share memory between Virtual Servers (there may be a better way using iRules LX instead of just iRules)
Bridge or offload/terminate TLS on the Load Balancer
Have vendor support and consulting if needed
Do all of this in Amazon's cloud  (or anyone else's; you can also run it in-house)
Scale to millions more connections than Kubernetes, nginx, or any other load balancer solution that doesn't use a microkernel is capable of.