1. A method, comprising: monitoring, by a load balancer executed by a processing device, an overall load measurement of containers associated with an application executed on virtual machines (VMs) in a multi-tenant Platform-as-a-Service (PaaS) system, wherein the overall load measurement is a summation of individual current loads at the containers; comparing, by the load balancer, the overall load measurement to an overall load threshold for the containers; and when the overall load measurement exceeds the overall load threshold, causing resources to be added to execute functionality of the application in the VMs of the multi-tenant PaaS system.