1. A method, in an information handling system comprising a processor and a memory, of scaling a workload being executed in a cloud computing environment, the method comprising: providing incoming traffic of the workload concurrently to both a scaled up resource configuration and a scaled out resource configuration, wherein the scaled up resource configuration adds additional resources to a first virtual machine (VM) running the workload, and wherein the scaled out resource configuration adds one or more VMs to a second VM to create a first plurality of VMs running the workload; comparing a plurality of test results generated from the scaled up resource configuration and the scaled out resource configuration, the comparison resulting in an optimal resource configuration; and optimizing a workload scaling profile based upon the optimized resource configuration.