1. A method for predicting acceleration in a hybrid system, comprising: determining a number of cross system calls in a first host-accelerator computer architecture running a workload; determining host machine overhead and accelerator overhead in the first host-accelerator computer architecture associated with each of the cross system calls; determining communication delay associated with each of the cross system calls in the first host-accelerator computer architecture running a workload; and predicting an application response time for a candidate application to be run in a second host-accelerator computer architecture, based at least on the determined host machine overhead, the accelerator overhead, and the communication delay associated with each of the cross system calls in the first host-accelerator computer architecture running a workload, wherein the determining communication delay associated with each of the cross system calls in the first host-accelerator computer architecture running a workload comprises at least: determining communication delay associated with each of the cross system calls in the first host-accelerator computer architecture running a workload, based on parameter inferencing using response time and central processing unit (CPU) utilization measurement of the first host-accelerator computer architecture running the workload.