5 (512x512 resolution):

Latency (batch size = 1)
Throughput (batch size = 8)
first-generation Gaudi
4.22s
0.29 images/s
Gaudi2
1.70s
0.925 images/s
Stable Diffusion v2.1 (768x768 resolution):

Latency (batch size = 1)
Throughput
first-generation Gaudi
23.3s
0.045 images/s (batch size = 2)
Gaudi2
7.75s
0.14 images/s (batch size = 5)
