90 Ti
48

213.19
186.55

12.50









4090
1
5.54
4.99
4.51
4.44
11.02
19.86
4090
4
13.67
11.4
10.3
9.84
13.68
28.02
4090
8

19.79
17.13
16.19
18.19

4090
16

38.62
33.14
32.31
16.34

4090
32 (1)

76.57
65.96
62.05
18.96

4090
48

114.44
98.78

13.68

(1) Batch Size >= 32 requires enable_vae_slicing() because of https://github.com/pytorch/pytorch/issues/81665
This is required for PyTorch 1.13.1, and also for PyTorch 2.0 and batch size of 64
F