24
15.00

3090 Ti
16

75.37
66.63
64.5
14.42

3090 Ti
32 (1)

142.55
128.89
124.92
12.37









4090
1
5.54
4.99
2.66
2.58
48.30
53.43
4090
4
13.67
11.4
8.81
8.46
25.79
38.11
4090
8

19.79
17.55
16.62
16.02

4090
16

38.62
35.65
34.07
11.78

4090
32 (1)

76.57
69.48
65.35
14.65

4090
48

114.44
106.3

7.11

(1) Batch Size >= 32 requires enable_vae_slicing() because of https://github.com/pytorch/pytorch/issues/81665.
This is required for PyTor