⚡ WebGPU Benchmark Results (4.64x speedup)
#17
by
michellediazvi
- opened
Batch Size | WASM (ms) | WebGPU (ms) |
1 | 977.40 | 88.30 |
2 | 2088.50 | 179.80 |
4 | 3994.50 | 240.20 |
8 | 7608.40 | 504.00 |
16 | 14822.20 | 1143.10 |
32 | 29871.30 | 6443.20 |
- Model: Xenova/all-MiniLM-L6-v2
- Quantized: false
- Sequence length: 512
- Browser: Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/122.0.0.0 Safari/537.36
- GPU: vendor=amd, architecture=gcn-4, device=, description=