
gather: backward of scatter_reduce, specially tuned for the GNN compute when the index is an expanded tensor.
torch.sparse.mm with reduce flag: performance hotspot in Message Passing when the edge index is stored in Compressed Sparse Row (CSR). Supported reduce flag of: sum, mean, amax, amin.

On PyG benchmarks/examples, OGB benchmarks, a 1.12x - 4.07x performance speedup is measured (1.13.1 compared with 2.0) for single node inference and training.



Model-Dataset

Option

Speedup Ratio




GCN-Reddit (inference)
   
512-2-64-dense
   
1.22x
   


1024-3-128-dense
   
1.25x
   


512-2-64-sparse
   
1.31x
   


1024-3-128-sparse
   
1.68x
   