[Beta] functorch -> torch.func
Inspired by Google JAX, functorch is a library that offers composable vmap (vectorization) and autodiff transforms. It enables advanced autodiff use cases that would otherwise be tricky to express in PyTorch. Examples include:
* model ensembling
* efficiently computing jacobians and hessians
* computing per-sample-gradients (or other per-sample quantities)