Benchmark Utils - torch.utils.benchmark
class torch.utils.benchmark.Timer(stmt='pass', setup='pass', global_setup='', timer=, globals=None, label=None, sub_label=None, description=None, env=None, num_threads=1, language=Language.PYTHON)
Helper class for measuring execution time of PyTorch statements.
For a full tutorial on how to use this class, see:
   https://pytorch.org/tutorials/recipes/recipes/benchmark.html
The PyTorch Timer is based on timeit.Timer (and in fact uses
   timeit.Timer internally), but with several key differences:


Runtime aware:
         Timer will perform warmups (important as some elements of
         PyTorch are lazily initialized), set threadpool size so that
         comparisons are apples-to-apples, and synchronize
         asynchronous CUDA functions when necessary.


Focus on replicates:
         When measuring code, and particularly complex kernels /

