event counters:


""num_alloc_retries"": number of failed "cudaMalloc" calls that
     result in a cache flush and retry.


""num_ooms"": number of out-of-memory errors thrown.


The caching allocator can be configured via ENV to not split blocks
   larger than a defined size (see Memory Management section of the
   Cuda Semantics documentation). This helps avoid memory
   fragmentation but may have a performance penalty. Additional
   outputs to assist with tuning and evaluating impact:


""max_split_size"": blocks above this size will not be split.


""oversize_allocations.{current,peak,allocated,freed}"": number
     of over-size allocation requests received by the memory
     allocator.


""oversize_segments.{current,peak,allocated,freed}"": number of
     over-size reserved segments from "cudaMalloc()".


Parameters:
      device (torch.device or int, optional) -- selected
      device. Returns statistics for the current device, given by