Spaces:
Running
on
Zero
Running
on
Zero
from dataclasses import dataclass | |
import torch | |
class Cache: | |
key_states: torch.Tensor | |
value_states: torch.Tensor | |