Upload folder using huggingface_hub
Browse files
README.md
CHANGED
|
@@ -6,7 +6,7 @@ pipeline_tag: text-generation
|
|
| 6 |
<div align="center">
|
| 7 |
<h1>UltraGist for Mistral-7B-Instruct-v0.2</h1>
|
| 8 |
|
| 9 |
-
[<a href="https://github.com/namespace-Pt/UltraGist">Github</a>]
|
| 10 |
</div>
|
| 11 |
|
| 12 |
UltraGist is a context compression method can **flexibly**, **effectively**, and **efficiently** to handle various context lengths and compression ratios. We apply UltraGist on [Mistral-7B-Instruct-v0.2](https://huggingface.co/mistralai/Mistral-7B-Instruct-v0.2).
|
|
@@ -64,7 +64,3 @@ with torch.no_grad():
|
|
| 64 |
print(f"Memory: {compressed_memory[0][0].shape}")
|
| 65 |
print("*"*20)
|
| 66 |
```
|
| 67 |
-
|
| 68 |
-
## Citation
|
| 69 |
-
```
|
| 70 |
-
```
|
|
|
|
| 6 |
<div align="center">
|
| 7 |
<h1>UltraGist for Mistral-7B-Instruct-v0.2</h1>
|
| 8 |
|
| 9 |
+
[<a href="https://arxiv.org/abs/2405.16635">Paper</a>] [<a href="https://github.com/namespace-Pt/UltraGist">Github</a>]
|
| 10 |
</div>
|
| 11 |
|
| 12 |
UltraGist is a context compression method can **flexibly**, **effectively**, and **efficiently** to handle various context lengths and compression ratios. We apply UltraGist on [Mistral-7B-Instruct-v0.2](https://huggingface.co/mistralai/Mistral-7B-Instruct-v0.2).
|
|
|
|
| 64 |
print(f"Memory: {compressed_memory[0][0].shape}")
|
| 65 |
print("*"*20)
|
| 66 |
```
|
|
|
|
|
|
|
|
|
|
|
|