-
neuralmagic/Sparse-Llama-3.1-8B-gsm8k-2of4
Text Generation • Updated • 27 • 1 -
neuralmagic/Sparse-Llama-3.1-8B-evolcodealpaca-2of4-FP8-dynamic
Text Generation • Updated • 27 -
neuralmagic/Sparse-Llama-3.1-8B-2of4
Text Generation • Updated • 2.08k • 61 -
neuralmagic/Sparse-Llama-3.1-8B-gsm8k-2of4-FP8-dynamic
Text Generation • Updated • 91 • 1
![](https://cdn-avatars.huggingface.co/v1/production/uploads/noauth/qQp5Mx0lVZQLcA4ZKPi40.png)
NM Testing
company
AI & ML interests
None defined yet.
Recent Activity
View all activity
Collections
3
-
neuralmagic/Nous-Hermes-2-Yi-34B-pruned50
Text Generation • Updated • 14 -
neuralmagic/Nous-Hermes-2-Yi-34B-pruned2.4
Text Generation • Updated • 16 -
neuralmagic/Nous-Hermes-2-SOLAR-10.7B-pruned2.4
Text Generation • Updated • 12 -
neuralmagic/OpenHermes-2.5-Mistral-7B-pruned50
Text Generation • Updated • 45 • 1
models
383
![](https://cdn-avatars.huggingface.co/v1/production/uploads/noauth/qQp5Mx0lVZQLcA4ZKPi40.png)
nm-testing/TinyLlama-1.1B-Chat-v1.0-W4A16_2of4-e2e
Text Generation
•
Updated
•
125
![](https://cdn-avatars.huggingface.co/v1/production/uploads/noauth/qQp5Mx0lVZQLcA4ZKPi40.png)
nm-testing/TinyLlama-1.1B-Chat-v1.0-W4A16_2of4_channel-e2e
Text Generation
•
Updated
•
162
![](https://cdn-avatars.huggingface.co/v1/production/uploads/noauth/qQp5Mx0lVZQLcA4ZKPi40.png)
nm-testing/TinyLlama-1.1B-Chat-v1.0-sparse2of4_only-e2e
Updated
•
64
![](https://cdn-avatars.huggingface.co/v1/production/uploads/noauth/qQp5Mx0lVZQLcA4ZKPi40.png)
nm-testing/TinyLlama-1.1B-Chat-v1.0-sparse2of4_fp8_dynamic-e2e
Updated
•
22
![](https://cdn-avatars.huggingface.co/v1/production/uploads/noauth/qQp5Mx0lVZQLcA4ZKPi40.png)
nm-testing/TinyLlama-1.1B-Chat-v1.0-kv_cache_default_tinyllama-e2e
Updated
•
29
![](https://cdn-avatars.huggingface.co/v1/production/uploads/noauth/qQp5Mx0lVZQLcA4ZKPi40.png)
nm-testing/Qwen2.5-0.5B-sparse2of4_fp8_dynamic-e2e
Updated
![](https://cdn-avatars.huggingface.co/v1/production/uploads/noauth/qQp5Mx0lVZQLcA4ZKPi40.png)
nm-testing/Meta-Llama-3-8B-Instruct-AttnQuantOnly
Updated
![](https://cdn-avatars.huggingface.co/v1/production/uploads/noauth/qQp5Mx0lVZQLcA4ZKPi40.png)
nm-testing/Meta-Llama-3-8B-FP8-AttnQuant-WeightQuant
Updated
![](https://cdn-avatars.huggingface.co/v1/production/uploads/noauth/qQp5Mx0lVZQLcA4ZKPi40.png)
nm-testing/Meta-Llama-3-8B-FP8-AttnQuant
Updated
![](https://cdn-avatars.huggingface.co/v1/production/uploads/noauth/qQp5Mx0lVZQLcA4ZKPi40.png)
nm-testing/TinyLlama-1.1B-Chat-v1.0-actorder-group-e2e
Text Generation
•
Updated
•
106