Edit Models filters

Inference Providers

HF Inference API

Misc

arxiv: 2301.00774

AutoTrain Compatible

Inference Endpoints

text-generation-inference

Misc with no match

4-bit precision

8-bit precision

text-embeddings-inference

Carbon Emissions

Mixture of Experts

Models

75

Full-text search

Active filters: 2301.00774

neuralmagic/Sparse-Llama-3.1-8B-2of4

Text Generation • Updated Dec 16, 2024 • 2.08k • 61

Thireus/Vicuna13B-v1.1-8bit-128g

Text Generation • Updated Apr 22, 2023 • 23 • 16

neuralmagic/mpt-7b-gsm8k-pruned50-quant-ds

Text Generation • Updated Oct 12, 2023 • 14

neuralmagic/mpt-7b-gsm8k-pruned40-quant-ds

Text Generation • Updated Oct 12, 2023 • 6

neuralmagic/mpt-7b-gsm8k-pruned60-quant-ds

Text Generation • Updated Oct 12, 2023 • 16

neuralmagic/mpt-7b-gsm8k-pruned70-quant-ds

Text Generation • Updated Oct 12, 2023 • 12 • 1

neuralmagic/mpt-7b-gsm8k-pruned80-quant-ds

Text Generation • Updated Oct 12, 2023 • 13 • 2

neuralmagic/mpt-7b-gsm8k-pruned75-quant-ds

Text Generation • Updated Oct 12, 2023 • 6

neuralmagic/mpt-7b-gsm8k-pruned60-pt

Text Generation • Updated Dec 4, 2023 • 22

neuralmagic/zephyr-7b-beta-pruned50-quant-ds

Text Generation • Updated Jan 9, 2024 • 18

neuralmagic/TinyLlama-1.1B-Chat-v0.4-pruned50-quant-ds

Text Generation • Updated Jan 29, 2024 • 56

neuralmagic/OpenHermes-2.5-Mistral-7B-pruned50-quant-ds

Text Generation • Updated Dec 6, 2023 • 9 • 2

mgoin/Orca-2-13b-pruned50-quant-ds

Text Generation • Updated Nov 26, 2023 • 8

neuralmagic/MiniChat-3B-pruned50-quant-ds

Text Generation • Updated Jan 2, 2024 • 20

nm-testing/open_llama_3b-pruned50-quant-ds

Text Generation • Updated Jan 11, 2024 • 4

nm-testing/shearedplats-2.7b-v2-pruned50-quant-ds

Text Generation • Updated Jan 2, 2024 • 4

neuralmagic/MiniChat-1.5-3B-pruned50-quant-ds

Text Generation • Updated Jan 8, 2024 • 35 • 1

nm-testing/open-llama-3b-everythingLM-2048-pruned50-quant-ds

Text Generation • Updated Jan 2, 2024 • 4

nm-testing/open_llama_3b_instruct_v_0.2-pruned50-quant-ds

Text Generation • Updated Jan 2, 2024 • 7

nm-testing/glaive-coder-7b-pruned50-quant-ds

Text Generation • Updated Dec 18, 2023 • 11

nm-testing/dopeyplats-1.1b-2T-v1-pruned50-quant-ds

Text Generation • Updated Jan 2, 2024 • 4

nm-testing/smol-3b-pruned60-quant-ds

Text Generation • Updated Jan 2, 2024 • 4

nm-testing/AmberChat-pruned60-quant-ds

Text Generation • Updated Dec 15, 2023 • 6

nm-testing/AmberChat-pruned60-quant-ds-v2

Text Generation • Updated Dec 15, 2023 • 2

nm-testing/AmberChat-pruned50-quant-ds

Text Generation • Updated Dec 15, 2023 • 7

nm-testing/MiniChat-1.5-3B-pruned70-quant-ds

Text Generation • Updated Dec 19, 2023 • 6

nm-testing/MiniChat-1.5-3B-pruned60-quant-ds

Text Generation • Updated Jan 2, 2024 • 2

neuralmagic/SOLAR-10.7B-Instruct-v1.0-pruned50-quant-ds

Text Generation • Updated Dec 20, 2023 • 13 • 5

nm-testing/mistral-7b-dpo-merge-v1.1-pruned50-quant-ds

Text Generation • Updated Jan 19, 2024 • 6

neuralmagic/Nous-Hermes-llama-2-7b-pruned50-quant-ds

Text Generation • Updated Dec 20, 2023 • 10