OpenVINO/phi-2-fp16-ov
Text Generation
•
Updated
•
138
•
1
LLM
Collection of OpenVINO optimized LLMs
-
-
OpenVINO/phi-2-int8-ov
Text Generation • Updated • 56 -
OpenVINO/mistral-7b-instruct-v0.1-int8-ov
Text Generation • Updated • 106 • 1 -
OpenVINO/mistral-7b-instruct-v0.1-fp16-ov
Text Generation • Updated • 23 -
OpenVINO/mistral-7b-instruct-v0.1-int4-ov
Text Generation • Updated • 277 -
OpenVINO/codegen25-7b-multi-fp16-ov
Text Generation • Updated • 4 -
OpenVINO/codegen25-7b-multi-int8-ov
Text Generation • Updated • 10 • 1 -
OpenVINO/mixtral-8x7b-instruct-v0.1-int4-ov
Text Generation • Updated • 30 • 4 -
OpenVINO/Mixtral-8x7B-Instruct-v0.1-int8-ov
Text Generation • Updated • 69 • 3 -
OpenVINO/notus-7b-v1-fp16-ov
Text Generation • Updated • 4 -
OpenVINO/notus-7b-v1-int8-ov
Text Generation • Updated • 7 -
OpenVINO/neural-chat-7b-v3-3-fp16-ov
Text Generation • Updated • 11 -
OpenVINO/neural-chat-7b-v3-3-int8-ov
Text Generation • Updated • 15 -
OpenVINO/zephyr-7b-beta-int8-ov
Text Generation • Updated • 10 -
OpenVINO/zephyr-7b-beta-int4-ov
Text Generation • Updated • 60 -
OpenVINO/dolly-v2-3b-int4-ov
Text Generation • Updated • 33 -
OpenVINO/dolly-v2-3b-int8-ov
Text Generation • Updated • 27 -
OpenVINO/dolly-v2-3b-fp16-ov
Text Generation • Updated • 38 -
OpenVINO/codegen2-3_7B_P-int4-ov
Text Generation • Updated • 2 -
OpenVINO/codegen2-3_7B_P-fp16-ov
Text Generation • Updated • 2 -
OpenVINO/zephyr-7b-beta-fp16-ov
Text Generation • Updated • 25 -
OpenVINO/codegen2-3_7B_P-int8-ov
Text Generation • Updated • 2 • 1 -
OpenVINO/TinyLlama-1.1B-Chat-v1.0-fp16-ov
Text Generation • Updated • 192 • 1 -
OpenVINO/TinyLlama-1.1B-Chat-v1.0-int4-ov
Text Generation • Updated • 132 -
OpenVINO/TinyLlama-1.1B-Chat-v1.0-int8-ov
Text Generation • Updated • 120 -
OpenVINO/gpt-neox-20b-int8-ov
Text Generation • Updated • 11 -
OpenVINO/gpt-neox-20b-fp16-ov
Text Generation • Updated • 9 -
OpenVINO/gpt-j-6b-int4-ov
Text Generation • Updated • 35 -
OpenVINO/gpt-j-6b-int8-ov
Text Generation • Updated • 11 -
OpenVINO/gpt-j-6b-fp16-ov
Text Generation • Updated • 5 -
OpenVINO/falcon-7b-instruct-int4-ov
Text Generation • Updated • 6 -
OpenVINO/falcon-7b-instruct-fp16-ov
Text Generation • Updated • 13 -
OpenVINO/falcon-7b-instruct-int8-ov
Text Generation • Updated • 3 -
OpenVINO/open_llama_7b_v2-int8-ov
Text Generation • Updated • 31 -
OpenVINO/open_llama_7b_v2-int4-ov
Text Generation • Updated • 39 -
OpenVINO/open_llama_7b_v2-fp16-ov
Text Generation • Updated • 27 -
OpenVINO/open_llama_3b_v2-int8-ov
Text Generation • Updated • 211 • 1 -
OpenVINO/open_llama_3b_v2-fp16-ov
Text Generation • Updated • 15 -
OpenVINO/phi-2-int4-ov
Text Generation • Updated • 14 • 1 -
OpenVINO/neural-chat-7b-v3-3-int4-ov
Text Generation • Updated • 789 -
OpenVINO/notus-7b-v1-int4-ov
Text Generation • Updated • 96 -
OpenVINO/RedPajama-INCITE-Chat-3B-v1-int8-ov
Text Generation • Updated • 7 -
OpenVINO/RedPajama-INCITE-7B-Instruct-fp16-ov
Text Generation • Updated • 13 -
OpenVINO/RedPajama-INCITE-7B-Instruct-int4-ov
Text Generation • Updated • 2 -
OpenVINO/RedPajama-INCITE-7B-Chat-int4-ov
Text Generation • Updated • 9 -
OpenVINO/RedPajama-INCITE-7B-Instruct-int8-ov
Text Generation • Updated • 3 -
OpenVINO/RedPajama-INCITE-7B-Chat-fp16-ov
Text Generation • Updated • 5 -
OpenVINO/RedPajama-INCITE-Chat-3B-v1-int4-ov
Text Generation • Updated • 7 -
OpenVINO/RedPajama-INCITE-7B-Chat-int8-ov
Text Generation • Updated • 5 -
OpenVINO/RedPajama-INCITE-Chat-3B-v1-fp16-ov
Text Generation • Updated • 2 -
OpenVINO/dolly-v2-7b-int4-ov
Text Generation • Updated • 4 -
OpenVINO/dolly-v2-7b-int8-ov
Text Generation • Updated • 4 -
OpenVINO/dolly-v2-7b-fp16-ov
Text Generation • Updated • 3 -
OpenVINO/Mistral-7B-Instruct-v0.2-int8-ov
Text Generation • Updated • 63 • 1 -
OpenVINO/dolly-v2-12b-int8-ov
Text Generation • Updated • 19 -
OpenVINO/Mistral-7B-Instruct-v0.2-int4-ov
Text Generation • Updated • 817 • 1 -
OpenVINO/Mistral-7B-Instruct-v0.2-fp16-ov
Text Generation • Updated • 23 -
OpenVINO/codegen25-7b-multi-int4-ov
Text Generation • Updated • 12 -
OpenVINO/persimmon-8b-chat-int4-ov
Text Generation • Updated • 7 -
OpenVINO/persimmon-8b-chat-int8-ov
Text Generation • Updated • 4 -
OpenVINO/pythia-1.4b-int4-ov
Text Generation • Updated • 2 -
OpenVINO/pythia-1.4b-int8-ov
Text Generation • Updated • 5 -
OpenVINO/persimmon-8b-chat-fp16-ov
Text Generation • Updated • 2 -
OpenVINO/pythia-1.4b-fp16-ov
Text Generation • Updated • 3 -
OpenVINO/pythia-12b-int8-ov
Text Generation • Updated • 7 -
OpenVINO/pythia-2.8b-int8-ov
Text Generation • Updated • 5 -
OpenVINO/pythia-2.8b-int4-ov
Text Generation • Updated • 2 -
OpenVINO/pythia-12b-fp16-ov
Text Generation • Updated • 4 -
OpenVINO/pythia-6.9b-int4-ov
Text Generation • Updated • 2 -
OpenVINO/pythia-6.9b-int8-ov
Text Generation • Updated • 5 -
OpenVINO/pythia-2.8b-fp16-ov
Text Generation • Updated • 6 -
OpenVINO/pythia-6.9b-fp16-ov
Text Generation • Updated • 2 -
OpenVINO/pythia-1b-int4-ov
Text Generation • Updated • 6 -
OpenVINO/pythia-1b-int8-ov
Text Generation • Updated • 2 -
OpenVINO/pythia-1b-fp16-ov
Text Generation • Updated • 6 -
OpenVINO/neural-chat-7b-v1-1-int4-ov
Text Generation • Updated • 9 -
OpenVINO/neural-chat-7b-v1-1-int8-ov
Text Generation • Updated • 10 -
OpenVINO/neural-chat-7b-v1-1-fp16-ov
Text Generation • Updated • 9 -
OpenVINO/Phi-3-medium-4k-instruct-fp16-ov
Text Generation • Updated • 6 -
OpenVINO/Phi-3-medium-4k-instruct-int4-ov
Text Generation • Updated • 43 • 3 -
OpenVINO/Phi-3-medium-4k-instruct-int8-ov
Text Generation • Updated • 25 -
OpenVINO/mpt-7b-int8-ov
Text Generation • Updated • 9 -
OpenVINO/mpt-7b-fp16-ov
Text Generation • Updated • 8 -
OpenVINO/starcoder2-15b-int8-ov
Text Generation • Updated • 17 -
OpenVINO/starcoder2-15b-int4-ov
Text Generation • Updated • 12 -
OpenVINO/starcoder2-15b-fp16-ov
Text Generation • Updated • 32 -
OpenVINO/starcoder2-7b-fp16-ov
Text Generation • Updated • 9 -
OpenVINO/starcoder2-7b-int4-ov
Text Generation • Updated • 5 -
OpenVINO/starcoder2-7b-int8-ov
Text Generation • Updated • 6 -
OpenVINO/starcoder2-3b-int4-ov
Text Generation • Updated • 10 -
OpenVINO/starcoder2-3b-fp16-ov
Text Generation • Updated • 2 -
OpenVINO/starcoder2-3b-int8-ov
Text Generation • Updated • 8 -
OpenVINO/Phi-3-mini-4k-instruct-fp16-ov
Text Generation • Updated • 83 • 2 -
OpenVINO/Phi-3-mini-128k-instruct-fp16-ov
Text Generation • Updated • 183 -
OpenVINO/Phi-3-mini-128k-instruct-int4-ov
Text Generation • Updated • 122 • 2 -
OpenVINO/Phi-3-mini-4k-instruct-int4-ov
Text Generation • Updated • 5.21k • 2 -
OpenVINO/Phi-3-mini-4k-instruct-int8-ov
Text Generation • Updated • 10 -
OpenVINO/Phi-3-mini-128k-instruct-int8-ov
Text Generation • Updated • 192 • 3 -
OpenVINO/open_llama_3b_v2-int4-ov
Text Generation • Updated • 52 -
OpenVINO/RedPajama-INCITE-Instruct-3B-v1-fp16-ov
Updated • 1 -
OpenVINO/RedPajama-INCITE-Instruct-3B-v1-int4-ov
Updated • 6 -
OpenVINO/RedPajama-INCITE-Instruct-3B-v1-int8-ov
Updated • 1 -
OpenVINO/gemma-2b-it-fp16-ov
Updated • 67 -
OpenVINO/gemma-2b-it-int8-ov
Updated • 11 -
OpenVINO/gemma-2b-fp16-ov
Updated • 2 -
OpenVINO/gemma-2b-int4-ov
Updated • 16 -
OpenVINO/gemma-2b-it-int4-ov
Updated • 46 -
OpenVINO/gemma-7b-fp16-ov
Updated • 2 -
OpenVINO/gemma-7b-int4-ov
Updated • 10 -
OpenVINO/gemma-7b-int8-ov
Updated • 67 -
OpenVINO/gemma-7b-it-int8-ov
Updated • 2 -
OpenVINO/gemma-7b-it-fp16-ov
Updated • 1 -
OpenVINO/gemma-7b-it-int4-ov
Updated • 3 -
OpenVINO/bloomz-1b1-fp16-ov
Updated • 3 -
OpenVINO/bloomz-1b1-int4-ov
Updated • 5 -
OpenVINO/bloomz-3b-int8-ov
Updated • 1 -
OpenVINO/bloomz-1b1-int8-ov
Updated • 2 -
OpenVINO/bloomz-3b-int4-ov
Updated • 1 -
OpenVINO/bloomz-3b-fp16-ov
Updated • 5 -
OpenVINO/codegen-2B-multi-int8-ov
Updated • 21 -
OpenVINO/codegen-2B-multi-fp16-ov
Updated • 27 -
OpenVINO/codegen-2B-multi-int4-ov
Updated • 1 -
OpenVINO/codegen-6B-multi-int4-ov
Updated • 4 -
OpenVINO/codegen-6B-multi-fp16-ov
Updated • 6 -
OpenVINO/codegen-6B-multi-int8-ov
Updated • 4 -
OpenVINO/Phi-3.5-mini-instruct-fp16-ov
Updated • 112 -
OpenVINO/Phi-3.5-mini-instruct-int8-ov
Updated • 2.08k -
OpenVINO/Phi-3.5-mini-instruct-int4-ov
Updated • 187 • 3 -
OpenVINO/gemma-2-9b-it-int4-ov
Updated • 7 -
OpenVINO/gemma-2-9b-it-int8-ov
Updated • 6 -
OpenVINO/gemma-2-9b-it-fp16-ov
Updated • 2