relaxml/Llama-2-7b-chat-E8PRVQ-4Bit
Text Generation
•
Updated
•
75
QuIP# Quantized Models
https://github.com/Cornell-RelaxML/quip-sharp
-
-
relaxml/Llama-2-70b-E8PRVQ-4Bit
Text Generation • Updated • 27 -
relaxml/Llama-2-13b-E8PRVQ-4Bit
Text Generation • Updated • 17 -
relaxml/Llama-2-7b-E8PRVQ-4Bit
Text Generation • Updated • 96 -
relaxml/Llama-2-70b-chat-E8PRVQ-3Bit
Text Generation • Updated • 22 -
relaxml/Llama-2-13b-chat-E8PRVQ-3Bit
Text Generation • Updated • 16 -
relaxml/Llama-2-7b-chat-E8PRVQ-3Bit
Text Generation • Updated • 69 -
relaxml/Llama-2-13b-E8PRVQ-3Bit
Text Generation • Updated • 18 -
relaxml/Llama-2-70b-E8PRVQ-3Bit
Text Generation • Updated • 25 -
relaxml/Llama-2-7b-E8PRVQ-3Bit
Text Generation • Updated • 73 -
relaxml/Llama-2-70b-chat-E8P-2Bit
Text Generation • Updated • 26 • 6 -
relaxml/Llama-2-7b-chat-E8P-2Bit
Text Generation • Updated • 78 • 2 -
relaxml/Llama-2-13b-chat-E8P-2Bit
Text Generation • Updated • 22 • 1 -
relaxml/Llama-2-70b-E8P-2Bit
Text Generation • Updated • 25 • 4 -
relaxml/Llama-2-13b-E8P-2Bit
Text Generation • Updated • 21 • 2 -
relaxml/Llama-2-7b-E8P-2Bit
Text Generation • Updated • 82 • 1 -
relaxml/Llama-1-65b-E8P-2Bit
Text Generation • Updated • 23 -
relaxml/Llama-1-65b-E8PRVQ-4Bit
Text Generation • Updated • 31 -
relaxml/Llama-1-30b-E8PRVQ-4Bit
Text Generation • Updated • 21 -
relaxml/Llama-1-13b-E8PRVQ-4Bit
Text Generation • Updated • 21 -
relaxml/Llama-1-7b-E8PRVQ-4Bit
Text Generation • Updated • 79 -
relaxml/Llama-1-30b-E8PRVQ-3Bit
Text Generation • Updated • 25 -
relaxml/Llama-1-65b-E8PRVQ-3Bit
Text Generation • Updated • 24 -
relaxml/Llama-1-13b-E8PRVQ-3Bit
Text Generation • Updated • 14 -
relaxml/Llama-1-7b-E8PRVQ-3Bit
Text Generation • Updated • 72 -
relaxml/Llama-1-30b-E8P-2Bit
Text Generation • Updated • 22 • 1 -
relaxml/Llama-1-13b-E8P-2Bit
Text Generation • Updated • 26 -
relaxml/Llama-1-7b-E8P-2Bit
Text Generation • Updated • 77 -
relaxml/Openhermes-7b-E8PRVQ-3Bit
Text Generation • Updated • 69 -
relaxml/Mistral-7b-E8PRVQ-3Bit
Text Generation • Updated • 72 -
relaxml/Mistral-7b-E8PRVQ-4Bit
Text Generation • Updated • 73 -
relaxml/Openhermes-7b-E8PRVQ-4Bit
Text Generation • Updated • 70 -
relaxml/Mistral-7b-E8P-2Bit
Text Generation • Updated • 23 • 7 -
relaxml/Openhermes-7b-E8P-2Bit
Text Generation • Updated • 28 • 8