VPTQ-community/Meta-Llama-3.1-405B-Instruct-v16-k65536-65536-woft VPTQ-community/Meta-Llama-3.1-405B-Instruct-v16-k65536-256-woft mradermacher/Meta-Llama-3.1-405B-Instruct-GGUF neuralmagic/Meta-Llama-3.1-405B-Instruct-quantized.w4a16 neuralmagic/Meta-Llama-3.1-405B-Instruct-FP8-dynamic nicoboss/Meta-Llama-3.1-405B-Instruct-Uncensored VPTQ-community/Meta-Llama-3.1-405B-Instruct-v16-k32768-32768-woft VPTQ-community/Meta-Llama-3.1-405B-Instruct-v16-k65536-1024-woft amd/Meta-Llama-3.1-405B-Instruct-FP8-KV VoyagerYuan/Xillama-3.1-405B-Instruct-BNB-NF4-BF16 nisten/meta-405b-instruct-cpu-optimized-gguf mradermacher/Meta-Llama-3.1-405B-Instruct-i1-GGUF VPTQ-community/Meta-Llama-3.1-405B-Instruct-v16-k65536-128-woft meta-llama/Llama-3.1-405B-Instruct-FP8 jburmeister/Meta-Llama-3.1-405B-Instruct-GGUF etemiz/Llama-3.1-405B-Inst-GGUF nicoboss/Meta-Llama-3.1-405B-Instruct-Uncensored-Lora neuralmagic/Meta-Llama-3.1-405B-Instruct-quantized.w8a16 neuralmagic/Meta-Llama-3.1-405B-Instruct-quantized.w8a8 VPTQ-community/Meta-Llama-3.1-405B-Instruct-v16-k65536-64-woft mlabonne/BigLlama-3.1-681B-Instruct MaziyarPanahi/Meta-Llama-3.1-405B-Instruct-GGUF neuralmagic/Meta-Llama-3.1-405B-Instruct-FP8 VPTQ-community/Meta-Llama-3.1-405B-Instruct-v8-k4096-0-woft DivineVeil/pufferfish xmadai/Llama-3.1-405B-Instruct-xMADai-4bit hugging-quants/Meta-Llama-3.1-405B-Instruct-BNB-NF4
neuralmagic/Meta-Llama-3.1-405B-Instruct-quantized.w8a8 neuralmagic/Meta-Llama-3.1-405B-Instruct-quantized.w8a16 hugging-quants/Meta-Llama-3.1-405B-Instruct-BNB-NF4 xmadai/Llama-3.1-405B-Instruct-xMADai-4bit VoyagerYuan/Xillama-3.1-405B-Instruct-BNB-NF4-BF16-Writer amd/Meta-Llama-3.1-405B-Instruct-FP8-KV VPTQ-community/Meta-Llama-3.1-405B-Instruct-v16-k65536-1024-woft VPTQ-community/Meta-Llama-3.1-405B-Instruct-v16-k32768-32768-woft DivineVeil/pufferfish VPTQ-community/Meta-Llama-3.1-405B-Instruct-v8-k4096-0-woft nicoboss/Meta-Llama-3.1-405B-Instruct-Uncensored-Lora etemiz/Llama-3.1-405B-Inst-GGUF jburmeister/Meta-Llama-3.1-405B-Instruct-GGUF meta-llama/Llama-3.1-405B-Instruct-FP8 VPTQ-community/Meta-Llama-3.1-405B-Instruct-v16-k65536-128-woft mradermacher/Meta-Llama-3.1-405B-Instruct-i1-GGUF mradermacher/BigLlama-3.1-681B-Instruct-i1-GGUF nisten/meta-405b-instruct-cpu-optimized-gguf VoyagerYuan/Xillama-3.1-405B-Instruct-BNB-NF4-BF16 mradermacher/Meta-Llama-3.1-405B-Instruct-Uncensored-i1-GGUF mradermacher/BigLlama-3.1-681B-Instruct-GGUF nicoboss/Meta-Llama-3.1-405B-Instruct-Uncensored neuralmagic/Meta-Llama-3.1-405B-Instruct-FP8-dynamic neuralmagic/Meta-Llama-3.1-405B-Instruct-quantized.w4a16 mradermacher/Meta-Llama-3.1-405B-Instruct-GGUF VPTQ-community/Meta-Llama-3.1-405B-Instruct-v16-k65536-256-woft VPTQ-community/Meta-Llama-3.1-405B-Instruct-v16-k65536-65536-woft mradermacher/Meta-Llama-3.1-405B-Instruct-Uncensored-GGUF neuralmagic/Meta-Llama-3.1-405B-Instruct-FP8 MaziyarPanahi/Meta-Llama-3.1-405B-Instruct-GGUF mlabonne/BigLlama-3.1-681B-Instruct VPTQ-community/Meta-Llama-3.1-405B-Instruct-v16-k65536-64-woft