Hugging Face's logo Hugging Face
  • Models
  • Datasets
  • Spaces
  • Docs
  • Enterprise
  • Pricing

  • Log In
  • Sign Up

Mozilla
/
Meta-Llama-3.1-8B-Instruct-llamafile

llamafile
PyTorch
facebook
meta
llama
llama-3
Model card Files Files and versions Community
Meta-Llama-3.1-8B-Instruct-llamafile
Ctrl+K
Ctrl+K
  • 2 contributors
History: 19 commits
jartine's picture
jartine
Quantize Q5_K_M with llamafile-0.8.11
122f424 verified about 1 year ago
  • .gitattributes
    2.31 kB
    Quantize Q5_K_M with llamafile-0.8.11 about 1 year ago
  • LICENSE
    17.3 kB
    Update LICENSE about 1 year ago
  • Meta-Llama-3.1-8B-Instruct.Q2_K.llamafile
    3.21 GB
    LFS
    Quantize Q2_K with llamafile-0.8.11 about 1 year ago
  • Meta-Llama-3.1-8B-Instruct.Q3_K_L.llamafile
    4.35 GB
    LFS
    Quantize Q3_K_L with llamafile-0.8.11 about 1 year ago
  • Meta-Llama-3.1-8B-Instruct.Q3_K_M.llamafile
    4.05 GB
    LFS
    Quantize Q3_K_M with llamafile-0.8.11 about 1 year ago
  • Meta-Llama-3.1-8B-Instruct.Q3_K_S.llamafile
    3.69 GB
    LFS
    Quantize Q3_K_S with llamafile-0.8.11 about 1 year ago
  • Meta-Llama-3.1-8B-Instruct.Q4_K_M.llamafile
    4.95 GB
    LFS
    Quantize Q4_K_M with llamafile-0.8.11 about 1 year ago
  • Meta-Llama-3.1-8B-Instruct.Q4_K_S.llamafile
    4.72 GB
    LFS
    Quantize Q4_K_S with llamafile-0.8.11 about 1 year ago
  • Meta-Llama-3.1-8B-Instruct.Q5_0.llamafile
    5.63 GB
    LFS
    Quantize Q5_0 with llamafile-0.8.11 about 1 year ago
  • Meta-Llama-3.1-8B-Instruct.Q5_K_M.llamafile
    5.76 GB
    LFS
    Quantize Q5_K_M with llamafile-0.8.11 about 1 year ago
  • Meta-Llama-3.1-8B-Instruct.Q5_K_S.llamafile
    5.63 GB
    LFS
    Quantize Q5_K_S with llamafile-0.8.11 about 1 year ago
  • Meta-Llama-3.1-8B-Instruct.Q6_K.llamafile
    6.63 GB
    LFS
    Quantize Q6_K with llamafile-0.8.11 about 1 year ago
  • README.md
    31.2 kB
    Update README.md about 1 year ago