GGUF quantization of https://huggingface.co/Finnish-NLP/llama-7b-finnish-instruct-v0.2 โ€“ see details there.

Downloads last month
8
GGUF
Model size
7B params
Architecture
llama

5-bit

Inference Providers NEW
This model is not currently available via any of the supported Inference Providers.
The model cannot be deployed to the HF Inference API: The model has no library tag.