Model

This model has been fine-tuned based on Meta-Llama/Meta-Llama-3-8B-Instruct using the mlx-lm with a cleaned-up function calling dataset that removed invalid JSON data and single quotes around argument values. It is a GGUF Q4_0 for the model originally found at https://huggingface.co/mzbac/llama-3-8B-Instruct-function-calling-v0.2

Usage

Just load the GGUF

Downloads last month
61
GGUF
Model size
8.03B params
Architecture
llama

4-bit

Inference Providers NEW
This model is not currently available via any of the supported Inference Providers.
The model cannot be deployed to the HF Inference API: The model has no library tag.

Dataset used to train ghhwer/mzbac-llama-3-8B-Instruct-function-calling-v0.2-GGUF