Llama-3.2-8B-Instruct

Llama-3.2-8B-Instruct is a merge of the following models using mergekit:

🧩 Configuration

slices:
  - sources:
      - model: unsloth/Llama-3.2-3B-Instruct
        layer_range: [0, 24]
  - sources:
      - model: Lyte/Llama-3.2-3B-Overthinker
        layer_range: [4, 24]
  - sources:
      - model: huihui-ai/Llama-3.2-3B-Instruct-abliterated
        layer_range: [8, 28]
merge_method: passthrough
dtype: bfloat16
Downloads last month
12
Inference Providers NEW
This model is not currently available via any of the supported Inference Providers.
The model cannot be deployed to the HF Inference API: The model has no library tag.