README.md

---
license: other
language:
- en
base_model:
- tiiuae/Falcon3-7B-Instruct
pipeline_tag: text-generation
tags:
- falcon3
- falcon
- falcon-moe
- moe
- llama
---

# Falcon3 MoE 2x7B Instruct

Mixture of Experts of Falcon3 7B-IT & 7B-IT.

- 13.4B parameters
- BF16
- Falcon3 (Llama)
- Instruct

## Falcon3-7B-Instruct
Falcon3 family of Open Foundation Models is a set of pretrained and instruct LLMs ranging from 1B to 10B.

This repository contains the Falcon3-7B-Instruct. It achieves state of art results (at the time of release) on reasoning, language understanding, instruction following, code and mathematics tasks. Falcon3-7B-Instruct supports 4 languages (english, french, spanish, portuguese) and a context length up to 32K.