|
|
--- |
|
|
license: other |
|
|
license_name: aplux-model-farm-license |
|
|
license_link: https://aiot.aidlux.com/api/v1/files/license/model_farm_license_en.pdf |
|
|
pipeline_tag: text-generation |
|
|
tags: |
|
|
- AIoT |
|
|
- QNN |
|
|
- LL |
|
|
base_model: |
|
|
- mistralai/Mistral-7B-Instruct-v0.3 |
|
|
--- |
|
|
|
|
|
 |
|
|
|
|
|
## Mistral-7B-Instruct-v0.3 |
|
|
|
|
|
The Mistral-7B-Instruct-v0.3 Large Language Model (LLM) is an instruct fine-tuned version of the Mistral-7B-v0.3. |
|
|
|
|
|
## Model Details |
|
|
|
|
|
Mistral-7B-v0.3 has the following changes compared to [Mistral-7B-v0.3](https://huggingface.co/mistralai/Mistral-7B-Instruct-v0.3) |
|
|
- Extended vocabulary to 32768 |
|
|
- Supports v3 Tokenizer |
|
|
- Supports function calling |
|
|
|
|
|
## Source Model Evaluation |
|
|
|
|
|
The Mistral 7B Instruct model is a quick demonstration that the base model can be easily fine-tuned to achieve compelling performance. It does not have any moderation mechanisms. Mistral looking forward to engaging with the community on ways to make the model finely respect guardrails, allowing for deployment in environments requiring moderated outputs. |
|
|
|
|
|
## Performance Reference |
|
|
|
|
|
Please search model by model name in [Model Farm](https://aiot.aidlux.com/en/models) |
|
|
|
|
|
## Inference & Model Conversion |
|
|
|
|
|
Please search model by model name in [Model Farm](https://aiot.aidlux.com/en/models) |
|
|
|
|
|
## License |
|
|
|
|
|
- Source Model: [APACHE-2.0](https://github.com/mistralai/mistral-inference/blob/main/LICENSE) |
|
|
|
|
|
- Deployable Model: [APLUX-MODEL-FARM-LICENSE](https://aiot.aidlux.com/api/v1/files/license/model_farm_license_en.pdf) |
