lvkaokao
commited on
Commit
·
cb7ae0b
1
Parent(s):
7e24c55
update doc.
Browse files
README.md
CHANGED
@@ -2,8 +2,7 @@
|
|
2 |
license: apache-2.0
|
3 |
---
|
4 |
|
5 |
-
|
6 |
-
should probably proofread and complete it, then remove this comment. -->
|
7 |
|
8 |
This model is a fine-tuned model based on [mistralai/Mistral-7B-v0.1](https://huggingface.co/mistralai/Mistral-7B-v0.1) on the open source dataset [Open-Orca/SlimOrca](https://huggingface.co/datasets/Open-Orca/SlimOrca). And align it with DPO algorithm. For more details about our DPO workaround blog, you can refer: [NeuralChat: Simplifying Supervised Instruction Fine-Tuning and Reinforcement Aligning](https://medium.com/intel-analytics-software/neuralchat-simplifying-supervised-instruction-fine-tuning-and-reinforcement-aligning-for-chatbots-d034bca44f69).
|
9 |
|
|
|
2 |
license: apache-2.0
|
3 |
---
|
4 |
|
5 |
+
## Finetuning on [habana](https://habana.ai/) HPU
|
|
|
6 |
|
7 |
This model is a fine-tuned model based on [mistralai/Mistral-7B-v0.1](https://huggingface.co/mistralai/Mistral-7B-v0.1) on the open source dataset [Open-Orca/SlimOrca](https://huggingface.co/datasets/Open-Orca/SlimOrca). And align it with DPO algorithm. For more details about our DPO workaround blog, you can refer: [NeuralChat: Simplifying Supervised Instruction Fine-Tuning and Reinforcement Aligning](https://medium.com/intel-analytics-software/neuralchat-simplifying-supervised-instruction-fine-tuning-and-reinforcement-aligning-for-chatbots-d034bca44f69).
|
8 |
|