Triangle104 commited on
Commit
fcedf61
·
verified ·
1 Parent(s): 7895e12

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +18 -0
README.md CHANGED
@@ -12,6 +12,24 @@ tags:
12
  This model was converted to GGUF format from [`SicariusSicariiStuff/Redemption_Wind_24B`](https://huggingface.co/SicariusSicariiStuff/Redemption_Wind_24B) using llama.cpp via the ggml.ai's [GGUF-my-repo](https://huggingface.co/spaces/ggml-org/gguf-my-repo) space.
13
  Refer to the [original model card](https://huggingface.co/SicariusSicariiStuff/Redemption_Wind_24B) for more details on the model.
14
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
15
  ## Use with llama.cpp
16
  Install llama.cpp through brew (works on Mac and Linux)
17
 
 
12
  This model was converted to GGUF format from [`SicariusSicariiStuff/Redemption_Wind_24B`](https://huggingface.co/SicariusSicariiStuff/Redemption_Wind_24B) using llama.cpp via the ggml.ai's [GGUF-my-repo](https://huggingface.co/spaces/ggml-org/gguf-my-repo) space.
13
  Refer to the [original model card](https://huggingface.co/SicariusSicariiStuff/Redemption_Wind_24B) for more details on the model.
14
 
15
+ ---
16
+ This model was undercooked on purpose. Target average loss value: 8.0
17
+
18
+ Mistral has blessed us with a capable new Apache 2.0 model, but not only that, we finally get a base model to play with as well. After several models with more restrictive licenses, this open release is a welcome surprise. Freedom was redeemed.
19
+
20
+ With this model, I took a different approach—it's designed less for typical end-user usage, and more for the fine-tuning community. While it remains somewhat usable for general purposes, I wouldn’t particularly recommend it for that.
21
+ What is this model?
22
+
23
+ This is a lightly fine-tuned version of the Mistral 24B base model, designed as an accessible and adaptable foundation for further fine-tuning and merging fodder. Key modifications include:
24
+
25
+ ChatML-ified, with no additional tokens introduced.
26
+ High quality private instruct—not generated by ChatGPT or Claude, ensuring no slop and good markdown understanding.
27
+ No refusals—since it’s a base model, refusals should be minimal to non-existent, though, in early testing, occasional warnings still appear (I assume some were baked into the pre-train).
28
+ High-quality private creative writing dataset Mainly to dilute baked-in slop further, but it can actually write some stories, not bad for loss ~8.
29
+ Small, high-quality private RP dataset This was done so further tuning for RP will be easier. The dataset was kept small and contains ZERO SLOP, some entries are of 16k token length.
30
+ Exceptional adherence to character cards This was done to make it easier for further tunes intended for roleplay.
31
+
32
+ ---
33
  ## Use with llama.cpp
34
  Install llama.cpp through brew (works on Mac and Linux)
35