Update README.md

README.md

@@ -10,6 +10,45 @@ tags:
 license: llama3.2
 ---
 
+# about
+
+The Kermes series is my second attempt at making merges, after the Kostume series.
+
+On the Kostume series started on the 11/02/0205 I tried to make a triple stock merge of 3 intermediary stock merges of a dozen of model or so.
+This, to see if I could pile up their abilities.
+Not bad, but nothing special about it, it's a bit hard for me to judge at 3b.
+
+On the Kermes series started the day after, I defined a simpler approach:
+
+- Perplexity is the main constraint. Usual L3.2 3b finetunes are around 10.5-11 ppl512wikieng, Hermes is around 9.5.
+- I also measure in French and Serbian to observe the variances.
+  
+- Arc Challenge and Easy are the second constraint to judge its basic logics.
+- Usual L3.2 3b finetunes hit 40 and 60-65 respectively, Hermes3 hits 47+ and 70+.
+
+- Lack of censorship. I always keep in mind to pick models compatible with that AMAP.
+- This, may it be through the picked models' abliteration or the datasets they use.
+
+- And of course, the test, both In Kobold/Croco.CPP (spamming very offensive requests), and in ST (a 10k prompt with a big lorebook).
+
+Kermes series 2 is basically a stock merge on the top of another.
+- The goal was to maintain as much the qualities of the models used, so I stay on 1+2 models for the first merge, and 1+2 for the second as well.
+
+For V2.1 :
+- First, DarkHermes as the base, LlamaLoi as the "stabilizator", and Hermes Abliterated.
+- That triplet kept the strong benchs of DarkHermes and even.. improved them a bit.
+- Second, That Kermes 0.2 served as a base, with.. Evil Aplaca as a wild card (very good Arcs and nasty dataset), and Dophin 3.0 for a quality addition.
+
+And bingo. Perplexity goes down still, ARC remain stable, it's quite unhinged still, and.. quite coherent, event at 10k+ context.
+
+I will probably replicate that recipes a bit in the future, first to try to improve Kermes 3b.
+And then, go on 8b for the next.. arc of this adventure.
+
+Kudos go to the model authors, and to the Arcee / MergeKit folks, as well as to HF hosting the MergeKit App.
+Also a big-up to SteelSkull, observing him cooking Nevoria decided me to try to make some merges by myself.
+
+---
+# quantizations
 
 GGUF static quantizations (Thanks!) :
 
@@ -19,7 +58,7 @@ GGUF custom quantizations:
 
 https://huggingface.co/Nexesenex/Llama_3.2_3b_Kermes_v2.1-iMat-CQ-GGUF
 
-
+---
 # merge
 
 This is a merge of pre-trained language models created using [mergekit](https://github.com/cg123/mergekit).