--- library_name: llamacpp model_name: Vikhr-Gemma-2B-instruct base_model: Vikhrmodels/Vikhr-Gemma-2B-instruct language: - ru license: apache-2.0 tags: - instruct datasets: - Vikhrmodels/GrandMaster-PRO-MAX pipeline_tag: text-generation --- # 💨 Vikhr-Gemma-2B-instruct Мощная инструктивная модель на основе Gemma 2 2B, обученная на русскоязычном датасете GrandMaster-PRO-MAX. - [HF model](https://huggingface.co/Vikhrmodels/Vikhr-Gemma-2B-instruct) ## Perplexity Wikitext-2 | Model | Perplexity | |:--------------------------------|:--------------------| | Vikhr-Gemma-2B-instruct-Q4_K | 10.4374 +/- 0.07339 | | Vikhr-Gemma-2B-instruct-Q4_0 | 10.6480 +/- 0.07452 | | Vikhr-Gemma-2B-instruct-Q8_0 | 10.1209 +/- 0.07105 | | Vikhr-Gemma-2B-instruct-Q4_1 | 10.5574 +/- 0.07476 | | Vikhr-Gemma-2B-instruct-F32 | 10.1191 +/- 0.07099 | | Vikhr-Gemma-2B-instruct-Q6_K | 10.1503 +/- 0.07117 | | Vikhr-Gemma-2B-instruct-IQ2_S | 14.0745 +/- 0.10367 | | Vikhr-Gemma-2B-instruct-BF16 | 10.1189 +/- 0.07098 | | Vikhr-Gemma-2B-instruct-IQ2_M | 12.7723 +/- 0.09234 | | Vikhr-Gemma-2B-instruct-Q2_K | 12.8851 +/- 0.09332 | | Vikhr-Gemma-2B-instruct-IQ4_XS | 10.3770 +/- 0.07299 | | Vikhr-Gemma-2B-instruct-Q5_0 | 10.2551 +/- 0.07251 | | Vikhr-Gemma-2B-instruct-Q5_K | 10.1975 +/- 0.07184 | | Vikhr-Gemma-2B-instruct-IQ1_S | 42.6888 +/- 0.36888 | | Vikhr-Gemma-2B-instruct-IQ4_NL | 10.3767 +/- 0.07310 | | Vikhr-Gemma-2B-instruct-IQ3_S | 10.9100 +/- 0.07725 | | Vikhr-Gemma-2B-instruct-Q3_K_S | 11.6028 +/- 0.08333 | | Vikhr-Gemma-2B-instruct-Q2_K_S | 14.7951 +/- 0.10960 | | Vikhr-Gemma-2B-instruct-F16 | 10.1191 +/- 0.07099 | | Vikhr-Gemma-2B-instruct-Q4_K_M | 10.4374 +/- 0.07339 | | Vikhr-Gemma-2B-instruct-Q5_K_M | 10.1975 +/- 0.07184 | | Vikhr-Gemma-2B-instruct-Q5_1 | 10.2348 +/- 0.07208 | | Vikhr-Gemma-2B-instruct-Q4_K_S | 10.4924 +/- 0.07386 | | Vikhr-Gemma-2B-instruct-Q5_K_S | 10.2098 +/- 0.07198 | | Vikhr-Gemma-2B-instruct-IQ3_XS | 11.1461 +/- 0.07907 | | Vikhr-Gemma-2B-instruct-Q3_K | 10.7416 +/- 0.07606 | | Vikhr-Gemma-2B-instruct-Q3_K_M | 10.7416 +/- 0.07606 | | Vikhr-Gemma-2B-instruct-IQ3_M | 10.7035 +/- 0.07573 | | Vikhr-Gemma-2B-instruct-Q3_K_L | 10.6242 +/- 0.07506 | | Vikhr-Gemma-2B-instruct-IQ2_XS | 15.8229 +/- 0.11909 | | Vikhr-Gemma-2B-instruct-IQ1_M | 29.5443 +/- 0.24168 | | Vikhr-Gemma-2B-instruct-IQ3_XXS | 11.6931 +/- 0.08282 | | Vikhr-Gemma-2B-instruct-IQ2_XXS | 18.8375 +/- 0.14581 |