WaveCut's picture
Update README.md
384cf0e verified
|
raw
history blame
2.58 kB
metadata
library_name: llamacpp
model_name: Vikhr-Gemma-2B-instruct
base_model: Vikhrmodels/Vikhr-Gemma-2B-instruct
language:
  - ru
license: apache-2.0
tags:
  - instruct
datasets:
  - Vikhrmodels/GrandMaster-PRO-MAX
pipeline_tag: text-generation

💨 Vikhr-Gemma-2B-instruct

Мощная инструктивная модель на основе Gemma 2 2B, обученная на русскоязычном датасете GrandMaster-PRO-MAX.

Perplexity Wikitext-2

Model Perplexity
Vikhr-Gemma-2B-instruct-Q4_K 10.4374 +/- 0.07339
Vikhr-Gemma-2B-instruct-Q4_0 10.6480 +/- 0.07452
Vikhr-Gemma-2B-instruct-Q8_0 10.1209 +/- 0.07105
Vikhr-Gemma-2B-instruct-Q4_1 10.5574 +/- 0.07476
Vikhr-Gemma-2B-instruct-F32 10.1191 +/- 0.07099
Vikhr-Gemma-2B-instruct-Q6_K 10.1503 +/- 0.07117
Vikhr-Gemma-2B-instruct-IQ2_S 14.0745 +/- 0.10367
Vikhr-Gemma-2B-instruct-BF16 10.1189 +/- 0.07098
Vikhr-Gemma-2B-instruct-IQ2_M 12.7723 +/- 0.09234
Vikhr-Gemma-2B-instruct-Q2_K 12.8851 +/- 0.09332
Vikhr-Gemma-2B-instruct-IQ4_XS 10.3770 +/- 0.07299
Vikhr-Gemma-2B-instruct-Q5_0 10.2551 +/- 0.07251
Vikhr-Gemma-2B-instruct-Q5_K 10.1975 +/- 0.07184
Vikhr-Gemma-2B-instruct-IQ1_S 42.6888 +/- 0.36888
Vikhr-Gemma-2B-instruct-IQ4_NL 10.3767 +/- 0.07310
Vikhr-Gemma-2B-instruct-IQ3_S 10.9100 +/- 0.07725
Vikhr-Gemma-2B-instruct-Q3_K_S 11.6028 +/- 0.08333
Vikhr-Gemma-2B-instruct-Q2_K_S 14.7951 +/- 0.10960
Vikhr-Gemma-2B-instruct-F16 10.1191 +/- 0.07099
Vikhr-Gemma-2B-instruct-Q4_K_M 10.4374 +/- 0.07339
Vikhr-Gemma-2B-instruct-Q5_K_M 10.1975 +/- 0.07184
Vikhr-Gemma-2B-instruct-Q5_1 10.2348 +/- 0.07208
Vikhr-Gemma-2B-instruct-Q4_K_S 10.4924 +/- 0.07386
Vikhr-Gemma-2B-instruct-Q5_K_S 10.2098 +/- 0.07198
Vikhr-Gemma-2B-instruct-IQ3_XS 11.1461 +/- 0.07907
Vikhr-Gemma-2B-instruct-Q3_K 10.7416 +/- 0.07606
Vikhr-Gemma-2B-instruct-Q3_K_M 10.7416 +/- 0.07606
Vikhr-Gemma-2B-instruct-IQ3_M 10.7035 +/- 0.07573
Vikhr-Gemma-2B-instruct-Q3_K_L 10.6242 +/- 0.07506
Vikhr-Gemma-2B-instruct-IQ2_XS 15.8229 +/- 0.11909
Vikhr-Gemma-2B-instruct-IQ1_M 29.5443 +/- 0.24168
Vikhr-Gemma-2B-instruct-IQ3_XXS 11.6931 +/- 0.08282
Vikhr-Gemma-2B-instruct-IQ2_XXS 18.8375 +/- 0.14581