SKYCAVE-R1-32B-v0.1 / README.md
Holy-fox's picture
Upload 73 files
afd3e27 verified
|
raw
history blame
1.13 kB
---
base_model:
- cyberagent/DeepSeek-R1-Distill-Qwen-32B-Japanese
library_name: transformers
tags:
- mergekit
- merge
---
# SKYCAVE-R1-32B-v0.1
This is a merge of pre-trained language models created using [mergekit](https://github.com/cg123/mergekit).
## Merge Details
### Merge Method
This model was merged using the [Model Stock](https://arxiv.org/abs/2403.19522) merge method using [cyberagent/DeepSeek-R1-Distill-Qwen-32B-Japanese](https://huggingface.co/cyberagent/DeepSeek-R1-Distill-Qwen-32B-Japanese) as a base.
### Models Merged
The following models were included in the merge:
* SKYCAVE_element_QR_jp
* SKYCAVE_element_Sky_jp
* SKYCAVE_element_R1_jp_02
* SKYCAVE_element_R1_jp_03
* SKYCAVE_element_R1_jp_01
### Configuration
The following YAML configuration was used to produce this model:
```yaml
merge_method: model_stock
base_model: cyberagent/DeepSeek-R1-Distill-Qwen-32B-Japanese
models:
- model: SKYCAVE_element_QR_jp
- model: SKYCAVE_element_R1_jp_01
- model: SKYCAVE_element_R1_jp_02
- model: SKYCAVE_element_R1_jp_03
- model: SKYCAVE_element_Sky_jp
dtype: bfloat16
name: SKYCAVE-R1-32B-v0.1
```