gagan3012 commited on
Commit
0f49fd6
·
verified ·
1 Parent(s): afbd282

End of training

Browse files
Files changed (1) hide show
  1. README.md +2 -1
README.md CHANGED
@@ -1,5 +1,6 @@
1
  ---
2
  base_model: Qwen/Qwen2.5-0.5B-Instruct
 
3
  library_name: transformers
4
  model_name: Qwen-2.5-reasoning-verifier
5
  tags:
@@ -11,7 +12,7 @@ licence: license
11
 
12
  # Model Card for Qwen-2.5-reasoning-verifier
13
 
14
- This model is a fine-tuned version of [Qwen/Qwen2.5-0.5B-Instruct](https://huggingface.co/Qwen/Qwen2.5-0.5B-Instruct).
15
  It has been trained using [TRL](https://github.com/huggingface/trl).
16
 
17
  ## Quick start
 
1
  ---
2
  base_model: Qwen/Qwen2.5-0.5B-Instruct
3
+ datasets: gagan3012/Sky-T1_preference_data_10k_reward_templated
4
  library_name: transformers
5
  model_name: Qwen-2.5-reasoning-verifier
6
  tags:
 
12
 
13
  # Model Card for Qwen-2.5-reasoning-verifier
14
 
15
+ This model is a fine-tuned version of [Qwen/Qwen2.5-0.5B-Instruct](https://huggingface.co/Qwen/Qwen2.5-0.5B-Instruct) on the [gagan3012/Sky-T1_preference_data_10k_reward_templated](https://huggingface.co/datasets/gagan3012/Sky-T1_preference_data_10k_reward_templated) dataset.
16
  It has been trained using [TRL](https://github.com/huggingface/trl).
17
 
18
  ## Quick start