Model save

README.md

@@ -1,7 +1,7 @@
 ---
 base_model: RyanYr/reflect_single_mini8B_SftT12
 library_name: transformers
-model_name: reflect_single_mini8B_Om2SftT012_Om2G8kOm2Ag40kIpsdpT012_b0.5
+model_name: reflect_single_mini8B_Om2SftT012_Om2G8kOm2Ag40kIpsdpT012_b0.1
 tags:
 - generated_from_trainer
 - trl
@@ -9,7 +9,7 @@ tags:
 licence: license
 ---
 
-# Model Card for reflect_single_mini8B_Om2SftT012_Om2G8kOm2Ag40kIpsdpT012_b0.5
+# Model Card for reflect_single_mini8B_Om2SftT012_Om2G8kOm2Ag40kIpsdpT012_b0.1
 
 This model is a fine-tuned version of [RyanYr/reflect_single_mini8B_SftT12](https://huggingface.co/RyanYr/reflect_single_mini8B_SftT12).
 It has been trained using [TRL](https://github.com/huggingface/trl).
@@ -20,14 +20,14 @@ It has been trained using [TRL](https://github.com/huggingface/trl).
 from transformers import pipeline
 
 question = "If you had a time machine, but could only go to the past or the future once and never return, which would you choose and why?"
-generator = pipeline("text-generation", model="RyanYr/reflect_single_mini8B_Om2SftT012_Om2G8kOm2Ag40kIpsdpT012_b0.5", device="cuda")
+generator = pipeline("text-generation", model="RyanYr/reflect_single_mini8B_Om2SftT012_Om2G8kOm2Ag40kIpsdpT012_b0.1", device="cuda")
 output = generator([{"role": "user", "content": question}], max_new_tokens=128, return_full_text=False)[0]
 print(output["generated_text"])
 ```
 
 ## Training procedure
 
-[<img src="https://raw.githubusercontent.com/wandb/assets/main/wandb-github-badge-28.svg" alt="Visualize in Weights & Biases" width="150" height="24"/>](https://wandb.ai/yyr/huggingface/runs/mvbd6d22)
+[<img src="https://raw.githubusercontent.com/wandb/assets/main/wandb-github-badge-28.svg" alt="Visualize in Weights & Biases" width="150" height="24"/>](https://wandb.ai/yyr/huggingface/runs/2dr8ngde)
 
 This model was trained with DPO, a method introduced in [Direct Preference Optimization: Your Language Model is Secretly a Reward Model](https://huggingface.co/papers/2305.18290).
 

last_checkpoint/model-00001-of-00004.safetensors

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:9e9ec8b955ab27329222edd0e71f5f053b9438e704d8a5076655fa8361ea9a71
+oid sha256:f3dd5ebc719ad8bfedd84cb00ffee668915743714e04fdfc60e38cfb225b9271
 size 4983016096

last_checkpoint/model-00002-of-00004.safetensors

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:4a36dc1c87b9c96995c0313d6c131294d1e0ebae51790b045da6f6264e7cb600
+oid sha256:f200f25e23977d39ff2eed9d945c6f136bfa5393c9560e7ebc5deb2b38e5de78
 size 4999836776

last_checkpoint/model-00003-of-00004.safetensors

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:8b16fcd33e712553eceac4f9d9d52fe5f72bdbde05da15a19cd64eb556adccdc
+oid sha256:4705f63c53d3eb80f9330c278a4e3b8dfdbc02517fb8d5b65931997baa8e7889
 size 4983067960

last_checkpoint/model-00004-of-00004.safetensors

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:a7f8024f898d2ab88528faeb87506ce355a77de6e8135708001aaf0d12adec2a
+oid sha256:d1e82decf8044e32f1fc4d81dd7debbd0aa534d2a03bb0c362613abafa8a27ae
 size 1073750144

last_checkpoint/training_args.bin

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:942a478820cabe004a36a544a3ccfa81413200dd7bfbb7599f3a7be00633b46d
+oid sha256:46994e10dd15a3044783b2ce05abdf348ce0f3a03a422ad4f40e2f3c56cd7208
 size 8056