EllieS/zephyr-7b-dpo-lora-pubmedqa-ultrafeedback UCLA-AGI/zephyr-7b-sft-full-SPIN-iter1 LoneStriker/notus-7b-v1-6.0bpw-h6-exl2 EllieS/zephyr-7b-dpo-lora-timedial DatPySci/zephyr-7b-kto-iter0 EllieS/zephyr-7b-dpo-lora-pubmedqa-selfgen-complete alignment-handbook/zephyr-7b-dpo-full scottsuk0306/zephyr-7b-math-case-6 SumanthRH/zephr_flex_packing_bsz_8 SumanthRH/zephr_fa3_packing_bsz_4 taicheng/zephyr-7b-align-scan-0.0-0.0-polynomial-3 taicheng/zephyr-7b-align-scan-6e-07-0.53-polynomial-2.0 taicheng/zephyr-7b-align-scan-4e-07-0.45-cosine-1.0 taicheng/zephyr-7b-align-scan-0.0-0.4-polynomial-2 sfulay/zephyr-7b-dpo-full-gpt_consistent-reward-scale-1-rpo-gamma-05 sfulay/zephyr-7b-dpo-full-gpt_consistent-reward-scale-1-rpo-gamma-2 NicholasCorrado/uf-rlced-conifer-zephyr-7b-group-dpo-no-clip-no-excess sfulay/zephyr-7b-dpo-full-gpt-high-curriculum sfulay/zephyr-7b-dpo-full-prometheus-reward-scale-1 TTTXXX01/zephyr-7b-MI-1-SELM sfulay/zephyr-7b-dpo-full-ultrabin-high-bleu-3-epochs sfulay/zephyr-7b-dpo-full-magpi-high-curriculum sfulay/zephyr-7b-dpo-full-ultrabin-low-bleu sfulay/zephyr-7b-dpo-full-ultrabin-low-curriculum sfulay/zephyr-7b-dpo-full-ultrabin-high-margin just1nseo/zephyr-dpop-qlora-uf6k-5e-7 just1nseo/zephyr-dpo-qlora-uf-oursuf6k-5e-7 just1nseo/zephyr-dpop-qlora-uf-ours-uffull-5e-6 just1nseo/zephyr-dpo-qlora-uf-ours-5e-7 just1nseo/zephyr-dpop-qlora-uf-ours-5e-6 YYYYYYibo/gshf_lora_iter_3 AmberYifan/spin-v-deduplicate sfulay/zephyr-7b-dpo-full-hh YYYYYYibo/imp_sam_iter_2 TTTXXX01/zephyr-7b-DPOBS48-full vwxyzjn/ppo_zephyr_vllm_1e-6_kl_0.02_num_mini_batches_1 vwxyzjn/ppo_zephyr_vllm_2e-6_kl_0.02_num_mini_batches_4 TTTXXX01/Positive_likelihood-zephyr-7b-sft-full TTTXXX01/KL-zephyr-7b-sft-full CXL295/zephyr-7b-dpo-full AmberYifan/dpo-v YYYYYYibo/vanilla_dpo_iter_4 YYYYYYibo/nash_dpo_doff_real_no_golden_iter_2 YYYYYYibo/nash_dpo_doff_no_golden_iter_2 YYYYYYibo/nash_dpo_doff_no_golden_iter_1 fenguhao/zephyr-7b-dpo-full YYYYYYibo/nash_dpo_merge_iter_6 YYYYYYibo/nash_dpo_rank4_iter_real_plus_3 AmberYifan/advsafe-spin-iter0 YYYYYYibo/vanilla_dpo_iter_3 YYYYYYibo/vanilla_dpo_iter_2 splm/zephyr-7b-sft-full-spin-peft-iter1 taicheng/zephyr-7b-align-scan-dpo0.1data-5e-07-0.01-1-cosine-8 NicholasCorrado/zephyr-7b-uf-rc-small-dpo weijie210/zephyr-7b-UFB-ref MaziyarPanahi/zephyr-7b-sft-full-GGUF weijie210/zephyr-7b-teacher jikaixuan/zephyr-ds yihang7/zephyr-7b-dpo-full LoneStriker/notus-7b-v1-3.0bpw-h6-exl2 timlim123/zephyr-7b-dpo-full tianlinliu0121/zephyr-7b-dpo-full-beta-0.083 YYYYYYibo/zephyr-7b-lora-64-no-quant-2k AmberYifan/test-spin-iter0 EllieS/zephyr-7b-dpo-lora-pubmedqa-mix2 EllieS/zephyr-7b-dpo-lora-pubmedqa-selfgen-ultrafeedback-com scottsuk0306/zephyr-7b-math-case-6-ep1 taicheng/zephyr-7b-align-scan-0.0-0.0-linear-1 taicheng/zephyr-7b-align-scan-0.0-0.9-polynomial-3 taicheng/zephyr-7b-align-scan-0.0-1.0-linear-2 taicheng/zephyr-7b-align-scan-0.0-0.3-polynomial-3 taicheng/zephyr-7b-align-scan-0.0-0.7-cosine-3 taicheng/zephyr-7b-align-scan-0.0-0.9-linear-2 taicheng/zephyr-7b-align-scan NicholasCorrado/zephyr-7b-uf-rlced-conifer-1e2e-group-dpo-2e NicholasCorrado/rlced-conifer-zephyr-7b-dpo-2e sfulay/zephyr-7b-dpo-full-gpt_consistent-reward-scale-05 sfulay/zephyr-7b-dpo-full-gpt-reward-scale-01 sfulay/zephyr-7b-dpo-full-gpt-low-curriculum zodi1121/zephyr-7b-dpo-full sfulay/zephyr-7b-dpo-full-magpi-reward-scale-05 TTTXXX01/zephyr-7b-MI-1-selm2 just1nseo/zephyr-dpo-qlora-uf-ours-5e-6-epoch1 just1nseo/zephyr-dpop-qlora-gpt4-5e-6-epoch3 sruthigorantla/zephyr-7b-dpo-full nlee-208/zephyr-7b-sft-kto2 just1nseo/zephyr-7b-dpop-uf6k-qlora-5e-6-epoch3 AmberYifan/zephyr-spin-llama2-data AmberYifan/spin-v-diverse just1nseo/zephyr-dpo-qlora-uf-ours-5e-6 YYYYYYibo/imp_sam_iter_1 TTTXXX01/All_like48-zephyr-7b-sft-full AmberYifan/spin-advbench TTTXXX01/DPO005-Baseline-zephyr-7b-sft-full vwxyzjn/ppo_zephyr_vllm_1e-6_kl_0.15 TTTXXX01/DPO-Baseline-zephyr-7b-sft-full TTTXXX01/Negative_likelihood-zephyr-7b-sft-full TTTXXX01/Ber_shift-zephyr-7b-sft-full TTTXXX01/DPO_shift-zephyr-7b-sft-full TTTXXX01/energy-zephyr-7b-sft-full wyan1/zephyr-7b-dpo-full YYYYYYibo/nash_dpo_rank4_on_vanilla_iter_1 YYYYYYibo/nash_dpo_doff_real_no_golden_iter_3 YYYYYYibo/vanilla_doff_dpo_iter_3 AmberYifan/advsafe_plus-spin-iter0 justtherightsize/zephyr-7b-sft-full124 scottsuk0306/zephyr-7b-stem-half scottsuk0306/zephyr-7b-stem-test weijie210/zephyr-7b-critique-pairwise EllieS/zephyr-dpo-timedial EllieS/zephyr-sft-timedial scottsuk0306/zephyr-7b-math-case-4 taicheng/zephyr-7b-align-scan-2e-07-0.39-polynomial-1.0 taicheng/zephyr-7b-align-scan-7e-07-0.99-cosine-2.0 taicheng/zephyr-7b-align-scan-3e-07-0.62-polynomial-3.0 taicheng/zephyr-7b-align-scan-9e-07-0.86-linear-2.0 taicheng/zephyr-7b-align-scan-0.0-0.8-cosine-1 NicholasCorrado/zephyr-7b-uf-rlced-conifer-group-dpo-2e NicholasCorrado/uf-rlced-conifer-zephyr-7b-group-dpo-full yangzhao02/mistral-7b-listmle sfulay/zephyr-7b-dpo-full-gpt_consistent-reward-scale-1 sfulay/zephyr-7b-dpo-full-gpt_consistent-3 NicholasCorrado/zephyr-7b-group-dpo-full-4 sfulay/zephyr-7b-dpo-full-prometheus_consistent-reward-scale-1-rpo TTTXXX01/Mistral-7B-Base-MI-1e-6 sfulay/zephyr-7b-dpo-full-prometheus-3 LaoRay/zephyr-7b-dpo-lora-r16-20k TTTXXX01/zephyr-7b-Cal-DPO-1-001-False TTTXXX01/zephyr-7b-MI05-SELM sfulay/zephyr-7b-dpo-full-ultrabin-reward-scale-01-random LaoRay/zephyr-7b-dpo-lora sfulay/zephyr-7b-dpo-full-ultrabin-low-margin-3-epochs sfulay/zephyr-7b-dpo-full-ultrabin-low-margin just1nseo/zephyr-dpo-qlora-gpt4-5e-6 JW17/mistral-sft-simpo-cleaned-re just1nseo/zephyr-7b-dpop-ours-qlora-5e-7-epoch3 just1nseo/zephyr-dpo-qlora-uf6k-5e-7 just1nseo/zephyr-dpop-qlora-uf-5e-6 YYYYYYibo/imp_sam_1_iter_2 YYYYYYibo/imp_sam_iter_3 sfulay/zephyr-7b-dpo-full YYYYYYibo/nash_ave_pi_with_golden_iter_2 YYYYYYibo/nash_ave_pi_with_golden_iter_1 ishant0121/zephyr-7b-dpo-full YYYYYYibo/nash_ave_pi_iter_1 TTTXXX01/Negative_like_DPO_Chat-zephyr-7b-sft-full TTTXXX01/zephyr-7b-DPOBS128-full vwxyzjn/ppo_zephyr_vllm_2e-6_kl_0.03_num_mini_batches_4 vwxyzjn/ppo_zephyr_vllm_1e-6_kl_0.03_num_mini_batches_4 vwxyzjn/ppo_zephyr_vllm_1e-6_kl_0.03_num_mini_batches_2 vwxyzjn/ppo_zephyr_vllm_2e-6_kl_0.02_num_mini_batches_1 TTTXXX01/All_like_DPO_Chat-zephyr-7b-sft-full vwxyzjn/ppo_zephyr_vllm_1e-6_kl_0.03 TTTXXX01/DPO_shift2-Negative-zephyr-7b-sft-full YYYYYYibo/nash_simple_online_iter_3 YYYYYYibo/nash_simple_online_iter_2 YYYYYYibo/vanilla_dpo_iter_5 YYYYYYibo/vanilla_doff_dpo_iter_1 YYYYYYibo/nash_dpo_rank4_iter_plus_3 EllieS/Temp-L1-SFT-L2-DPO weqweasdas/zephyr-7b-dpo-full weijie210/zephyr-7b-UC-0 splm/zephyr-7b-sft-full-spin-peft-iter0 MaziyarPanahi/notus-7b-v1-GGUF MaziyarPanahi/notus-7b-v1-Mistral-7B-Instruct-v0.1-GGUF ondevicellm/zephyr-7b-dpo-full EllieS/zephyr-7b-sft-qlora LoneStriker/notus-7b-v1-8.0bpw-h8-exl2 tianlinliu0121/zephyr-7b-dpo-full EllieS/zephyr-dpo-timedial-selfgen-mix2 EllieS/zephyr-7b-sft-lora-timedial ZHLiu627/zephyr-7b-dpo-full argilla/notus-7b-v1 taicheng/zephyr-7b-align-scan-0.0-0.0-polynomial-1 sfulay/zephyr-7b-dpo-full-gpt-reward-scale-05 NicholasCorrado/zephyr-7b-hh-dpo NicholasCorrado/uf-rlced-conifer-zephyr-7b-dpo-full sfulay/zephyr-7b-dpo-full-gpt_consistent-reward-scale-1-rpo sfulay/zephyr-7b-dpo-full-gpt_consistent-high-curriculum sfulay/zephyr-7b-dpo-full-ultrabin-3-avg-logprob-lr-same yangzhao02/mistral-7b-dpo-all_pairs sfulay/zephyr-7b-dpo-full-ultrabin-low-bleu-3-epochs sfulay/zephyr-7b-dpo-full-ultrabin-high-bleu yangzhao02/mistral-7b-approx_ndcg AmberYifan/zephyr-spin-mix-data-zephyr-llama2 just1nseo/zephyr-dpo-qlora-uf-ours-5e-7-epoch1 just1nseo/zephyr-dpo-qlora-gpt4-5e-7-epoch3 YYYYYYibo/two_agent_iter_1 just1nseo/zephyr-dpop-qlora-gpt4-5e-7 just1nseo/zephyr-7b-dpop-ours-qlora-5e-6-epoch3 just1nseo/zephyr-7b-dpop-uf6k-qlora-5e-7-epoch3 just1nseo/zephyr-7b-dpo-uffull-qlora-5e-7 AmberYifan/zephyr-spin-phi3-data just1nseo/zephyr-dpo-qlora-uf-ours-uffull-5e-7 YYYYYYibo/imp_sam_1_iter_1 AmberYifan/spin-v-high-loss AmberYifan/spin-margin2 YYYYYYibo/nash_ave_pi_iter_2 TTTXXX01/zephyr-7b-DPOBS128Base-full AmberYifan/spin-filtered vwxyzjn/ppo_zephyr_vllm_1e-6_kl_0.02_num_mini_batches_2 vwxyzjn/ppo_zephyr_vllm_1e-6_kl_0.20 TTTXXX01/LS-zephyr-7b-sft-full EllieS/Temp-L1-SFT-L2-KTO YYYYYYibo/nash_rank4_all_iter_3 YYYYYYibo/nash_dpo_merge_iter_5 YYYYYYibo/nash_dpo_merge_iter_4 YYYYYYibo/nash_dpo_merge_iter_real_plus_3 YYYYYYibo/nash_dpo_rank4_iter_3 YYYYYYibo/nash_dpo_merge_iter_2 EllieS/TempReason-L1 YYYYYYibo/nash_dpo_iter_1 YYYYYYibo/zephyr-7b-lora-64-no-quant-all weijie210/zephyr-7b-UFB-0 YYYYYYibo/vanilla_dpo_iter_1 scottsuk0306/zephyr-7b-stem-train weijie210/IKEA-7b-UC-0 weijie210/zephyr-critique-7b-score bartowski/zephyr-7b-dpo-full-exl2 weijie210/zephyr-7b-dpo-full YYYYYYibo/zephyr-7b-lora-64-no-quant-4k YYYYYYibo/zephyr-7b-dpo-qlora-min-pi-part-0 Beanpow/zephyr-7b-dpo-full argilla/zephyr-7b-spin-iter0-v0 EllieS/zephyr-7b-dpo-lora-pubmedqa-selfgen-old taicheng/zephyr-7b-align-scan-0.0-0.0-linear-3 taicheng/zephyr-7b-align-scan-0.0-0.0-cosine-2 scottsuk0306/zephyr-7b-math-train-test scottsuk0306/zephyr-7b-stem-train-test NicholasCorrado/zephyr-7b-uf-dpo-2e NicholasCorrado/tulu-2-7b-rlced-conifer-dpo NicholasCorrado/rlced-conifer-zephyr-7b-dpo-full sfulay/zephyr-7b-dpo-full-prometheus_consistent-3 sfulay/zephyr-7b-dpo-full-prometheus-reward-scale-1-rpo sfulay/zephyr-7b-dpo-full-prometheus-low-curriculum sfulay/zephyr-7b-dpo-full-prometheus-high-bleu-3-epochs FrankWu96/zephyr-7b-dpo-full TTTXXX01/zephyr-7b-SimPO-Plus-SELM3 yangzhao02/mistral-7b-slic sfulay/zephyr-7b-dpo-full-ultrabin-high-curriculum sfulay/zephyr-7b-dpo-full-ultrabin-reward-scale-01 jmajkutewicz/zephyr-7b-shp just1nseo/zephyr-dpop-qlora-uf-ours-5e-6-epoch1 just1nseo/zephyr-dpop-qlora-gpt4-5e-7-epoch3 just1nseo/zephyr-dpo-qlora-gpt4-5e-7 AmberYifan/spin-v-mix just1nseo/zephyr-dpop-qlora-uf-ours-5e-7 YYYYYYibo/gshf_lora_iter_2 AmberYifan/zephyr-7b-sft-safe-hhrlhf YYYYYYibo/nash_ave_pi_with_golden_iter_3 YYYYYYibo/nash_ave_pi_iter_3 TTTXXX01/zephyr-7b-IL_DPOBPBase-full AmberYifan/spin-v-iter0-v2 vwxyzjn/ppo_zephyr_vllm_1e-6_kl_0.03_num_mini_batches_1 vwxyzjn/ppo_zephyr_vllm_2e-6_kl_0.03_num_mini_batches_1 vwxyzjn/ppo_zephyr_vllm_2e-6_kl_0.03_num_mini_batches_2 YYYYYYibo/nash_simple_online_iter_1 YYYYYYibo/vanilla_doff_iter_3 YYYYYYibo/vanilla_doff_iter_2 YYYYYYibo/nash_dpo_rank4_on_vanilla_iter_3 YYYYYYibo/nash_dpo_doff_real_no_golden_iter_1 AmberYifan/zephyr-7b-sft-safeDPO YYYYYYibo/nash_real_rank4_all_iter_2 justtherightsize/zephyr-7b-sft-full124_d270 NicholasCorrado/zephyr-7b-uf-rlced-conifer-group-dpo-2e-alr-0.1 NicholasCorrado/zephyr-7b-uf-rlced-conifer-group-dpo-2e-alr-0.01 weijie210/zephyr-7b-UFB-pure-0 MaziyarPanahi/notus-7b-v1-Mistral-7B-Instruct-v0.1 jlkj/zephyr-7b-sft-lora yimingzhang/zephyr-7b-dpo-full argilla/notus-7b-v1-lora dongwang218/zephyr-7b-dpo-full DaYin/zephyr-7b-dpo-full YYYYYYibo/zephyr-7b-lora-64-no-quant AmberYifan/safe-spin-iter0 ZHZisZZ/zephyr-7b-dpo-full DatPySci/zephyr-7b-kto-iter0-des133 erichen-0615/zephyr-7b-dpo-full SumanthRH/zephr_flex_packing_bsz_12 taicheng/zephyr-7b-align-scan-2e-07-0.5-linear-2.0 taicheng/zephyr-7b-align-scan-0.0-0.2-polynomial-3 scottsuk0306/zephyr-7b-math-test scottsuk0306/zephyr-7b-math-train SiliangZ/IRL_Iter0_Policy_Epoch5_RM_Data_SPIN_Iter0 NicholasCorrado/rlced-conifer-tulu-2-7b-dpo-full sfulay/zephyr-7b-dpo-full-gpt_consistent-reward-scale-01 sfulay/zephyr-7b-dpo-full-prometheus_consistent-reward-scale-1 sfulay/zephyr-7b-dpo-full-prometheus_consistent-low-curriculum yangzhao02/mistral-7b-dpo-single_pair NicholasCorrado/zephyr-7b-dpo-full sfulay/zephyr-7b-dpo-full-prometheus-reward-scale-01 sfulay/zephyr-7b-dpo-full-prometheus-high-margin-3-epochs sfulay/zephyr-7b-dpo-full-prometheus-high-curriculum sfulay/zephyr-7b-dpo-full-ultrabin-3-avg-logprob sfulay/zephyr-7b-dpo-full-magpi-reward-scale-1 sfulay/zephyr-7b-dpo-full-magpi-low-bleu-3-epochs sfulay/zephyr-7b-dpo-full-magpi-high-margin-3-epochs yangzhao02/mistral-7b-opo sfulay/zephyr-7b-dpo-full-ultrabin-high-margin-3-epochs AmberYifan/zephyr-spin-nll sfulay/zephyr-7b-dpo-full-ultrabin-reward-scale-1 just1nseo/zephyr-dpop-qlora-uf-oursuf6k-5e-6 just1nseo/zephyr-dpop-qlora-uf-5e-7-real just1nseo/zephyr-dpo-qlora-uf-5e-6 YYYYYYibo/gshf_lora_iter_1 sfulay/zephyr-7b-dpo-full-ultrabin-2 TTTXXX01/All_like128-zephyr-7b-sft-full vwxyzjn/ppo_zephyr_vllm_2e-6_kl_0.02_num_mini_batches_2 TTTXXX01/KL_shift-zephyr-7b-sft-full AmberYifan/spin-v-iter0 YYYYYYibo/nash_dpo_rank4_on_vanilla_iter_2 happii/zephyr-7b-dpo-full YYYYYYibo/nash_rank4_all_iter_2 YYYYYYibo/nash_dpo_rank4_iter_2 YYYYYYibo/nash_dpo_merge_iter_3 YYYYYYibo/nash_dpo_iter_3 weijie210/zephyr-7b-dpo-maximal scottsuk0306/zephyr-7b-sft-full weijie210/zephyr-7b-dpo-reference EllieS/zephyr-7b-dpo-lora-ultrafeedback EllieS/zephyr-7b-dpo-lora-pubmedqa LoneStriker/notus-7b-v1-5.0bpw-h6-exl2 nnheui/zephyr-7b-kto-qlora sengi/zephyr-7b-pl-qlora EllieS/zephyr-dpo-timedial-selfgen-mix EllieS/zephyr-dpo-timedial-selfgen EllieS/zephyr-7b-sft-qlora-mctaco plaguss/zephyr-7b-lora-adapter-dpo-dibt-v0 EllieS/zephyr-7b-dpo-lora-pubmedqa-selfgen-ultrafeedback-old AlexiaJM/zephyr-7b-dpo-full-repnew EllieS/zephyr-7b-dpo-selfgen scottsuk0306/zephyr-7b-stem-case-7 scottsuk0306/zephyr-7b-stem-case-5 scottsuk0306/zephyr-7b-math-case-7 DUAL-GPO/phi-2-kto-i0-v2 SumanthRH/zephr_flex_packing_bsz_4 taicheng/zephyr-7b-align-scan-0.0-0.0-polynomial-2 taicheng/zephyr-7b-align-scan-0.0-0.3-linear-3 NicholasCorrado/zephyr-7b-uf-rlced-conifer-dpo-2e NicholasCorrado/rlced_conifer_zephyr-7b-dpo-full sfulay/zephyr-7b-dpo-full-prometheus_consistent-reward-scale-01 sfulay/zephyr-7b-dpo-full-prometheus_consistent-high-curriculum sfulay/zephyr-7b-dpo-full-prometheus-reward-scale-05 TTTXXX01/zephyr-7b-Cal-DPO-4-001-False TTTXXX01/zephyr-7b-MI1-SELM3 LaoRay/zephyr-7b-dpo-lora-r16 sfulay/zephyr-7b-dpo-full-magpi-low-curriculum AmberYifan/zephyr-simpo-data-zephyr just1nseo/zephyr-dpop-qlora-uf-ours-5e-7-epoch1 just1nseo/zephyr-dpop-qlora-uf6k-5e-6 just1nseo/zephyr-dpop-qlora-uf-ours-uffull-5e-7 just1nseo/zephyr-dpo-qlora-uf-ours-uffull-5e-6 just1nseo/zephyr-dpop-qlora-uf-5e-7 AmberYifan/dpo-v-deduplicate YYYYYYibo/full_vanilla_dpo_iter_1 AmberYifan/spin-v-trans TTTXXX01/Positive_like_DPO_Chat-zephyr-7b-sft-full AmberYifan/dpo-v-trans 1t4chi/zephyr-7b-DPOBS128-full TTTXXX01/DPO_Chat-zephyr-7b-sft-full TTTXXX01/All_like-zephyr-7b-sft-full AmberYifan/zephyr-7b-sft-safeDPO3 YYYYYYibo/vanilla_doff_dpo_iter_2 NicholasCorrado/zephyr-7b-uf-rlced-conifer-group-dpo-2e-alr-0.01-1e LoneStriker/notus-7b-v1-4.0bpw-h6-exl2 nlile/zephyr-7b-dpo-full argilla/notus-7b-v1-lora-adapter YYYYYYibo/zephyr-7b-lora-64-no-quant-6k EllieS/zephyr-7b-dpo-lora-pubmedqa-ultrafeedback-mix abgoswam/zephyr-7b-dpo-full scottsuk0306/zephyr-7b-math-case-6-ep5 scottsuk0306/zephyr-7b-math-case-8 Borise/zephyr-7b-dpo-full taicheng/zephyr-7b-align-scan-7e-07-0.45-cosine-3.0 taicheng/zephyr-7b-align-scan-0.0-0.3-polynomial-1 scottsuk0306/zephyr-7b-math-test-half NicholasCorrado/uf-rlced-conifer-zephyr-7b-group-dpo-no-clip TTTXXX01/Mistral-7B-Base-SimPO2-5e-7 NicholasCorrado/zephyr-7b-group-dpo-full-3 sfulay/zephyr-7b-dpo-full-ultrabin-reward-scale-1-rpo TTTXXX01/zephyr-7b-Cal-DPO-SELM sfulay/zephyr-7b-dpo-full-magpi-reward-scale-01 sfulay/zephyr-7b-dpo-full-magpi-low-margin-3-epochs TTTXXX01/zephyr-7b-SimPO-SELM3 TTTXXX01/zephyr-7b-SimPO-SELM sfulay/zephyr-7b-dpo-full-magpi-high-bleu-3-epochs sfulay/zephyr-7b-dpo-full-magpi-3 sfulay/zephyr-7b-dpo-full-ultrabin-amazon sfulay/zephyr-7b-dpo-full-ultrabin-reward-scale-05 jmajkutewicz/zephyr-7b-oasst1 just1nseo/zephyr-dpo-qlora-gpt4-5e-6-epoch3 just1nseo/zephyr-dpo-qlora-uf6k-5e-6 just1nseo/zephyr-7b-dpo-oursuf6k-qlora-5e-6 just1nseo/zephyr-dpop-qlora-uf-oursuf6k-5e-7 YYYYYYibo/imp_sam_1_iter_3 YYYYYYibo/full_vanilla_doff_dpo_iter_1 AmberYifan/base-sft-safe-spin-v AmberYifan/zephyr-7b-sft-safe AmberYifan/spin-margin1 vwxyzjn/ppo_zephyr_vllm_1e-6_kl_0.02_num_mini_batches_4 TTTXXX01/zephyr-7b-DPO-full vwxyzjn/ppo_zephyr_vllm_1e-6_kl_0.05 TTTXXX01/energy-reg-zephyr-7b-sft-full YYYYYYibo/vanilla_doff_iter_1 YYYYYYibo/vanilla_dpo_iter_6 ShenaoZ/vanilla_dpo_iter_4 YYYYYYibo/nash_dpo_doff_no_golden_iter_3 vwxyzjn/rm_zephyr YYYYYYibo/nash_real_rank4_all_iter_3 YYYYYYibo/nash_dpo_iter_2 jmajkutewicz/zephyr-7b-dpo-lora weijie210/zephyr-7b-UC-0-B0.5 splm/zephyr-7b-sft-full-spin-peft-iter2 yangzhao02/mistral-7b-lambdarank
mradermacher/Elysium-Omni-11b-GGUF mradermacher/SharkOgno-11b-Passthrough-GGUF powermove72/Elysium-Omni-11b mradermacher/Shark-Coder-9b-GGUF powermove72/SharkOgno-11b-Passthrough powermove72/Elysium-Omni-Itt-11b mradermacher/Stealth-Notus-xb-GGUF powermove72/FusionNotus-Gk-MoE-13b-slerp argilla/zephyr-7b-spin-iter1-v0 YYYYYYibo/approx_nash_1_iter_2 YYYYYYibo/two_agent_rdpo_iter_2 TTTXXX01/DPO_shift2-zephyr-7b-sft-full TTTXXX01/Bernoulli_Like_Positive1-7b-sft-full TTTXXX01/Bernoulli_Like_Negative1-zephyr-7b-sft-full TTTXXX01/IL_BrierAll-7b-sft-full youndukn/zephyr-7b-sft-lora weijie210/zephyr-7b-dpo-full bartowski/zephyr-7b-dpo-full-exl2 weijie210/zephyr-critique-7b-score weijie210/IKEA-7b-UC-0 NicholasCorrado/zephyr-7b-uf-rlced-conifer-group-dpo-2e-alr-0.01 NicholasCorrado/zephyr-7b-uf-rlced-conifer-group-dpo-2e-alr-0.1 justtherightsize/zephyr-7b-sft-full124_d270 YYYYYYibo/nash_real_rank4_all_iter_2 AmberYifan/zephyr-7b-sft-safeDPO YYYYYYibo/nash_dpo_doff_real_no_golden_iter_1 YYYYYYibo/nash_dpo_rank4_on_vanilla_iter_3 YYYYYYibo/vanilla_doff_iter_2 YYYYYYibo/vanilla_doff_iter_3 YYYYYYibo/nash_simple_online_iter_1 vwxyzjn/ppo_zephyr_vllm_2e-6_kl_0.03_num_mini_batches_2 vwxyzjn/ppo_zephyr_vllm_2e-6_kl_0.03_num_mini_batches_1 vwxyzjn/ppo_zephyr_vllm_1e-6_kl_0.03_num_mini_batches_1 AmberYifan/spin-v-iter0-v2 TTTXXX01/zephyr-7b-IL_DPOBPBase-full YYYYYYibo/nash_ave_pi_iter_3 YYYYYYibo/nash_ave_pi_with_golden_iter_3 AmberYifan/zephyr-7b-sft-safe-hhrlhf YYYYYYibo/gshf_lora_iter_2 just1nseo/zephyr-dpop-qlora-uf-ours-5e-7 AmberYifan/spin-v-mix just1nseo/zephyr-dpo-qlora-gpt4-5e-7 just1nseo/zephyr-dpop-qlora-gpt4-5e-7-epoch3 just1nseo/zephyr-dpop-qlora-uf-ours-5e-6-epoch1 jmajkutewicz/zephyr-7b-shp sfulay/zephyr-7b-dpo-full-ultrabin-reward-scale-01 sfulay/zephyr-7b-dpo-full-ultrabin-high-curriculum yangzhao02/mistral-7b-slic TTTXXX01/zephyr-7b-SimPO-Plus-SELM3 FrankWu96/zephyr-7b-dpo-full sfulay/zephyr-7b-dpo-full-prometheus-high-bleu-3-epochs sfulay/zephyr-7b-dpo-full-prometheus-low-curriculum sfulay/zephyr-7b-dpo-full-prometheus-reward-scale-1-rpo sfulay/zephyr-7b-dpo-full-prometheus_consistent-3 NicholasCorrado/rlced-conifer-zephyr-7b-dpo-full NicholasCorrado/tulu-2-7b-rlced-conifer-dpo NicholasCorrado/zephyr-7b-uf-dpo-2e scottsuk0306/zephyr-7b-stem-train-test scottsuk0306/zephyr-7b-math-train-test taicheng/zephyr-7b-align-scan-0.0-0.0-cosine-2 taicheng/zephyr-7b-align-scan-0.0-0.0-linear-3 EllieS/zephyr-7b-dpo-lora-pubmedqa-selfgen-old argilla/zephyr-7b-spin-iter0-v0 Beanpow/zephyr-7b-dpo-full YYYYYYibo/zephyr-7b-dpo-qlora-min-pi-part-0 YYYYYYibo/zephyr-7b-lora-64-no-quant-4k mradermacher/Elysium2.2-task-11b-GGUF mradermacher/Elysium2.1-11b-i1-GGUF mradermacher/SharkOgno2-7b-Passthrough-GGUF AmberYifan/safe-spin-iter2 powermove72/Elysium2-11b mradermacher/Trinity_Notus2-xb-GGUF AINovice2005/LeEmpereur_70-Base AmberYifan/safe-spin-iter1-v2 AmberYifan/safe-spin-iter1 YYYYYYibo/full_vanilla_dpo_iter_2 YYYYYYibo/two_agent_1_dpo_iter_2 YYYYYYibo/two_agent_1_rdpo_iter_2 TTTXXX01/IL_DPO128-zephyr-7b-sft-full powermove72/Notus-TheTop-7b-Slerp QuantFactory/notus-7b-v1-GGUF TachyHealth/Thealthnotus-7b_v1 nlile/zephyr-7b-dpo-full LoneStriker/notus-7b-v1-4.0bpw-h6-exl2 yangzhao02/mistral-7b-lambdarank splm/zephyr-7b-sft-full-spin-peft-iter2 weijie210/zephyr-7b-UC-0-B0.5 jmajkutewicz/zephyr-7b-dpo-lora YYYYYYibo/nash_dpo_iter_2 YYYYYYibo/nash_real_rank4_all_iter_3 vwxyzjn/rm_zephyr YYYYYYibo/nash_dpo_doff_no_golden_iter_3 ShenaoZ/vanilla_dpo_iter_4 YYYYYYibo/vanilla_dpo_iter_6 YYYYYYibo/vanilla_doff_iter_1 TTTXXX01/energy-reg-zephyr-7b-sft-full vwxyzjn/ppo_zephyr_vllm_1e-6_kl_0.05 TTTXXX01/zephyr-7b-DPO-full vwxyzjn/ppo_zephyr_vllm_1e-6_kl_0.02_num_mini_batches_4 AmberYifan/spin-margin1 AmberYifan/zephyr-7b-sft-safe AmberYifan/base-sft-safe-spin-v YYYYYYibo/full_vanilla_doff_dpo_iter_1 YYYYYYibo/imp_sam_1_iter_3 just1nseo/zephyr-dpop-qlora-uf-oursuf6k-5e-7 just1nseo/zephyr-7b-dpo-oursuf6k-qlora-5e-6 just1nseo/zephyr-dpo-qlora-uf6k-5e-6 just1nseo/zephyr-dpo-qlora-gpt4-5e-6-epoch3 jmajkutewicz/zephyr-7b-oasst1 sfulay/zephyr-7b-dpo-full-ultrabin-reward-scale-05 sfulay/zephyr-7b-dpo-full-ultrabin-amazon sfulay/zephyr-7b-dpo-full-magpi-3 sfulay/zephyr-7b-dpo-full-magpi-high-bleu-3-epochs TTTXXX01/zephyr-7b-SimPO-SELM TTTXXX01/zephyr-7b-SimPO-SELM3 sfulay/zephyr-7b-dpo-full-magpi-low-margin-3-epochs sfulay/zephyr-7b-dpo-full-magpi-reward-scale-01 TTTXXX01/zephyr-7b-Cal-DPO-SELM sfulay/zephyr-7b-dpo-full-ultrabin-reward-scale-1-rpo NicholasCorrado/zephyr-7b-group-dpo-full-3 TTTXXX01/Mistral-7B-Base-SimPO2-5e-7 NicholasCorrado/uf-rlced-conifer-zephyr-7b-group-dpo-no-clip scottsuk0306/zephyr-7b-math-test-half taicheng/zephyr-7b-align-scan-0.0-0.3-polynomial-1 taicheng/zephyr-7b-align-scan-7e-07-0.45-cosine-3.0 Borise/zephyr-7b-dpo-full scottsuk0306/zephyr-7b-math-case-8 scottsuk0306/zephyr-7b-math-case-6-ep5 abgoswam/zephyr-7b-dpo-full EllieS/zephyr-7b-dpo-lora-pubmedqa-ultrafeedback-mix YYYYYYibo/zephyr-7b-lora-64-no-quant-6k argilla/notus-7b-v1-lora-adapter argilla/zephyr-7b-spin-iter2-v0 powermove72/SharkOgno2-7b-Passthrough powermove72/Trinity_Notus-xb-Q4_K_M-GGUF powermove72/Elysium-Slerp mradermacher/GK-inv-MoE-0.1-GGUF mradermacher/GK-MoE-0.1-GGUF YYYYYYibo/gshf_ours_1_iter_2 YYYYYYibo/approx_nash_3temp_iter_2 YYYYYYibo/selm_ours_iter_2 YYYYYYibo/selm_ours_1_iter_2 mradermacher/zephyr-7b-DPOBS128-full-GGUF TTTXXX01/IL_BERAll-zephyr-7b-sft-full TTTXXX01/DPO-Negative-zephyr-7b-sft-full powermove72/GK-MoE-0.1 powermove72/Notus-TheTop-7b-Passthrough powermove72/Trinity_Notus2-xb youndukn/zephyr-7b-sft-lora-romantic YYYYYYibo/full_vanilla_doff_dpo_iter_2 tianlinliu0121/zephyr-7b-dpo-full-beta-0.083 timlim123/zephyr-7b-dpo-full LoneStriker/notus-7b-v1-3.0bpw-h6-exl2 yihang7/zephyr-7b-dpo-full jikaixuan/zephyr-ds weijie210/zephyr-7b-teacher MaziyarPanahi/zephyr-7b-sft-full-GGUF weijie210/zephyr-7b-UFB-ref scottsuk0306/zephyr-7b-stem-test scottsuk0306/zephyr-7b-stem-half justtherightsize/zephyr-7b-sft-full124 AmberYifan/advsafe_plus-spin-iter0 YYYYYYibo/vanilla_doff_dpo_iter_3 YYYYYYibo/nash_dpo_doff_real_no_golden_iter_3 YYYYYYibo/nash_dpo_rank4_on_vanilla_iter_1 wyan1/zephyr-7b-dpo-full TTTXXX01/energy-zephyr-7b-sft-full TTTXXX01/DPO_shift-zephyr-7b-sft-full TTTXXX01/Ber_shift-zephyr-7b-sft-full TTTXXX01/Negative_likelihood-zephyr-7b-sft-full TTTXXX01/DPO-Baseline-zephyr-7b-sft-full vwxyzjn/ppo_zephyr_vllm_1e-6_kl_0.15 TTTXXX01/DPO005-Baseline-zephyr-7b-sft-full AmberYifan/spin-advbench TTTXXX01/All_like48-zephyr-7b-sft-full YYYYYYibo/imp_sam_iter_1 just1nseo/zephyr-dpo-qlora-uf-ours-5e-6 AmberYifan/spin-v-diverse AmberYifan/zephyr-spin-llama2-data just1nseo/zephyr-7b-dpop-uf6k-qlora-5e-6-epoch3 nlee-208/zephyr-7b-sft-kto2 sruthigorantla/zephyr-7b-dpo-full just1nseo/zephyr-dpop-qlora-gpt4-5e-6-epoch3 just1nseo/zephyr-dpo-qlora-uf-ours-5e-6-epoch1 TTTXXX01/zephyr-7b-MI-1-selm2 sfulay/zephyr-7b-dpo-full-magpi-reward-scale-05 zodi1121/zephyr-7b-dpo-full sfulay/zephyr-7b-dpo-full-gpt-low-curriculum sfulay/zephyr-7b-dpo-full-gpt-reward-scale-01 sfulay/zephyr-7b-dpo-full-gpt_consistent-reward-scale-05 NicholasCorrado/rlced-conifer-zephyr-7b-dpo-2e NicholasCorrado/zephyr-7b-uf-rlced-conifer-1e2e-group-dpo-2e taicheng/zephyr-7b-align-scan taicheng/zephyr-7b-align-scan-0.0-0.9-linear-2 taicheng/zephyr-7b-align-scan-0.0-0.7-cosine-3 taicheng/zephyr-7b-align-scan-0.0-0.3-polynomial-3 taicheng/zephyr-7b-align-scan-0.0-1.0-linear-2 taicheng/zephyr-7b-align-scan-0.0-0.9-polynomial-3 taicheng/zephyr-7b-align-scan-0.0-0.0-linear-1 scottsuk0306/zephyr-7b-math-case-6-ep1 EllieS/zephyr-7b-dpo-lora-pubmedqa-selfgen-ultrafeedback-com EllieS/zephyr-7b-dpo-lora-pubmedqa-mix2 AmberYifan/test-spin-iter0 YYYYYYibo/zephyr-7b-lora-64-no-quant-2k mradermacher/Shark-1-Ogno-9b-passthrough-GGUF mradermacher/FusionNotus-Gk-MoE-13b-slerp-GGUF powermove72/Shark-1-Ogno-7b-passthrough powermove72/Shark-Coder powermove72/Elysium-Passthrough mradermacher/Notus-TheTop-7b-Slerp-GGUF YYYYYYibo/approx_nash_again_1_iter_2 TTTXXX01/IL_DPO48-zephyr-7b-sft-full TTTXXX01/IL_SquareAll-7b-sft-full youndukn/zephyr-7b-sft-lora-check powermove72/Stealth-Notus-xb AINovice2005/LeEmpereur_70 TheBloke/notus-7B-v1-AWQ mradermacher/zephyr-spin-phi3-data-GGUF LoneStriker/notus-7b-v1-5.0bpw-h6-exl2 EllieS/zephyr-7b-dpo-lora-pubmedqa EllieS/zephyr-7b-dpo-lora-ultrafeedback weijie210/zephyr-7b-dpo-reference NicholasCorrado/zephyr-7b-uf-rlced-conifer-group-dpo-2e-alr-0.01-1e YYYYYYibo/vanilla_doff_dpo_iter_2 AmberYifan/zephyr-7b-sft-safeDPO3 TTTXXX01/All_like-zephyr-7b-sft-full TTTXXX01/DPO_Chat-zephyr-7b-sft-full 1t4chi/zephyr-7b-DPOBS128-full AmberYifan/dpo-v-trans TTTXXX01/Positive_like_DPO_Chat-zephyr-7b-sft-full AmberYifan/spin-v-trans YYYYYYibo/full_vanilla_dpo_iter_1 AmberYifan/dpo-v-deduplicate just1nseo/zephyr-dpop-qlora-uf-5e-7 just1nseo/zephyr-dpo-qlora-uf-ours-uffull-5e-6 just1nseo/zephyr-dpop-qlora-uf-ours-uffull-5e-7 just1nseo/zephyr-dpop-qlora-uf6k-5e-6 just1nseo/zephyr-dpop-qlora-uf-ours-5e-7-epoch1 AmberYifan/zephyr-simpo-data-zephyr sfulay/zephyr-7b-dpo-full-magpi-low-curriculum LaoRay/zephyr-7b-dpo-lora-r16 TTTXXX01/zephyr-7b-MI1-SELM3 TTTXXX01/zephyr-7b-Cal-DPO-4-001-False sfulay/zephyr-7b-dpo-full-prometheus-reward-scale-05 sfulay/zephyr-7b-dpo-full-prometheus_consistent-high-curriculum sfulay/zephyr-7b-dpo-full-prometheus_consistent-reward-scale-01 NicholasCorrado/rlced_conifer_zephyr-7b-dpo-full NicholasCorrado/zephyr-7b-uf-rlced-conifer-dpo-2e taicheng/zephyr-7b-align-scan-0.0-0.3-linear-3 taicheng/zephyr-7b-align-scan-0.0-0.0-polynomial-2 SumanthRH/zephr_flex_packing_bsz_4 DUAL-GPO/phi-2-kto-i0-v2 scottsuk0306/zephyr-7b-math-case-7 scottsuk0306/zephyr-7b-stem-case-5 scottsuk0306/zephyr-7b-stem-case-7 EllieS/zephyr-7b-dpo-selfgen AlexiaJM/zephyr-7b-dpo-full-repnew EllieS/zephyr-7b-dpo-lora-pubmedqa-selfgen-ultrafeedback-old plaguss/zephyr-7b-lora-adapter-dpo-dibt-v0 EllieS/zephyr-7b-sft-qlora-mctaco EllieS/zephyr-dpo-timedial-selfgen EllieS/zephyr-dpo-timedial-selfgen-mix sengi/zephyr-7b-pl-qlora nnheui/zephyr-7b-kto-qlora bartowski/zephyr-7b-spin-iter3-v0-exl2 mradermacher/Elysium2.1-11b-GGUF powermove72/SharkOgno-7b-Task powermove72/Elysium2-11b-Slerp powermove72/Elysium2.2-task-11b powermove72/Notus-TheTop-7b-Passthrough-Q4_K_M-GGUF YYYYYYibo/full_vanilla_doff_dpo_iter_3 MaziyarPanahi/notus-7b-v1-Mistral-7B-Instruct-v0.1-GGUF YYYYYYibo/two_agent_2_rdpo_iter_2 YYYYYYibo/spin_dpo_dpo_iter_2 TTTXXX01/DPO_shift2_average-zephyr-7b-sft-full TTTXXX01/DPOAll-zephyr-7b-sft-full TTTXXX01/IL_DPO_ChatALL-zephyr-7b-sft-full MaziyarPanahi/notus-7b-v1-GGUF powermove72/GK-inv-MoE-0.1 powermove72/SoMix2-xb TheBloke/notus-7B-v1-GPTQ LoneStriker/notus-7b-v1-8.0bpw-h8-exl2 EllieS/zephyr-7b-sft-qlora ondevicellm/zephyr-7b-dpo-full scottsuk0306/zephyr-7b-stem-train weijie210/zephyr-7b-UFB-0 YYYYYYibo/zephyr-7b-lora-64-no-quant-all YYYYYYibo/vanilla_dpo_iter_1 YYYYYYibo/nash_dpo_iter_1 EllieS/TempReason-L1 YYYYYYibo/nash_dpo_merge_iter_2 YYYYYYibo/nash_dpo_rank4_iter_3 YYYYYYibo/nash_dpo_merge_iter_real_plus_3 YYYYYYibo/nash_dpo_merge_iter_4 YYYYYYibo/nash_dpo_merge_iter_5 YYYYYYibo/nash_rank4_all_iter_3 EllieS/Temp-L1-SFT-L2-KTO TTTXXX01/LS-zephyr-7b-sft-full vwxyzjn/ppo_zephyr_vllm_1e-6_kl_0.20 vwxyzjn/ppo_zephyr_vllm_1e-6_kl_0.02_num_mini_batches_2 AmberYifan/spin-filtered TTTXXX01/zephyr-7b-DPOBS128Base-full YYYYYYibo/nash_ave_pi_iter_2 AmberYifan/spin-margin2 AmberYifan/spin-v-high-loss YYYYYYibo/imp_sam_1_iter_1 just1nseo/zephyr-dpo-qlora-uf-ours-uffull-5e-7 AmberYifan/zephyr-spin-phi3-data just1nseo/zephyr-7b-dpo-uffull-qlora-5e-7 just1nseo/zephyr-7b-dpop-uf6k-qlora-5e-7-epoch3 just1nseo/zephyr-7b-dpop-ours-qlora-5e-6-epoch3 just1nseo/zephyr-dpop-qlora-gpt4-5e-7 YYYYYYibo/two_agent_iter_1 just1nseo/zephyr-dpo-qlora-gpt4-5e-7-epoch3 just1nseo/zephyr-dpo-qlora-uf-ours-5e-7-epoch1 AmberYifan/zephyr-spin-mix-data-zephyr-llama2 yangzhao02/mistral-7b-approx_ndcg sfulay/zephyr-7b-dpo-full-ultrabin-high-bleu sfulay/zephyr-7b-dpo-full-ultrabin-low-bleu-3-epochs yangzhao02/mistral-7b-dpo-all_pairs sfulay/zephyr-7b-dpo-full-ultrabin-3-avg-logprob-lr-same sfulay/zephyr-7b-dpo-full-gpt_consistent-high-curriculum sfulay/zephyr-7b-dpo-full-gpt_consistent-reward-scale-1-rpo NicholasCorrado/uf-rlced-conifer-zephyr-7b-dpo-full NicholasCorrado/zephyr-7b-hh-dpo sfulay/zephyr-7b-dpo-full-gpt-reward-scale-05 taicheng/zephyr-7b-align-scan-0.0-0.0-polynomial-1 argilla/notus-7b-v1 ZHLiu627/zephyr-7b-dpo-full EllieS/zephyr-7b-sft-lora-timedial EllieS/zephyr-dpo-timedial-selfgen-mix2 tianlinliu0121/zephyr-7b-dpo-full argilla/zephyr-7b-spin-iter3-v0 mradermacher/Shark-1-Ogno-7b-passthrough-GGUF ClaudioItaly/TopMaya-Q4_K_M-GGUF powermove72/Shark-1-Ogno-9b-passthrough YYYYYYibo/full_simple_online_iter_3 YYYYYYibo/gshf_iter_3 YYYYYYibo/two_agent_dpo_iter_2 YYYYYYibo/approx_nash_rdpo_iter_2 YYYYYYibo/approx_nash_again_iter_2 ClaudioItaly/TopMaya AmberYifan/sft-safe-spin-v TTTXXX01/IL_DPOAll-zephyr-7b-sft-full powermove72/Trinity_Notus-xb powermove72/Shark-1 TheBloke/notus-7B-v1-GGUF mradermacher/zephyr-7b-hh-dpo-GGUF mradermacher/zephyr-7b-hh-dpo-i1-GGUF weijie210/zephyr-7b-critique-pairwise splm/zephyr-7b-sft-full-spin-peft-iter0 weijie210/zephyr-7b-UC-0 weqweasdas/zephyr-7b-dpo-full EllieS/Temp-L1-SFT-L2-DPO YYYYYYibo/nash_dpo_rank4_iter_plus_3 YYYYYYibo/vanilla_doff_dpo_iter_1 YYYYYYibo/vanilla_dpo_iter_5 YYYYYYibo/nash_simple_online_iter_2 YYYYYYibo/nash_simple_online_iter_3 TTTXXX01/DPO_shift2-Negative-zephyr-7b-sft-full vwxyzjn/ppo_zephyr_vllm_1e-6_kl_0.03 TTTXXX01/All_like_DPO_Chat-zephyr-7b-sft-full vwxyzjn/ppo_zephyr_vllm_2e-6_kl_0.02_num_mini_batches_1 vwxyzjn/ppo_zephyr_vllm_1e-6_kl_0.03_num_mini_batches_2 vwxyzjn/ppo_zephyr_vllm_1e-6_kl_0.03_num_mini_batches_4 vwxyzjn/ppo_zephyr_vllm_2e-6_kl_0.03_num_mini_batches_4 TTTXXX01/zephyr-7b-DPOBS128-full TTTXXX01/Negative_like_DPO_Chat-zephyr-7b-sft-full YYYYYYibo/nash_ave_pi_iter_1 ishant0121/zephyr-7b-dpo-full YYYYYYibo/nash_ave_pi_with_golden_iter_1 YYYYYYibo/nash_ave_pi_with_golden_iter_2 sfulay/zephyr-7b-dpo-full YYYYYYibo/imp_sam_iter_3 YYYYYYibo/imp_sam_1_iter_2 just1nseo/zephyr-dpop-qlora-uf-5e-6 just1nseo/zephyr-dpo-qlora-uf6k-5e-7 just1nseo/zephyr-7b-dpop-ours-qlora-5e-7-epoch3 JW17/mistral-sft-simpo-cleaned-re just1nseo/zephyr-dpo-qlora-gpt4-5e-6 sfulay/zephyr-7b-dpo-full-ultrabin-low-margin sfulay/zephyr-7b-dpo-full-ultrabin-low-margin-3-epochs LaoRay/zephyr-7b-dpo-lora sfulay/zephyr-7b-dpo-full-ultrabin-reward-scale-01-random TTTXXX01/zephyr-7b-MI05-SELM TTTXXX01/zephyr-7b-Cal-DPO-1-001-False LaoRay/zephyr-7b-dpo-lora-r16-20k sfulay/zephyr-7b-dpo-full-prometheus-3 TTTXXX01/Mistral-7B-Base-MI-1e-6 sfulay/zephyr-7b-dpo-full-prometheus_consistent-reward-scale-1-rpo NicholasCorrado/zephyr-7b-group-dpo-full-4 sfulay/zephyr-7b-dpo-full-gpt_consistent-3 sfulay/zephyr-7b-dpo-full-gpt_consistent-reward-scale-1 yangzhao02/mistral-7b-listmle NicholasCorrado/uf-rlced-conifer-zephyr-7b-group-dpo-full NicholasCorrado/zephyr-7b-uf-rlced-conifer-group-dpo-2e taicheng/zephyr-7b-align-scan-0.0-0.8-cosine-1 taicheng/zephyr-7b-align-scan-9e-07-0.86-linear-2.0 taicheng/zephyr-7b-align-scan-3e-07-0.62-polynomial-3.0 taicheng/zephyr-7b-align-scan-7e-07-0.99-cosine-2.0 taicheng/zephyr-7b-align-scan-2e-07-0.39-polynomial-1.0 scottsuk0306/zephyr-7b-math-case-4 EllieS/zephyr-sft-timedial EllieS/zephyr-dpo-timedial bartowski/zephyr-7b-spin-iter3-v0-GGUF powermove72/SharkOgno-11b-Passthrough-Q4_K_M-GGUF mradermacher/LeEmpereur_70-Base-GGUF mradermacher/Shark-Coder-GGUF powermove72/Elysium2.1-11b powermove72/IceShark-Coder-9b mradermacher/SoMix2-xb-GGUF YYYYYYibo/gshf_iter_2 YYYYYYibo/approx_nash_maxmin_iter_2 YYYYYYibo/two_agent_2_dpo_iter_2 TTTXXX01/IL_LSAll-7b-sft-full powermove72/GreenNodeviolet-Notus-Passthrough burtenshaw/notus-merged-with-code-mistral-so-its-better-at-coding LoneStriker/notus-7b-v1-6.0bpw-h6-exl2 UCLA-AGI/zephyr-7b-sft-full-SPIN-iter1 EllieS/zephyr-7b-dpo-lora-pubmedqa-ultrafeedback NicholasCorrado/zephyr-7b-uf-rc-small-dpo taicheng/zephyr-7b-align-scan-dpo0.1data-5e-07-0.01-1-cosine-8 splm/zephyr-7b-sft-full-spin-peft-iter1 YYYYYYibo/vanilla_dpo_iter_2 YYYYYYibo/vanilla_dpo_iter_3 AmberYifan/advsafe-spin-iter0 YYYYYYibo/nash_dpo_rank4_iter_real_plus_3 YYYYYYibo/nash_dpo_merge_iter_6 fenguhao/zephyr-7b-dpo-full YYYYYYibo/nash_dpo_doff_no_golden_iter_1 YYYYYYibo/nash_dpo_doff_no_golden_iter_2 YYYYYYibo/nash_dpo_doff_real_no_golden_iter_2 YYYYYYibo/vanilla_dpo_iter_4 AmberYifan/dpo-v CXL295/zephyr-7b-dpo-full TTTXXX01/KL-zephyr-7b-sft-full TTTXXX01/Positive_likelihood-zephyr-7b-sft-full vwxyzjn/ppo_zephyr_vllm_2e-6_kl_0.02_num_mini_batches_4 vwxyzjn/ppo_zephyr_vllm_1e-6_kl_0.02_num_mini_batches_1 TTTXXX01/zephyr-7b-DPOBS48-full YYYYYYibo/imp_sam_iter_2 sfulay/zephyr-7b-dpo-full-hh AmberYifan/spin-v-deduplicate YYYYYYibo/gshf_lora_iter_3 just1nseo/zephyr-dpop-qlora-uf-ours-5e-6 just1nseo/zephyr-dpo-qlora-uf-ours-5e-7 just1nseo/zephyr-dpop-qlora-uf-ours-uffull-5e-6 just1nseo/zephyr-dpo-qlora-uf-oursuf6k-5e-7 just1nseo/zephyr-dpop-qlora-uf6k-5e-7 sfulay/zephyr-7b-dpo-full-ultrabin-high-margin sfulay/zephyr-7b-dpo-full-ultrabin-low-curriculum sfulay/zephyr-7b-dpo-full-ultrabin-low-bleu sfulay/zephyr-7b-dpo-full-magpi-high-curriculum sfulay/zephyr-7b-dpo-full-ultrabin-high-bleu-3-epochs TTTXXX01/zephyr-7b-MI-1-SELM sfulay/zephyr-7b-dpo-full-prometheus-reward-scale-1 sfulay/zephyr-7b-dpo-full-gpt-high-curriculum NicholasCorrado/uf-rlced-conifer-zephyr-7b-group-dpo-no-clip-no-excess sfulay/zephyr-7b-dpo-full-gpt_consistent-reward-scale-1-rpo-gamma-2 sfulay/zephyr-7b-dpo-full-gpt_consistent-reward-scale-1-rpo-gamma-05 taicheng/zephyr-7b-align-scan-0.0-0.4-polynomial-2 taicheng/zephyr-7b-align-scan-4e-07-0.45-cosine-1.0 taicheng/zephyr-7b-align-scan-6e-07-0.53-polynomial-2.0 taicheng/zephyr-7b-align-scan-0.0-0.0-polynomial-3 SumanthRH/zephr_fa3_packing_bsz_4 SumanthRH/zephr_flex_packing_bsz_8 scottsuk0306/zephyr-7b-math-case-6 alignment-handbook/zephyr-7b-dpo-full EllieS/zephyr-7b-dpo-lora-pubmedqa-selfgen-complete DatPySci/zephyr-7b-kto-iter0 EllieS/zephyr-7b-dpo-lora-timedial mradermacher/SharkOgno-7b-Task-GGUF powermove72/Shark-Coder-Q4_K_M-GGUF YYYYYYibo/full_vanilla_dpo_iter_3 mradermacher/TopMaya-GGUF powermove72/SharkOgno2-9b-Passthrough powermove72/Shark-Coder-9b mradermacher/Notus-TheTop-7b-Passthrough-GGUF AmberYifan/test-spin-iter1 YYYYYYibo/gshf_ours_iter_2 mradermacher/zephyr-7b-dpo-full-ultrabin-2-GGUF TTTXXX01/Ber_shift2-zephyr-7b-sft-full TTTXXX01/IL_ExponentialAll-7b-sft-full AlekseyKorshuk/notus-casino-reviews powermove72/GreenNodeviolet-Notus-Linear yimingzhang/zephyr-7b-dpo-full jlkj/zephyr-7b-sft-lora MaziyarPanahi/notus-7b-v1-Mistral-7B-Instruct-v0.1 weijie210/zephyr-7b-UFB-pure-0 scottsuk0306/zephyr-7b-sft-full weijie210/zephyr-7b-dpo-maximal YYYYYYibo/nash_dpo_iter_3 YYYYYYibo/nash_dpo_merge_iter_3 YYYYYYibo/nash_dpo_rank4_iter_2 YYYYYYibo/nash_rank4_all_iter_2 happii/zephyr-7b-dpo-full YYYYYYibo/nash_dpo_rank4_on_vanilla_iter_2 AmberYifan/spin-v-iter0 TTTXXX01/KL_shift-zephyr-7b-sft-full vwxyzjn/ppo_zephyr_vllm_2e-6_kl_0.02_num_mini_batches_2 TTTXXX01/All_like128-zephyr-7b-sft-full sfulay/zephyr-7b-dpo-full-ultrabin-2 YYYYYYibo/gshf_lora_iter_1 just1nseo/zephyr-dpo-qlora-uf-5e-6 just1nseo/zephyr-dpop-qlora-uf-5e-7-real just1nseo/zephyr-dpop-qlora-uf-oursuf6k-5e-6 sfulay/zephyr-7b-dpo-full-ultrabin-reward-scale-1 AmberYifan/zephyr-spin-nll sfulay/zephyr-7b-dpo-full-ultrabin-high-margin-3-epochs yangzhao02/mistral-7b-opo sfulay/zephyr-7b-dpo-full-magpi-high-margin-3-epochs sfulay/zephyr-7b-dpo-full-magpi-low-bleu-3-epochs sfulay/zephyr-7b-dpo-full-magpi-reward-scale-1 sfulay/zephyr-7b-dpo-full-ultrabin-3-avg-logprob sfulay/zephyr-7b-dpo-full-prometheus-high-curriculum sfulay/zephyr-7b-dpo-full-prometheus-high-margin-3-epochs sfulay/zephyr-7b-dpo-full-prometheus-reward-scale-01 NicholasCorrado/zephyr-7b-dpo-full yangzhao02/mistral-7b-dpo-single_pair sfulay/zephyr-7b-dpo-full-prometheus_consistent-low-curriculum sfulay/zephyr-7b-dpo-full-prometheus_consistent-reward-scale-1 sfulay/zephyr-7b-dpo-full-gpt_consistent-reward-scale-01 NicholasCorrado/rlced-conifer-tulu-2-7b-dpo-full SiliangZ/IRL_Iter0_Policy_Epoch5_RM_Data_SPIN_Iter0 scottsuk0306/zephyr-7b-math-train scottsuk0306/zephyr-7b-math-test taicheng/zephyr-7b-align-scan-0.0-0.2-polynomial-3 taicheng/zephyr-7b-align-scan-2e-07-0.5-linear-2.0 SumanthRH/zephr_flex_packing_bsz_12 erichen-0615/zephyr-7b-dpo-full DatPySci/zephyr-7b-kto-iter0-des133 ZHZisZZ/zephyr-7b-dpo-full AmberYifan/safe-spin-iter0 YYYYYYibo/zephyr-7b-lora-64-no-quant DaYin/zephyr-7b-dpo-full dongwang218/zephyr-7b-dpo-full argilla/notus-7b-v1-lora