Edit Models filters

HuggingFaceH4/ultrafeedback_binarized

HuggingFaceH4/ultrachat_200k

bigcode/starcoderdata

cerebras/SlimPajama-627B

HuggingFaceH4/cai-conversation-harmless

meta-math/MetaMathQA

allenai/tulu-v2-sft-mixture

Intel/orca_dpo_pairs

HuggingFaceH4/orca_dpo_pairs

jondurbin/gutenberg-dpo-v0.1

Open-Orca/SlimOrca-Dedup

Open-Orca/OpenOrca

NewEden/OpenCAI-ShareGPT

NewEden/Roleplay-Logs-Sharegpt-Ngram-cleaned

argilla/distilabel-math-preference-dpo

HuggingFaceH4/deita-10k-v0-sft

pints-ai/Expository-Prose-V1

togethercomputer/llama-instruct

OpenAssistant/oasst2

HuggingFaceTB/smoltalk

argilla/distilabel-intel-orca-dpo-pairs

zake7749/kyara-chinese-preference-rl-dpo-s0-30K

BAAI/Infinity-Instruct

EleutherAI/proof-pile-2

JeanKaddour/minipile

OEvortex/vortex-mini

PKU-Alignment/PKU-SafeRLHF

argilla/OpenHermesPreferences

fblgit/tree-of-knowledge

jondurbin/py-dpo-v0.1

mattymchen/refinedweb-3m

pszemraj/simple_wikipedia_LM

teknium/OpenHermes-2.5

teknium/openhermes

yahma/alpaca-cleaned

fka/awesome-chatgpt-prompts

Anthropic/hh-rlhf

BramVanroy/dolly-15k-dutch

CohereForAI/aya_dataset

HuggingFaceH4/no_robots

Open-Orca/SlimOrca

THUDM/AgentInstruct

allenai/MADLAD-400

anon8231489123/ShareGPT_Vicuna_unfiltered

databricks/databricks-dolly-15k

euclaise/reddit-instruct-curated

hkust-nlp/deita-10k-v0

openbmb/UltraFeedback

snorkelai/Snorkel-Mistral-PairRM-DPO-Dataset

stingning/ultrachat

togethercomputer/RedPajama-Data-V2

wikimedia/wikipedia

Datasets with no match

mozilla-foundation/common_voice_11_0

mozilla-foundation/common_voice_7_0

microsoft/orca-math-word-problems-200k

cis-lmu/Glot500

m-a-p/CodeFeedback-Filtered-Instruction

cognitivecomputations/dolphin-coder

cognitivecomputations/samantha-data

oscar-corpus/OSCAR-2109

kiranpantha/dataset-for-peft-cv-nepds

TIGER-Lab/MathInstruct

garage-bAInd/Open-Platypus

legacy-datasets/wikipedia

jondurbin/truthy-dpo-v0.1

mozilla-foundation/common_voice_13_0

OpenAssistant/oasst1

anthracite-org/kalo-opus-instruct-22k-no-refusal

EleutherAI/pile

jondurbin/airoboros-2.2.1

lmsys/lmsys-chat-1m

tiiuae/falcon-refinedweb

allenai/ultrafeedback_binarized_cleaned

jondurbin/airoboros-3.2

facebook/voxpopuli

AI-MO/NuminaMath-CoT

m-a-p/Code-Feedback

AI-MO/NuminaMath-TIR

togethercomputer/RedPajama-Data-1T

migtissera/Synthia-v1.3

mozilla-foundation/common_voice_17_0

Gryphe/Sonnet3.5-Charcard-Roleplay

open-r1/OpenR1-Math-220k

cognitivecomputations/Dolphin-2.9

ise-uiuc/Magicoder-Evol-Instruct-110K

Epiculous/Synthstruct-Gens-v1.1-Filtered-n-Cleaned

nothingiisreal/Reddit-Dirty-And-WritingPrompts

HuggingFaceFW/fineweb

Epiculous/SynthRP-Gens-v1.1-Filtered-n-Cleaned

internlm/Agent-FLAN

Locutusque/function-calling-chatml

microsoft/orca-agentinstruct-1M-v1

Vezora/Tested-22k-Python-Alpaca

allenai/tulu-3-sft-mixture

nvidia/HelpSteer

Gryphe/Sonnet3.5-SlimOrcaDedupCleaned

jondurbin/cinematika-v0.1

tatsu-lab/alpaca

codeparrot/apps

NousResearch/hermes-function-calling-v1

glaiveai/glaive-function-calling-v2

anthracite-org/nopm_claude_writing_fixed

OpenCoder-LLM/opc-sft-stage1

mlabonne/orpo-dpo-mix-40k

argilla/dpo-mix-7k

HuggingFaceFW/fineweb-edu

Muennighoff/natural-instructions

nbeerbower/gutenberg2-dpo

unalignment/toxic-dpo-v0.2

mozilla-foundation/common_voice_8_0

Nopm/Opus_WritingStruct

OpenCoder-LLM/opc-sft-stage2

ise-uiuc/Magicoder-OSS-Instruct-75K

huggan/smithsonian_butterflies_subset

camel-ai/biology

camel-ai/physics

facebook/belebele

allura-org/Celeste-1.x-data-mixture

camel-ai/chemistry

Gryphe/ChatGPT-4o-Writing-Prompts

open-thoughts/OpenThoughts-114k

nvidia/HelpSteer2

kingbri/PIPPA-shareGPT

grimulkan/LimaRP-augmented

OpenAssistant/oasst_top1_2023-08-25

FreedomIntelligence/medical-o1-reasoning-SFT

netcat420/MFANN

trl-lib/ultrafeedback_binarized

HuggingFaceTB/cosmopedia

openchat/openchat_sharegpt4_dataset

unalignment/toxic-dpo-v0.1

glaiveai/glaive-code-assistant-v3

Models

1,208

Full-text search

Active filters: HuggingFaceH4/ultrafeedback_binarized

werty1248/Mistral-Nemo-NT-Ko-12B-dpo

Updated Sep 22, 2024 • 1.76k • 3

ssmits/Zamba2-1.2B-instruct-Dutch

Text Generation • Updated Nov 3, 2024 • 21 • 1

sapienzanlp/Minerva-7B-instruct-v1.0

Text Generation • Updated Dec 5, 2024 • 6.81k • 15

mradermacher/tulu-2-dpo-70b-GGUF

Updated Dec 5, 2024 • 97 • 1

SmallDoge/Doge-20M-Instruct

Question Answering • Updated 26 days ago • 6.22k • 4

Delta-Vector/Control-Nanuq-8B

Updated Feb 6 • 365 • 5

mradermacher/SambaLingo-Russian-Chat-i1-GGUF

Updated Dec 21, 2024 • 536 • 1

Delta-Vector/Control-Nanuq-8B-GGUF

Updated Dec 31, 2024 • 343 • 1

mradermacher/Control-Nanuq-8B-GGUF

Updated Dec 22, 2024 • 367 • 4

mradermacher/Control-Nanuq-8B-i1-GGUF

Updated Dec 22, 2024 • 495 • 2

punchnox/Tinnyllama-1.1B-rk3588-rkllm-1.1.4

Updated Jan 8 • 23 • 1

mradermacher/lambda-qwen2.5-14b-dpo-test-i1-GGUF

Updated Jan 24 • 835 • 1

tianyil1/MistralForCausalLM_Cal_DPO

Updated Feb 5 • 19 • 1

RTO-RL/Llama3-8B-RDPO

Updated Feb 11 • 15 • 1

RTO-RL/Llama3-8B-TDPO

Updated Feb 11 • 12 • 1

mradermacher/Mistral-Nemo-NT-Ko-12B-dpo-GGUF

Updated Feb 11 • 742 • 1

glorgao/SelectiveDPO-Qwen2.5-7B-SFT-UFBinarized

Text Generation • Updated Feb 13 • 29 • 1

mradermacher/Llama3-8B-RDPO-GGUF

Updated Feb 11 • 118 • 1

mradermacher/Llama3-8B-TDPO-GGUF

Updated Feb 11 • 19 • 1

mradermacher/Mistral-Nemo-NT-Ko-12B-dpo-i1-GGUF

Updated Feb 12 • 3.32k • 1

SmallDoge/Doge-160M-Instruct

Question Answering • Updated 26 days ago • 40k • 11

Vision-CAIR/BFPO-Mistral-7b-v0.1

Text Generation • Updated 14 days ago • 67 • 1

mradermacher/Llama-3-Base-8B-DICE-Iter1-GGUF

Updated 14 days ago • 455 • 1

mradermacher/Llama-3-Base-8B-DICE-Iter2-GGUF

Updated 13 days ago • 288 • 1

mradermacher/Zephyr-7B-DICE-Iter2-GGUF

Updated 14 days ago • 187 • 1

mradermacher/BFPO-Mistral-7b-v0.1-GGUF

Updated 14 days ago • 212 • 1

mradermacher/Llama-3-Base-8B-DICE-Iter1-i1-GGUF

Updated 14 days ago • 578 • 1

mradermacher/BFPO-Mistral-7b-v0.1-i1-GGUF

Updated 14 days ago • 388 • 1

mradermacher/Llama-3-Base-8B-DICE-Iter2-i1-GGUF

Updated 13 days ago • 567 • 1

mradermacher/lambda-llama-3-8b-ipo-test-GGUF

Updated 11 days ago • 277 • 1