Blog, Articles, and discussions

Putting RL back in RLHF

By June 12, 2024 • 94

Community Articles

🤔👀🎬🖥️📖 Kimi-VL-A3B-Thinking-2506: A Quick Navigation

and 1 other •

Adaptive Classifier: Dynamic Text Classification with Continuous Learning

DeepSeek-R1 Dissection: Understanding PPO & GRPO Without Any Prior Reinforcement Learning Knowledge

Accelerating AI for Drug Discovery: Ginkgo’s GDPx Functional Genomics and GDPa Antibody Developability Dataset Series

and 1 other •

about 9 hours ago

Fine-tune Llama 3.1 Ultra-Efficiently with Unsloth

Code a simple RAG from scratch

💥 Building a Vulnerable Bank MCP — Then Automating an Agent to Hack It

and 2 others •

Uncensor any LLM with abliteration

Saying Thank You to a LLM Isn't Free — Measuring the Energy Cost of Politeness

and 2 others •

Whose Voice Do We Hear When AI Speaks?

🦸🏻#14: What Is MCP, and Why Is Everyone – Suddenly!– Talking About It?

Why Maybe We're Measuring LLM Compression Wrong

Mastering Tensor Dimensions in Transformers

The Large Language Model Course

KV Caching Explained: Optimizing Transformer Inference Efficiency

DO THEY SEE WHAT WE SEE?

The Common Pile v0.1

and 2 others •

Post-Training Isaac GR00T N1.5 for LeRobot SO-101 Arm

and 4 others •

Introducing Cosmos Predict-2: A Foundation For Your Own World Model

and 2 others •

Introduction to State Space Models (SSM)

Jack of All Trades, Master of Some, a Multi-Purpose Transformer Agent

By April 22, 2024 • 81

Constitutional AI with Open LLMs

By February 1, 2024 • 15

Preference Tuning LLMs with Direct Preference Optimization Methods

By January 18, 2024 • 66

The N Implementation Details of RLHF with PPO

By October 24, 2023 • 59

Finetune Stable Diffusion Models with DDPO via TRL

By September 29, 2023 guest • 16

Fine-tune Llama 2 with DPO

By August 8, 2023 • 54

StackLLaMA: A hands-on guide to train LLaMA with RLHF

By April 5, 2023 • 39

Fine-tuning 20B LLMs with RLHF on a 24GB consumer GPU

By March 9, 2023 • 56

Introducing ⚔️ AI vs. AI ⚔️ a deep reinforcement learning multi-agents competition system

By February 7, 2023 • 2

Illustrating Reinforcement Learning from Human Feedback (RLHF)

By December 9, 2022 • 285

Train your first Decision Transformer

By September 8, 2022 • 12

Proximal Policy Optimization (PPO)

By August 5, 2022 • 45

Advantage Actor Critic (A2C)

By July 22, 2022 • 5

Policy Gradient with PyTorch

By June 30, 2022

Community Articles

🤔👀🎬🖥️📖 Kimi-VL-A3B-Thinking-2506: A Quick Navigation

and 1 other •

Adaptive Classifier: Dynamic Text Classification with Continuous Learning

DeepSeek-R1 Dissection: Understanding PPO & GRPO Without Any Prior Reinforcement Learning Knowledge

Accelerating AI for Drug Discovery: Ginkgo’s GDPx Functional Genomics and GDPa Antibody Developability Dataset Series

and 1 other •

about 9 hours ago

Fine-tune Llama 3.1 Ultra-Efficiently with Unsloth

Code a simple RAG from scratch

💥 Building a Vulnerable Bank MCP — Then Automating an Agent to Hack It

and 2 others •

Uncensor any LLM with abliteration

Saying Thank You to a LLM Isn't Free — Measuring the Energy Cost of Politeness

and 2 others •

Whose Voice Do We Hear When AI Speaks?

🦸🏻#14: What Is MCP, and Why Is Everyone – Suddenly!– Talking About It?

Why Maybe We're Measuring LLM Compression Wrong

Mastering Tensor Dimensions in Transformers

The Large Language Model Course

KV Caching Explained: Optimizing Transformer Inference Efficiency

DO THEY SEE WHAT WE SEE?

The Common Pile v0.1

and 2 others •

Post-Training Isaac GR00T N1.5 for LeRobot SO-101 Arm

and 4 others •

Introducing Cosmos Predict-2: A Foundation For Your Own World Model

and 2 others •

Introduction to State Space Models (SSM)

View all