Both ChatGPT and InstructGPT are Transformer-based generative text models created by OpenAI. However, while ChatGPT was released in early 2023, InstructGPT is a year older. Both models were trained using Reinforcement Learning with Human Feedback (RLHF) to improve their capabilities in specific task categories. InstructGPT was trained to follow instructions provided by the user, and served as a predecessor to ChatGPT. ChatGPT was trained to be a more general chatbot with a wider range of capabilities, ranging from following instructions to do tasks to answering questions, holding conversations, and telling jokes.
spam fails_task lang_mismatch pii not_appropriate hate_speech sexual_content quality toxicity humor helpfulness creativity violence