Chat GPT is a system by OpenAI that uses human feedback (RLHF) to align large language models (LLMs) with human intent. It allows users to interact with the LLM trained with RLHF but the model and data used are proprietary.

Open Assistant, a free, open-source alternative to Chat GPT, is being developed using crowdsourced RLHF. It offers the ability to run the model on one's own hardware, allowing for customization for specific tasks.
spam fails_task lang_mismatch pii not_appropriate hate_speech sexual_content quality toxicity humor helpfulness creativity violence