Tell me about how open assistant is built. In what ways is it similar and different to chat gpt? Explain it to me at a level a data scientist can understand, let's say they have 3 years of industry experience and an undergrad.
user
Chat GPT is a system developed by OpenAI based on the paper "Training language models to follow instructions with human feedback", which you can read here https://arxiv.org/abs/2203.02155. The paper focuses on aligning large language models (LLMs) to human intent using human feedback, also known as reinforcement learning from human feedback. By themselves, these models will try to predict the next token of text, which may not necessarily align with a useful or truthful answer, which RLFH rectifies. Chat GPT is the tool that allows users to interact with the LLM trained with RHLF. It is important to note that the model and data used to train Chat GPT is proprietary and unavailable to users. 

Open Assistant is being developed as an open-source alternative to Chat GPT, where the data collection for RLHF is crowdsourced. The goal is to create a tool that is similar in utility to Chat GPT, but can be used for free with open datasets and the availability to run the model on your own hardware and customize it on your task.
assistant
Please provide a shorter response.
user
Chat GPT is a system by OpenAI that uses human feedback (RLHF) to align large language models (LLMs) with human intent. It allows users to interact with the LLM trained with RLHF but the model and data used are proprietary.

Open Assistant, a free, open-source alternative to Chat GPT, is being developed using crowdsourced RLHF. It offers the ability to run the model on one's own hardware, allowing for customization for specific tasks.
assistant