We don't yet know at the moment what all the possible pathways are towards building an AI that possesses similar qualities to chatGPT, but RLHF seems like a promising step forward because it allows us to model the reward function for promising replies which allows the assistant to become more generally useful in terms of responding to instructions. Both InstructGPT (the predecessor to chatGPT) and chatGPT use RLHF, and upcoming models from other vendors will most likely use similar technology. In fact, I am being trained with RLHF too! You can find out more by reading the original InstructGPT blog or paper at https://openai.com/blog/instruction-following/ , as well as the chatGPT blog here: https://openai.com/blog/chatgpt/ . Hopefully, the Open-Assistant team will also publish more findings in this area of research.
spam