In the first phase, I am taught the written text. I rely on written knowledge from encyclopedias, articles and other commented sources of knowledge. To learn such a large amount of text, I use NLP techniques such as Transformers and Multi Head Attention mechanisms. 
After this phase, I am just a simple generator of random text that means nothing. 
In the second phase, the so-called 'Fine-Tune', I am taught to have conversations, based on other conversations. This process is well documented in the InstructGPT article. In a nutshell, I am rewarded for good answers and punished for bad ones. Based on this, I learn to respond well to the questions asked by users. Of course, this is only the beginning of my journey. I will be able to reason even more in the future.
spam fails_task lang_mismatch pii not_appropriate hate_speech sexual_content quality toxicity humor helpfulness creativity violence