Ask HN: Are ML models like ChatGPT just compressing/decompressing information?
Disclaimer: I don&#x27;t really understand how these magical AI models do their thing but, like almost everyone else I&#x27;ve been playing around with ChatGPT and I&#x27;m totally blown away by it.<p>It seems like every time I submit a question to chatGPT, I imagine some fancy math is being done behind the scenes and I am getting fed back some information from this massive model &quot;file&quot;.<p>Is the model just a compressed representation of all the training data that the model was trained on and so sending back a response is just &#x27;decompressing&#x27; the part of the model that is relevant to my question and sending me back the requested information? (I imagine it hallucinates the parts that vary from the data it was trained on to give a best-guess response to my query).<p>Wonder if there are any experts on here that could confirm&#x2F;deny my intuitive guess here.