yea but the context window is 32k "tokens", which isn't a single character, but words or semi-words, so it's like 100k more characters overall or more. niggers = 1 token = 7 characters   not really, it helps them by opening up the market. the common saying in the tech industry is "be the last person to do it well" (like yahoo/myspace vs facebook vs the next thing etc). here's an actual example that happened: transformer paper comes out (google). no one gives a fuck but sutskever and co. chatgpt 2 comes out. oh shit moment, and at the same time, minimal actual interest. chatgpt 3 comes out. oh shit oh fuck shit's amazing. chatgpt 4 comes out, it's crazy good, sputnik moment. google improves the context window to 2m tokens anthropic reaches similar performance, makes models 10 times cheaper. facebook trains better models and makes them open source and much much cheaper openai o1 comes out, is op deepseek reverse engineers the rl ideas behind the finetuning, uses facebook as a base model r1 is almost as good as o1 or whatever. fb and anthropic and deepseek and co have an incentive to undercut the market and disrupt however they can you see it's not about you getting value, it's about leveling the playing field. if your enemy sells some op rockets, you want to either sell the same rockets for cheaper (or better), or everyone has rockets, so now the enemy lost all the money they spend researching their rockets and can't sell shit. if you spend a fraction of the cost reverse engineering the rocket tech, you win. that's what deepseek did with r1. openai spend billions, deepseek pennies. and the consumers benefit.
Greece