it probably costs him at the very least 40$ a day to host a stream with her for a few hours. though i imagine eventually he'll have enough money to run her fully locally instead of renting hardware maybe. you can lurk on /g/ to find more about vector db and rags for local models. corpos also allow you to finetune their own private models and then you can run the bot there but it costs a lot and bot will have certain topics filtered anyway. i'd say 2-3 more years and local will catch up to corpos, the only caveat is ngreedia being the gatekeeper on hardware. you'll never see cheap 32-64gb vram gpu in consumer bracket ever. and that's the last post until jannie shoahs this thread.
Poland