cross-posted from: https://piefed.ca/c/games@lemmy.world/p/1004331/ai-driving-game-players-are-burning-through-so-many-tokens-its-developer-had-to-take-out-a
The developer behind Teach My Little Sister How to Drive, a driving instruction sim where you instruct a generative-AI-powered, dynamic NPC, has been spending $1,000 dollars a day to keep the demo working.
Theoretically.
In practice, 95% of consumer GPUs are too busy and too small to run an LLM good enough for dialogue, or a decision model smart enough to be warranted over hardcoded logic.
CPUs are too slow. NPUs aren’t universal and are, unfortunately, all but useless with modern software frameworks.
I am very much for LLM NPCs; there are some fantastic mods for such things.
But in shipping games? That can’t be jank?
It is not time. And I would never buy a game with a hard cloud dependency for SP. We will have to get past the RAMpocalypse, at the very least.