I bought a datacenter GPU that doesn't fit in a normal motherboard, macgyvered the fan with jumper wires, and now I'm running a model that ties with Claude Sonnet 4.6 on benchmarks, all for £200.
You are mistaken. Power consumption is lower because the VRAM is what’s primarily being utilized, not the GPU. Not only that, but GPU & VRAM are used non-stop while gaming, but only intermittently while performing LLM inference. And it’s asynchronous, only processing when replying, while the rest of the time it’s idle, while waiting for the next prompt. Gaming uses a LOT more electricity than local LLM usage.
If you’re going to count the processes that had to occur prior to the current usage, then gaming uses a magnitude more electricity because of all the electricity of the developers who made the game, and the artists, and the sound designers, and the composers, and the compilers, etc.
Let’s just leave it at both use substantial energy, and both are difficult to justify. I still personally love and will use both, as a game developer with a focus on novel AI usage in games.
The temperature my computer room gets to when gaming vs using a local model says otherwise. I’ll gladly plug in a measuring tool and show you the data if you want.
That depends entirely on the hardware, the game, the model, and the prompt. I’m sure you could find a combination where the LLM power usage is higher than the game, just as I could do the opposite. The point is, they both use power, but only one of them is disparaged.
You are mistaken. Power consumption is lower because the VRAM is what’s primarily being utilized, not the GPU. Not only that, but GPU & VRAM are used non-stop while gaming, but only intermittently while performing LLM inference. And it’s asynchronous, only processing when replying, while the rest of the time it’s idle, while waiting for the next prompt. Gaming uses a LOT more electricity than local LLM usage.
If you’re going to count the processes that had to occur prior to the current usage, then gaming uses a magnitude more electricity because of all the electricity of the developers who made the game, and the artists, and the sound designers, and the composers, and the compilers, etc.
Let’s just leave it at both use substantial energy, and both are difficult to justify. I still personally love and will use both, as a game developer with a focus on novel AI usage in games.
The temperature my computer room gets to when gaming vs using a local model says otherwise. I’ll gladly plug in a measuring tool and show you the data if you want.
That depends entirely on the hardware, the game, the model, and the prompt. I’m sure you could find a combination where the LLM power usage is higher than the game, just as I could do the opposite. The point is, they both use power, but only one of them is disparaged.