No? If everyone who uses LLMs globally switched over to a local LLM (after buying the necessary hardware), that’d still be a crazy amount of energy usage, just less centralised.
What I’m saying is that not all local LLMs are more power efficient, and that we are currently massively over-using the technology for things it isn’t all that useful for.
No? If everyone who uses LLMs globally switched over to a local LLM (after buying the necessary hardware), that’d still be a crazy amount of energy usage, just less centralised.
More energy actually.
nah like using the current Gaming PC/Laptop you have, Like Intel CPU + intergrated graphics or smth.
I suppose, but that’s a very different class of model. I think a more important question might be whether people actually need LLMs at all.
this is personal preference ig.
What I’m saying is that not all local LLMs are more power efficient, and that we are currently massively over-using the technology for things it isn’t all that useful for.
i see