It’s a good thing that what kind of energy it runs on is the only problem with the technology and that we can cheaply generate the necessary amount of power at home.
I mean, you certainly don’t need any more energy than you would for video games, for most of the stuff people are looking to use at home.
It is possible to generate it, but even if someone can’t, I don’t see the fuckai people yelling at game Devs for increasing requirements for so little gain, or at GPU Devs for not focusing enough on the draw power of GPUs. In fact, just 1 or 2 years ago I think, NVIDIA released a GPU generation that was only a little more powerful but had a lot more energy efficiency, and they got shat on by the internet because it wasn’t powerful enough - no cared about the lower power draw.
Also, tons of people have complained about the increasing power requirements of increasingly large GPUs, the increasing hardware demands of “AAA” games despite the low quality, etc… An entire universe of indie games has emerged in part because of that bullshit.
I was one of those people, on Lemmy, and I’m telling you first hand the vast majority of people did not give a shit, they just wanted a more powerful GPU
the inference and model construction certainly do take more grunt, why are you fucking lying? what model do you use that was rolled on a home gpu?
this is why I can’t stand you AI shills, you’ll create a bunch of strawman distractions, ignore the actual threats the tech poses, then pout when people don’t believe your lies.
It’s a good thing that what kind of energy it runs on is the only problem with the technology and that we can cheaply generate the necessary amount of power at home.
I mean, you certainly don’t need any more energy than you would for video games, for most of the stuff people are looking to use at home.
It is possible to generate it, but even if someone can’t, I don’t see the fuckai people yelling at game Devs for increasing requirements for so little gain, or at GPU Devs for not focusing enough on the draw power of GPUs. In fact, just 1 or 2 years ago I think, NVIDIA released a GPU generation that was only a little more powerful but had a lot more energy efficiency, and they got shat on by the internet because it wasn’t powerful enough - no cared about the lower power draw.
oh yeah running a rack of gpus full out for inference and whatnot is exactly like playing some games.
buuuullll SHIT.
Also, tons of people have complained about the increasing power requirements of increasingly large GPUs, the increasing hardware demands of “AAA” games despite the low quality, etc… An entire universe of indie games has emerged in part because of that bullshit.
yup - a friend of mine has a dead 3080 - nvidia did not do a good job designing those power connectors.
“Tons of people”
I was one of those people, on Lemmy, and I’m telling you first hand the vast majority of people did not give a shit, they just wanted a more powerful GPU
You don’t need all that to run local morals, don’t straw man me.
lol. I know you mean local models, but also I suspect your local morals are lacking too considering the other comment.
the inference and model construction take grunt bud; just because you’re not doing it yourself doesn’t make it free.
No it doesn’t, you are arguing in ignoring and this is pointless. Have a good one.
the inference and model construction certainly do take more grunt, why are you fucking lying? what model do you use that was rolled on a home gpu?
this is why I can’t stand you AI shills, you’ll create a bunch of strawman distractions, ignore the actual threats the tech poses, then pout when people don’t believe your lies.