Self host an open model, but yeah 20 a month is not that expensive for what you can do with it.
But that’s not what anyone in this thread is saying, they’re saying LLM code bad and stealing so let’s poison open source projects. Also sharing code is bad now, when I’m sure many of these people would claim they like open source code.
Again, I think knowledge and code should be free for all to use so that we all benefit from it.
“self host an open model”. My dude, you need pretty beefy hardware to run a slow and shit model that won’t even compare to the 0.33x models you get with a copilot subscription.
Its getting better all the time, its crazy how much better consumer level hardware can run competent models (even if it’s lower params) these days compared to just 6 months ago.
I figured you wouldn’t be able to look past your own personal experience. I’m sorry to say that most people outside your bubble cannot afford either the subscription nor the hardware to run usable LLMs locally.
“Sharing code is bad now” because a handful of companies scraped it and not only they haven’t given anything back, they are reselling it in different shapes, and telling people that now all that data is proprietary. So, yes, stolen is an apt word for it.
Anyway, all this talk about “democratizing” knowledge is bullshit. Libraries democratized knowledge. The internet democratized knowledge. Anyone can learn how to code if they put the time and read a book and practice.
But delegated thinking is the opposite of acquiring knowledge, so what the hell are you people yapping about.
You don’t have to delegate thinking, I’m sure many people will but it’s absolutely not a requirement for using LLMs as the intended tool they are.
On the topic of price, I’m sure people were saying the same things about books (oh must be nice you can afford books), then the same about computers and the internet. They eventually became more affordable.
Not even going to touch the “I couldn’t understand economic heardship” aspect.
You are betting on massive corporations having a change of heart and putting all their resources at the disposition of the public, for essentially free. Otherwise, AI will never be affordable in the sense that everyone could have free access to models that matter.
And I know that you said that self hosting is a possibility. But let’s be real here: public weight models are available because they pose no risk to the bottom line of the companies training them. There are zero competitive models trained by a non profit. But even if that wasn’t true, the current DRAM shortage is proof that these companies will never allow anyone to match them. Same goes for electricity and water.
Honestly, after all these years of witnessing big tech shitting all over us, I cannot understand where all these hopes come from. Would be endearing if it wasn’t so reckless.
I’m just showing that as technology progresses and scales it generally becomes cheaper and peoples access increases, again were literally on the internet now and have phones in our pockets that can do it, whereas 40 years ago PCs were much more expensive and internet was slow as hell.
We shouldn’t trust big tech, I’m on Lemmy so that should be a bit of a given lol.
I’m just showing that as technology progresses and scales it generally becomes cheaper and peoples access increases, again were literally on the internet now and have phones in our pockets that can do it, whereas 40 years ago PCs were much more expensive and internet was slow as hell.
Even if LLMs were free to download and use, who is going to subsidize training and fine tuning, when it takes hundreds of millions of dollars? Also, LLMs are software, not hardware. If there’s anything that we know about software is that it doesn’t become faster with time, quite the opposite.
The thing I don’t understand is that people believe the BS when all this is out there in the clear. Massive corporations open source models that pose no risk to their bottom line, then they spend millions of dollars to market their newest and latest, rinse and repeat, all fuelled by debt. Thus, self hosting will never catch up, and when the money dries up, there will be zero incentive to make more advanced models more affordable. In fact, since most of the time model improvements scale following training and hardware expenditure, they will become more expensive.
We shouldn’t trust big tech, I’m on Lemmy so that should be a bit of a given lol.
Is it though?
Like here you are, telling me that an example of “technology progress” is that “were literally on the internet now and have phones in our pockets that can do it, whereas 40 years ago PCs were much more expensive and internet was slow as hell”, when the phone market is effectively controlled by two companies, Apple and Google. Now imagine the same landscape with LLMs.
You are missing the most important questions here: who can afford it, and who owns it.
It’s easy to be pro LLM when $20 a month is not a big deal.
Self host an open model, but yeah 20 a month is not that expensive for what you can do with it.
But that’s not what anyone in this thread is saying, they’re saying LLM code bad and stealing so let’s poison open source projects. Also sharing code is bad now, when I’m sure many of these people would claim they like open source code.
Again, I think knowledge and code should be free for all to use so that we all benefit from it.
“self host an open model”. My dude, you need pretty beefy hardware to run a slow and shit model that won’t even compare to the 0.33x models you get with a copilot subscription.
Its getting better all the time, its crazy how much better consumer level hardware can run competent models (even if it’s lower params) these days compared to just 6 months ago.
I figured you wouldn’t be able to look past your own personal experience. I’m sorry to say that most people outside your bubble cannot afford either the subscription nor the hardware to run usable LLMs locally.
“Sharing code is bad now” because a handful of companies scraped it and not only they haven’t given anything back, they are reselling it in different shapes, and telling people that now all that data is proprietary. So, yes, stolen is an apt word for it.
Anyway, all this talk about “democratizing” knowledge is bullshit. Libraries democratized knowledge. The internet democratized knowledge. Anyone can learn how to code if they put the time and read a book and practice.
But delegated thinking is the opposite of acquiring knowledge, so what the hell are you people yapping about.
You don’t have to delegate thinking, I’m sure many people will but it’s absolutely not a requirement for using LLMs as the intended tool they are.
On the topic of price, I’m sure people were saying the same things about books (oh must be nice you can afford books), then the same about computers and the internet. They eventually became more affordable.
Not even going to touch the “I couldn’t understand economic heardship” aspect.
You are betting on massive corporations having a change of heart and putting all their resources at the disposition of the public, for essentially free. Otherwise, AI will never be affordable in the sense that everyone could have free access to models that matter.
And I know that you said that self hosting is a possibility. But let’s be real here: public weight models are available because they pose no risk to the bottom line of the companies training them. There are zero competitive models trained by a non profit. But even if that wasn’t true, the current DRAM shortage is proof that these companies will never allow anyone to match them. Same goes for electricity and water.
Honestly, after all these years of witnessing big tech shitting all over us, I cannot understand where all these hopes come from. Would be endearing if it wasn’t so reckless.
I’m just showing that as technology progresses and scales it generally becomes cheaper and peoples access increases, again were literally on the internet now and have phones in our pockets that can do it, whereas 40 years ago PCs were much more expensive and internet was slow as hell.
We shouldn’t trust big tech, I’m on Lemmy so that should be a bit of a given lol.
Even if LLMs were free to download and use, who is going to subsidize training and fine tuning, when it takes hundreds of millions of dollars? Also, LLMs are software, not hardware. If there’s anything that we know about software is that it doesn’t become faster with time, quite the opposite.
The thing I don’t understand is that people believe the BS when all this is out there in the clear. Massive corporations open source models that pose no risk to their bottom line, then they spend millions of dollars to market their newest and latest, rinse and repeat, all fuelled by debt. Thus, self hosting will never catch up, and when the money dries up, there will be zero incentive to make more advanced models more affordable. In fact, since most of the time model improvements scale following training and hardware expenditure, they will become more expensive.
Is it though?
Like here you are, telling me that an example of “technology progress” is that “were literally on the internet now and have phones in our pockets that can do it, whereas 40 years ago PCs were much more expensive and internet was slow as hell”, when the phone market is effectively controlled by two companies, Apple and Google. Now imagine the same landscape with LLMs.