• ayyy@sh.itjust.works
    link
    fedilink
    English
    arrow-up
    4
    ·
    15 days ago

    And what if tech oligarchs weren’t evil and used this new technology to make lives better instead of concentrating capital? We don’t have that either so there’s no use speculating.

    Snark aside, I think you’re underestimating just how much data it takes to make these models work. There is no such thing as enough “private” data for training.

    • Skullgrid@lemmy.world
      link
      fedilink
      English
      arrow-up
      3
      ·
      15 days ago

      There is no such thing as enough “private” data for training.

      what the fuck are you on about? You can build local datasets and train additional LORAs locally to have more relevant outputs, and it doesn’t go back to the creators of the original weights.

      • ayyy@sh.itjust.works
        link
        fedilink
        English
        arrow-up
        1
        ·
        15 days ago

        You are describing fine tuning, no? Which still requires a base model that was trained on a massive amount of other data.