It takes effort to be an informed citizen. Artificial intelligence tools offer an alluring shortcut — but they’re not without risk.

  • unexposedhazard@discuss.tchncs.de
    link
    fedilink
    arrow-up
    4
    ·
    1 month ago

    This was a pretty obvious one imo. Anyone who didnt see this coming had their eyes closed. Outsourcing your thinking to a product that can be freely manipulated by the company providing it has always been the goal of these companies. The ministry of truth is finally here and people are even paying money to use it.

  • greybeard@feddit.online
    link
    fedilink
    English
    arrow-up
    2
    ·
    1 month ago

    Unfortunately, these days, marketing departments know this, and like most marketing, money wins. It used to be SEO, but now it is AIO. The goal is to write articles it knows will get sucked up by the AI training sets, setting the narrative the AI will repeat. Because the page aren’t meant to be consumed by humans, they can be long-winded, repetitive, and misleading.

    I have no doubt big political campaigns are doing the same thing.

    • quick_snail@feddit.nl
      link
      fedilink
      arrow-up
      2
      ·
      1 month ago

      Got a link on AIO?

      How is that different than just content marketing articles they’ve been writing for years for SEO?

  • lennybird@lemmy.world
    link
    fedilink
    English
    arrow-up
    2
    ·
    1 month ago

    Has anyone tested the prompts on these? I’m kind of wondering if truth having a leftist bias could help inform people against the right-wing propaganda.

    • volore@scribe.disroot.org
      link
      fedilink
      arrow-up
      1
      ·
      edit-2
      1 month ago

      since when do LLMs care about what is true or not? I must’ve missed that, we fixed the hallucination problem?

      also, rest assured, Grok has almost certainly been tweaked to say “whoever’s on the Republican ticket”, and probably most other big AI companies in the US who benefit from this administration will do the same, just less ham-fistedly and more subtly than Musk will. If flagship LLMs in general were to start giving ringing endorsements of leftists, I have zero doubt in my mind that would not be allowed to continue, not under the current regime.

      • lennybird@lemmy.world
        link
        fedilink
        English
        arrow-up
        0
        arrow-down
        1
        ·
        1 month ago

        But AI has a hallucination problem similar in the way every single human being in existence has an imperfect recollection hallucinatory problem. We have to distinguish accuracy from precision and take that with a grain of salt. I do wonder when the last time people here have used some of these later GPTs, because they absolutely have value and vast consensus of scientists agree.

        How one regulates it, is of course another story that I agree with you on. I’ve already used AI successfully to combat far-right trolls though.

    • Bristlecone@lemmy.world
      link
      fedilink
      arrow-up
      1
      ·
      1 month ago

      We can hope that, but their responses rely entirely on where they pull their information from, and I lost all hope that they were actually factual when they turned grok into Mecha Hitler!

    • 4am@lemmy.zip
      link
      fedilink
      arrow-up
      0
      ·
      1 month ago

      Models don’t “care” about “truths”, they are about the average likelyhood that the next word is correct based on the previous x words based on the data they were trained on, which was mostly internet posting.

      Their output can also be manipulated by adding “system prompts” so that the user’s question isn’t the only thing being input.

      ChatGPT doesn’t think, it doesn’t “reason”, it doesn’t know what is true, it doesn’t “feel” “integrity”. It regurgitates Wikipedia articles against the biases of 4chan and Reddit posts and tries to sell that diarrhea as bowls of soup.

      Personally I’m to the point where I understand gulags now. Like, why would they need that? Why would they do something that seems so intentionally cruel and forceful and then read shit like this and I go “oh, oh yeah. I get it now. Yeah some people belong there.”

      • CharlesDarwin@lemmy.world
        link
        fedilink
        English
        arrow-up
        1
        ·
        1 month ago

        Personally I’m to the point where I understand gulags now. Like, why would they need that? Why would they do something that seems so intentionally cruel and forceful and then read shit like this and I go “oh, oh yeah. I get it now. Yeah some people belong there.”

        I very much doubt the kind of people that most need to be in things like gulags end up in them…

  • CharlesDarwin@lemmy.world
    link
    fedilink
    English
    arrow-up
    2
    ·
    1 month ago

    Well, that’s what they were doing, more or less, when it came to letting platforms like Facebook and Youtube tell them what to think…