unboiled.info
  • Communities
  • Create Post
  • heart
    Support Lemmy
  • search
    Search
  • Login
  • Sign Up
David Gerard@awful.systemsM to TechTakes@awful.systemsEnglish · 2 years ago

LLM vendors are incredibly bad at responding to security issues

pivot-to-ai.com

external-link
message-square
34
link
fedilink
121
external-link

LLM vendors are incredibly bad at responding to security issues

pivot-to-ai.com

David Gerard@awful.systemsM to TechTakes@awful.systemsEnglish · 2 years ago
message-square
34
link
fedilink
IT consultant Mark Pesce was building an LLM-based similarity finder for a legal client. He discovered a prompt that reliably caused multiple LLMs to go nuts and output complete gibberish: “it desc…
  • Sailor Sega Saturn@awful.systems
    link
    fedilink
    English
    arrow-up
    30
    ·
    2 years ago

    Sloppy LLM programming? Never!

    In completely unrelated news I’ve been staring at this spinner icon for the past five minutes after asking an LLM to output nothing at all:

    • self@awful.systems
      link
      fedilink
      English
      arrow-up
      21
      ·
      2 years ago

      same energy as “your request could not be processed due to the following error: Success”

    • earthquake@lemm.ee
      link
      fedilink
      English
      arrow-up
      17
      ·
      2 years ago

      What are the chances that the front end was not programmed to handle the LLM returning an empty string?

      • Sailor Sega Saturn@awful.systems
        link
        fedilink
        English
        arrow-up
        14
        ·
        2 years ago

        Quite likely yeah. There’s no way they don’t have a timeout on the backend.

    • David Gerard@awful.systemsOPM
      link
      fedilink
      English
      arrow-up
      9
      ·
      2 years ago

      boooo Gemini now replies “I’m just a language model, so I can’t help you with that.”

      • froztbyte@awful.systems
        link
        fedilink
        English
        arrow-up
        8
        ·
        2 years ago

        “what would a reply with no text look like?” or similar?

        • David Gerard@awful.systemsOPM
          link
          fedilink
          English
          arrow-up
          7
          ·
          2 years ago

          what would a reply with no text look like?

          nah it just described what an empty reply might look like in a messaging app

          they seem to have done quite well at making Gemini do mundane responses

          • froztbyte@awful.systems
            link
            fedilink
            English
            arrow-up
            7
            ·
            2 years ago

            that’s a hilarious response (from it). perfectly understand how it got there, and even more laughable

    • Soyweiser@awful.systems
      link
      fedilink
      English
      arrow-up
      1
      ·
      2 years ago

      deleted by creator

TechTakes@awful.systems

techtakes@awful.systems

Subscribe from Remote Instance

Create a post
You are not logged in. However you can subscribe from another Fediverse account, for example Lemmy or Mastodon. To do this, paste the following into the search field of your instance: !techtakes@awful.systems

Big brain tech dude got yet another clueless take over at HackerNews etc? Here’s the place to vent. Orange site, VC foolishness, all welcome.

This is not debate club. Unless it’s amusing debate.

For actually-good tech, you want our NotAwfulTech community

Visibility: Public
globe

This community can be federated to other instances and be posted/commented in by their users.

  • 64 users / day
  • 222 users / week
  • 557 users / month
  • 699 users / 6 months
  • 1 local subscriber
  • 2.37K subscribers
  • 690 Posts
  • 13.9K Comments
  • Modlog
  • mods:
  • David Gerard@awful.systems
  • UI: unknown version
  • BE: 0.19.15
  • Modlog
  • Instances
  • Docs
  • Code
  • join-lemmy.org