• ReallyActuallyFrankenstein@lemmynsfw.com
    link
    fedilink
    English
    arrow-up
    28
    ·
    1 year ago

    ControlNet uses the AI image-generating tool Stable Diffusion, and one of its initial uses was generating fancy QR codes using the code as an input image. That idea was then taken further, with some users developing a workflow that lets them specify any image or text as a black-and-white mask that implants itself into the generated image—kind of like an automated, generative version of the masking tool in Photoshop.

    “What happened there was that this user discovered that if they used the QR Code ControlNet but instead of feeding it a QR code, they fed it some other black-and-white patterns, they could create nice optical illusions,” said Passos. “You can now send a conditioning image and the model blends in a pattern that satisfies that while still making a coherent image at the same time.”

    Which is…just ControlNet?

    • Borimino@feddit.dk
      link
      fedilink
      English
      arrow-up
      19
      ·
      1 year ago

      Yes, the article explains what Control Net is for those of us who haven’t heard of it before. And the article says that Control Net was (apparently) initially meant to be used for qr codes.

      • ReallyActuallyFrankenstein@lemmynsfw.com
        link
        fedilink
        English
        arrow-up
        12
        ·
        1 year ago

        Sorry to be indirect - ControlNet is a Stable Diffusion tool that generally allows for generating images with input control frames. The QR code use-case was a single potential use that went viral.

        I was just eye-rolling a bit over the expert in the article also not understanding what ControlNet is, since it’s propagating an incorrect history.