• 18 Posts
  • 528 Comments
Joined 2 years ago
cake
Cake day: March 22nd, 2024

help-circle


  • …Okay. Technically, that’s true, going by strict semantics.

    But the Helium and Ungoogled Chromium are going to lose MV2, soon. I feel like “still supports uBlock Origin” doesn’t sufficiently convey that to Lemmy commenters trying to read the situation. That’s all I meant, though I was perhaps imprecise with my words.

    In other words, practically, if a users want to use UBO, they should know these browsers will not support that in the near future even if, strictly speaking, they support it right this second.


    I believe this means Brave will lose support too, unless they intend to extensively modify Chromium to maintain compatibility themselves (which would be odd, as Brave doesn’t really need UBO since it has its own adblocking engine?)








  • Okay.

    I don’t agree. But let’s say I agree.

    …Just don’t use Claude?

    Use an LLM without a watermark; there are hundreds to pick from.


    In other words, if one is going to try to hide automated writing, I think there should be a bare minimum effort to do so. That includes:

    • Reading/checking the text, to see if it makes any sense.

    • Actually trying to pass it as human.

    90% of slop is brain melting slop because this minimum bar isn’t even met. And all Claude’s watermark would do is catch that bottom of the barrel; it wouldn’t censor anyone.





  • I know exactly how it works. I read the article, and I knew of it beforehand, hence I explained it to someone else in a comment three days ago:

    https://lemmy.world/post/50533770/25234461


    I’m sorry to jab back, but you hit a button of mine.

    Lemmy commenters keep jabbing me with comments like “Clueless. Read the article and get back to me.”

    Like yesterday:

    https://lemmy.world/post/50595546/25269317

    But I’m aware of how sampling works. I knew all about LLM fingerprinting ~two years ago, and I’ve been tinkering with samplers myself for years. I’ve messed with local LLMs trying to make them “aware” of their own sampling many times, and even hacked out a (unsuccessful) experiment where a tiny LLM picks tokens for a larger one.

    I’m not trying to be pretentious, I’m not a researcher or expert or anything, but you shouldn’t assume everyone on Lemmy is clueless.


    And back on topic… to be clear, I have tried what you are proposing, and even with local LLMs I have more control over, it doesn’t work. They have extremely poor “awareness” of their own logit spread and tokenization, which is why they perform so poorly on any tasks that depends on that.

    You can’t tell them “don’t pick the top word” or “give more options in your logit spread” because that part of the process is completely invisible, from their perspective.




  • The dev comments say a lot:

    https://old.reddit.com/user/paintboth1234

    No one helping the project ever said “uBO is living on a secluded isle”. It’s a public community FOSS project, for over a decade, monitored and contributed by every user and volunteer. Every site has been watching uBO for years. It’s not new. And yes, if users do nothing to help, either on helping uBO’s side or leaving the trash sites, and just give snarky comments instead, this will happen.

    The message is clear to me; UBO devs are sick of a sick of a sea of users constantly complaining about imperfect Facebook blocking, who won’t contribute anything nor lift a finger to limit/adapt their own usage. They’re sick of slaving away fighting six-figure-salary Facebook devs, whose only job is to counter adblock, where UBO’s only compensation is more pretentious complaints.


    It’s not a technical limitation, persay. It kinda a “Why are we doing this to ourselves? If you all want us to support Facebook, fine; we welcome PRs.”

    Which is totally fair.

    To me, it sounds like UBO could drop other overtly hostile sites, too. As they should.




  • First of all, I mean zero offense with any purchase decision. A 5090 is very good.

    …But if I were paying that kind of money, I’d probably get a 4090 and a new motherboard/CPU instead. Maybe a used DRR4 threadripper system.

    Hybrid (CPU + GPU) inference is where it’s at these days. It opens up a whole world of huge MoE models, whereas on an 5090 you are stuck with Qwen 27B.

    Having a fast CPU, with lots of RAM channels, with full PCIe bandwidth is much more important for that than having a 5090, where a 3090 or 4090 will get the job done.

    Even if pure speed is your primary concern, you can tune a sparse 120B model (like Laguna) to run almost as fast as Qwen 27B on a 5090, and get at-least-good results.


    It’s more finicky and involved, though. For sure.

    Running an LLM on a 5090 is a task. Hybrid CPU + GPU inference is a hobby.