• 24 Posts
  • 256 Comments
Joined 7 years ago
cake
Cake day: August 24th, 2019

help-circle
  • the substance of your assignment is completely irrelevant, no one has time to understand what you have written. it has to look right, not actually be right

    This has been a longstanding problem in academia hasn’t it? Papers published (far before AI) just because they looked right and the team paid the magazine the exorbitant fees to get published, but could not be reproduced or made no sense.







  • a Markov chain predicts the next state based on the current state. If today is sunny, how likely is it that tomorrow will be rainy? Mathematically, this can be reduced to a Markov chain (so we don’t have to take into account the season, weather patterns or anything like that for this example).

    But a Markov chain isn’t just saying how likely it is to be rainy on a given day, but how likely it is to be rainy tomorrow based on today. If today is sunny, there’s a let’s say 70% chance that tomorrow will be rainy. If today is rainy, there’s a 40% chance that tomorrow will be rainy (and conversely a 60% chance that tomorrow will be sunny because possible states must always equal 100%).

    Autocorrect works similarly. It predicts the next word based on the current word you’ve typed out. LLMs are kinda glorified markov chains because they also predict words (called tokens, which are about 3 to 4 characters) but they do it over a much larger “current state”, which is the chat history, custom instructions if you gave any on chatgpt, etc. The context that is passed on with your prompt consists of several tokens and the AI generates one token at a time until little by little it’s formed a full response that it outputs.

    In this way the markov chain of LLM is if I give it the sentence “Hello! My name is” for example, it will predict which token is the most likely to follow and should output it. We can assume this should be a name but truthfully we don’t know the exact probabilities of the next state. If I give it “Hello, my name is” - changing just one character might also change the prediction weighting. I say “might” because AI is a black box and we don’t really see what happens when the data passes through the neurons.

    However if you send that sentence to chatGPT it will correctly tell you that your message got cut off and asks you to finish it. They do some post-production fine-tuning to get it to do that. Compare to deepseek without the reasoning model:





  • First of all why ‘grandma’? My own siblings were born before the end of the USSR. It wasn’t that long ago.

    Secondly you’re not gonna school communists on communism, I can tell you that much. The order to dissolve was illegal and protested against both in government and civil society. It required Yeltsin to proclaim the Russian federation, which he had no authority to do. The US spent millions around the world trying to bankrupt the USSR in conflicts and in their own society (eg the CIA art festival they wanted the USSR to hold in the 60s).

    Thirdly the reason you’re working more than your parents were in the 80s and healthcare is so bad CEOs are getting merked is because there is no USSR. With it western governments were scared of the revolution coming to them and allowed us treats to placate us. I call them treats but I could certainly go for guaranteed raises and free healthcare.

    Fourth Russia is kicking NATO in Ukraine so I’m not sure you’re doing much better all things considered.















  • It was a land swap to which Finland would have come out ahead. They would have received more land of equal value in the trade in the Karelia region.

    The point of the swap was to move Finland’s borders further from Leningrad, which was close enough to Finland that they could shell it from their side. The USSR was ultimately proven right as Finland joined with the Nazis in invading the USSR after Barbarossa.




  • Citizen @wtry@lemm.ee ! For crimes committed against the People’s Republic of Lemmygrad, its people, its institutions, and its Constitutionally-protected dictatorship of the proletariat!

    You are at this time accused of the following charges:

    • Using AI to craft answers for you!
    • Refusing to answer questions by our comrade investigators in the Stasi!
    • Upsetting our peaceful order and inciting sedition in our dictatorship of the proletariat!
    • Being smugly liberal!

    We, the highest court of the People’s Republic of Lemmygrad, sentence you to exile for these transgressions! Your exile is effective now, and is not conducive to a retrial or appeal! The sentence is pronounced!