It's just a pain in the ass.

AI companies claim their tools couldn’t exist without training on copyrighted material. It turns out, they could and it just takes more work. To prove it, AI researchers trained a model on a dataset that uses only public domain and openly licensed material.

What makes it difficult is curating the data, but once the data has been curated once, in principle everyone can use it without having to go through the painful part. So the whole “we have to violate copyright and steal intellectual property” is (as everybody already knew) total BS.

  • ☆ Yσɠƚԋσʂ ☆@lemmygrad.mlOPEnglish
    4·
    15 days ago

    That’s just a limitation of current training techniques. There’s no reason to expect that new techniques can’t be developed that don’t require exponentially more data. In fact, we already see that simply making models bigger isn’t actually helping. The research is now moving towards ideas like using reinforcement learning and neurosymbolics.