Once you’ve trained your large language model on the entire written output of humanity, where do you go? Here’s Ilya Sutskever, ex-OpenAI, admitting to Reuters that they’ve plateaued: [Reuters] The…

I’m usually the one saying “AI is already as good as it’s gonna get, for a long while.”

This article, in contrast, is quotes from folks making the next AI generation - saying the same.

  • MajorHavoc@programming.devOPEnglish
    9·
    4 days ago

    I think you’re agreeing, just in a rude and condescending way.

    There’s a lot of ways left to improve, but they’re not as simple as just throwing more data and CPU at the problem, anymore.

    • Greg Clarke@lemmy.caEnglish
      32·
      3 days ago

      I’m sorry if I’m coming across as condescending, that’s not my intent. It’s never been “as simple as just throwing more data and CPU at the problem”. There were algorithmic challenges for every LLM evolution. There are still lots of potential improvements using the existing training data. But even if there wasn’t, we’ll still see loads of improvements in chat bots because of other techniques.

      Edit: typo