• Drew@sopuli.xyz
    link
    fedilink
    arrow-up
    5
    ·
    13 hours ago

    I don’t think it’s training from AI data, but rather distillation: which tries to mimic another model

    So there’s a difference in what’s happening, one is taking the data as input and trying to form something new, while the other is trying to recreate the input

    • seang96@spgrn.com
      link
      fedilink
      arrow-up
      3
      ·
      13 hours ago

      Ah I saw it mentioned but paywall blocked the rest lol

      Distillation is basically reverse engineering for AI cool.