“Our primary conclusion across all scenarios is that without enough fresh real data in each generation of an autophagous loop, future generative models are doomed to have their quality (precision) or diversity (recall) progressively decrease,” they added. “We term this condition Model Autophagy Disorder (MAD).”

Interestingly, this might be a more challenging problem as we increase the use of generative AI models online.

  • Cybrpwca@beehaw.org
    link
    fedilink
    English
    arrow-up
    5
    ·
    1 year ago

    So we have generation loss instead of AI making better AI. At least for now. That’s strangely comforting.

    • FaceDeer@kbin.social
      link
      fedilink
      arrow-up
      1
      ·
      1 year ago

      The summary said:

      without enough fresh real data in each generation

      So as long as you’re mixing enough fresh data in you should be fine.