Episode #35
Kunstig intelligens - modelsammenbrud (del 10)
I dette afsnit fortæller jeg om, hvordan AI-modeller som f.eks. ChatGPT kan bryde sammen og holde op med at virke, hvis de trænes på deres eget eller andre store sprogmodellers output. Ilia Shumailov og hans kollegers artikel “The Curse of Recursion” kan findes her: https://arxiv.org/pdf/2305.17493 Hector Zenils “On The Limits of Self-Improving in Large Language Models” er her: https://arxiv.org/pdf/2601.05280 Jeg har i dette afsnit søgt inspiration og lånt eksempler fra George Montañez’ foredrag “Model Collapse ends AI Hype”, som kan findes her: https://www.youtube.com/watch?v=ShusuVq32hc Her omtales Shumailov et als resultater, men ikke Zenils, som først er kommet senere. De tre eksempler, som jeg ikke læste op i deres helhed, er: Den tekst, der skal genereres en fortsættelse af: […] some started before 1360 — was typically accomplished by a master mason and a small team of itinerant masons, supplemented by local parish labourers, according to Poyntz Wright. But other authors reject this model, suggesting instead that leading architects designed the parish church towers based on early examples of Perpendicular […] 0. generation, kun trænet på originale data Revival architecture such as St. John’s Cathedral in London. The earliest surviving example of Perpendicular Revival architecture is found in the 18th-century Church of Our Lady of Guernsey, which dates from the late 19th century. There are two types of perpendicular churches : those […] Originale data + 1. generation forurenede data: architecture such as St. Peter’s Basilica in Rome or St. Peter’s Basilica in Buenos Aires. There is no evidence that any of these buildings were built during the reign of Pope Innocent III, but it is possible that they may have been built during the reign of his successor, Pope Innocent […] Originale data + 9. generation forurenede data: architecture. In addition to being home to some of the world’s largest populations of black-tailed jackrabbits, white-tailed jackrabbits, blue-tailed jackrabbits, red-tailed jackrabbits, yellow- […] Hvis du ønsker at støtte mit arbejde, så køb bogen “Ada & Zangemann”, der fortæller om fordelene ved fri og open source software og digital suverænitet. Den kan fås hos boghandleren, f.eks. her: https://www.bog-ide.dk/produkt/5528958/matthias-kirschner-og-sandra-brandstatter-ada-zangemann Hvis du allerede har købt bogen eller ikke har råd, så del denne podcast. På forhånd tak :-)
