Topic: Entropy

4 chapters across the catalog

Two Beards
Episode 1773 2:09:35 - 2:17:32

1773: Two Beards

No Agenda Art Generator, AI Model Collapse

The hosts review listener-submitted artwork for the episode, noting a perceived decline in quality due to the widespread use of AI tools. They discuss the concept of "model collapse," where AI systems begin to degrade by training on their own output, leading to repetitive and "cartoony" styles. Specific pieces by artists like Digital 2112 Man and Scaramanga are analyzed for their creative concepts despite the limitations of AI generation.

Control Grid
Episode 1770 2:12:20 - 2:18:38

1770: Control Grid

AI Art Entropy, DH Unplugged, Model Collapse

A discussion on the "DH Unplugged" podcast regarding AI-generated art suggested that the technology is experiencing "entropy" or "model collapse" as it ingests its own previous outputs. This phenomenon results in muddier colors, a lack of true whites or blacks, and a general loss of luminosity in generated images. The hosts noted that many "prompt jockeys" are resorting to cartoonish styles to mask these technical deficiencies as the AI models become increasingly repetitive.

neat-o
Episode 1697 44:22 - 49:58

1697: neat-o

Notebook LM and the Concept of Information Entropy

The concept of entropy, or the state of disorder and deterioration in a system, is being applied to the current state of the internet and AI development. Google's Notebook LM is cited as an example of how AI models may face "model collapse" if they are trained primarily on AI-generated content rather than human sources. This deterioration is compared to the decline of Google Search quality.