Welcome to The Information Bottleneck!
The Information Bottleneck

The Information Bottleneck

Two AI Researchers - Ravid Shwartz Ziv, and Allen Roush, discuss the latest trends, news, and research within Generative AI, LLMs, GPUs, and Cloud Systems.

Jürgen Schmidhuber  -  World Models, RL, and the Year that changed AI (Part 1)
The Information Bottleneck
Jürgen Schmidhuber - World Models, RL, and the Year that changed AI (Part 1)

Recent Episodes

Jürgen Schmidhuber  -  World Models, RL, and the Year that changed AI (Part 1)
June 4, 2026

Jürgen Schmidhuber - World Models, RL, and the Year that changed AI (Part 1)

In this episode, we host Jürgen Schmidhuber - the man, the legend, one of the godfathers of modern AI. His lab worked out many ideas behind today’s systems (LSTM, world models, artificial curiosity, Transformer variants, and ...
AI for Science and the Thermodynamics of Generative AI - with Max Welling (UvA, CuspAI)
May 28, 2026

AI for Science and the Thermodynamics of Generative AI - with Max Welling (UvA, CuspAI)

In this episode, we sit with Max Welling, Professor of Machine Learning at the University of Amsterdam, co-founder and CTO of CuspAI, and a foundational figure behind variational autoencoders (VAEs), equivariant networks, and...
After Math Falls, What's Next?  with Julia Kempe (NYU/Meta)
May 24, 2026

After Math Falls, What's Next? with Julia Kempe (NYU/Meta)

Julia Kempe on Why Math Will Fall Next, Superhuman Provers, and the Return of the Renaissance Researcher In this episode, we sit down with Julia Kempe, a Professor at NYU's Center for Data Science and researcher at Meta FAIR'...
Intelligence in an Open World - with Mengye Ren (NYU)
May 20, 2026

Intelligence in an Open World - with Mengye Ren (NYU)

We talk with Mengye Ren , Assistant Professor at NYU's Center for Data Science, about what intelligence actually means once you step outside a benchmark, and why scaling a single centralized model isn't the whole story. We ge...
Language, Cognition, and the Limits of LLMs - with Tal Linzen (NYU/Google)
May 16, 2026

Language, Cognition, and the Limits of LLMs - with Tal Linzen (NYU/Google)

We host Tal Linzen, Associate Professor at NYU and Research Scientist at Google, for a conversation on the intersection of cognitive science and large language models. We discussed why children can learn language from around ...
The Principles of Diffusion Models -  with Jesse Lai (Sony AI)
May 10, 2026

The Principles of Diffusion Models - with Jesse Lai (Sony AI)

We host Chieh-Hsin (Jesse) Lai, Staff Research Scientist at Sony AI and visiting professor at National Yang Ming Chiao Tung University, Taiwan, for a conversation about diffusion models, the technology behind tools like Stabl...