Welcome to The Information Bottleneck!
The Information Bottleneck

The Information Bottleneck

Two AI Researchers - Ravid Shwartz Ziv, and Allen Roush, discuss the latest trends, news, and research within Generative AI, LLMs, GPUs, and Cloud Systems.

After Math Falls, What's Next?  with Julia Kempe (NYU/Meta)
The Information Bottleneck
After Math Falls, What's Next? with Julia Kempe (NYU/Meta)

Recent Episodes

After Math Falls, What's Next?  with Julia Kempe (NYU/Meta)
May 24, 2026

After Math Falls, What's Next? with Julia Kempe (NYU/Meta)

Julia Kempe on Why Math Will Fall Next, Superhuman Provers, and the Return of the Renaissance Researcher In this episode, we sit down with Julia Kempe, a Professor at NYU's Center for Data Science and researcher at Meta FAIR'...
Intelligence in an Open World - with Mengye Ren (NYU)
May 20, 2026

Intelligence in an Open World - with Mengye Ren (NYU)

We talk with Mengye Ren , Assistant Professor at NYU's Center for Data Science, about what intelligence actually means once you step outside a benchmark, and why scaling a single centralized model isn't the whole story. We ge...
Language, Cognition, and the Limits of LLMs - with Tal Linzen (NYU/Google)
May 16, 2026

Language, Cognition, and the Limits of LLMs - with Tal Linzen (NYU/Google)

We host Tal Linzen, Associate Professor at NYU and Research Scientist at Google, for a conversation on the intersection of cognitive science and large language models. We discussed why children can learn language from around ...
The Principles of Diffusion Models -  with Jesse Lai (Sony AI)
May 10, 2026

The Principles of Diffusion Models - with Jesse Lai (Sony AI)

We host Chieh-Hsin (Jesse) Lai, Staff Research Scientist at Sony AI and visiting professor at National Yang Ming Chiao Tung University, Taiwan, for a conversation about diffusion models, the technology behind tools like Stabl...
Inside xAI, and the Bet on AI Math - with Christian Szegedy (Math Inc)
May 4, 2026

Inside xAI, and the Bet on AI Math - with Christian Szegedy (Math Inc)

We talked with Christian Szegedy, co-inventor of Inception and Batch Normalization, founding scientist at xAI, now at Math Inc, about what it takes to build a frontier lab, and why he left xAI to work on formal mathematics. C...
Reasoning Models and Planning - with Rao Kambhampati (Arizona State)
April 29, 2026

Reasoning Models and Planning - with Rao Kambhampati (Arizona State)

We sat down with Rao Kambhampati, a Professor of CS at Arizona State University and former President of AAAI, to talk about reasoning models: what they are, when they work, and when they break. Rao has been working on plannin...