The Information Bottleneck

The Information Bottleneck

Home
Podcast
Posts
Archive
About
Why AI Still Can't See wtih Andrew Dai
Listen now (58 mins) | Andrew Dai spent over a decade at Google Brain and DeepMind, where he co-wrote the 2015 paper that introduced language model…
 • Ravid Shwartz Ziv
58:17
Can AI Replace Doctors? Zachary Lipton on the Future of Healthcare and AI
Zachary Lipton is an associate professor at Carnegie Mellon University and a co-founder of Abridge, a healthcare AI company (and a jazz saxophonist!).
 • Ravid Shwartz Ziv and Allen Roush
1:31:17
Sara Hooker on the End of Static AI
What comes after scaling?
 • Ravid Shwartz Ziv
1:35:51
Tiny Recursive Models Beat the Giants - Alexia Jolicoeur-Martineau (Microsoft)
Alexia Jolicoeur-Martineau is a Principal Researcher at Microsoft and the author of "Less is More: Recursive Reasoning with Tiny Networks," the paper…
 • Ravid Shwartz Ziv and Allen Roush
52:22
Continual Learning Is the Next Bottleneck | Rohan Anil (Core Automation )
Listen now (71 mins) | Rohan Anil spent eleven and a half years at Google, where he went from writing memory allocators to large-scale linear solvers…
 • Ravid Shwartz Ziv
1:11:09
World Models | John Langford (Microsoft AI Labs)
John Langford, one of the heads of Microsoft's AI Labs, the creator of Vowpal Wabbit, and a co-inventor of CAPTCHA, joins us to talk about world models.
 • Ravid Shwartz Ziv
1:05:39
Which Tabular Model Should You Actually Use? | David Holzmüller (INRIA)
Tabular data is still where most of machine learning actually happens in industry, and the field has changed a lot in the last few years.
 • Ravid Shwartz Ziv and Allen Roush
55:40
Why You Can't Just Rent 1,000 GPUs | Charles Frye (Modal)
Charles Frye (Modal, ex-Weights & Biases, Berkeley PhD) joins Ravid and Allen to explain why modern AI research is bottlenecked by compute, and why…
 • Ravid Shwartz Ziv and Allen Roush
1:03:00

August 2026

Stella Biderman (EleutherAI) - Open Source, AI Safety, and Who We Can Trust
Stella Biderman, Executive Director of EleutherAI, joins us the week an OpenAI model autonomously broke out of its sandbox and hacked Hugging Face.
 • Ravid Shwartz Ziv
1:06:25
Why AI Probably Won’t Cure Most Diseases in Ten Years
Since coding agents became much better at the end of last year, there has been a huge debate about what comes next.
 • Ravid Shwartz Ziv
Why Deep Learning Finally Works on Tables | Frank Hutter (Prior Labs)
In this episode, Frank Hutter joins us to talk about TabPFN and why tabular data is suddenly the hottest problem in deep learning.
 • Ravid Shwartz Ziv and Allen Roush
1:18:06
Surya Ganguli: The Physics of Intelligence
Surya Ganguli is a professor at Stanford and VP at General Catalyst, working at the intersection of physics, neuroscience, and AI.
 • Ravid Shwartz Ziv and Allen Roush
1:25:22
© 2026 The Information Bottleneck · Privacy ∙ Terms ∙ Collection notice
Start your SubstackGet the app
Substack is the home for great culture