The Information Bottleneck

The Information Bottleneck

Home
Podcast
Posts
Archive
About
How to Turn Research Into Billion-Dollar Companies, with Ion Stoica
Ion Stoica has done what almost no academic ever does — repeatedly turned university research into billion-dollar companies.
 • Ravid Shwartz Ziv and Allen Roush
49:26
How to Turn Research Into Billion-Dollar Companies, with Ion Stoica
Ion Stoica has done what almost no academic ever does — repeatedly turned university research into billion-dollar companies.
 • Ravid Shwartz Ziv
49:27
Kaggle Grandmasters, Agent Skills, and Why Everyone Is Overfitting with Jean-Francois Puget (Nvidia)
Jean-Francois Puget is a Director and Distinguished Engineer at NVIDIA, where he leads the Kaggle Grandmasters team, and he’s ranked third on Kaggle’s…
 • Ravid Shwartz Ziv and Allen Roush
59:08
Speculative decoding, from zero to DSpark
Big models generate slowly and verify fast. Speculative decoding exploits the gap. A post about how it works, and how DSpark pushes it into a real…
 • Ravid Shwartz Ziv
AI Agents and The Golden Age of Asking Questions with Dimitris Papailiopoulos (MSR/UW-Madison)
In this episode, we talked with Dimitris Papailiopoulos, researcher at Microsoft Research’s AI Frontiers lab and professor at the University of…
 • Ravid Shwartz Ziv and Allen Roush
1:13:11
Why All Models Learn the Same Thing with Phillip Isola (MIT)
Phillip Isola, professor at MIT, joins us to talk about representation learning: what makes a representation good, why different models seem to converge…
 • Ravid Shwartz Ziv
1:11:28

June 2026

Editing a Compressed Memory
Linear attention compresses memory into one fixed-size matrix. The hard part is editing it without scrambling everything else.
 • Ravid Shwartz Ziv
AI for Science with Qichao Hu (Molecular Universe / SES AI)
Most AI-for-science companies are selling shovels. Qichao Hu wants the gold.
 • Ravid Shwartz Ziv and Allen Roush
1:00:56
Infrastructure for AI at Scale - With Benny Chen (Fireworks AI)
We talk a lot on this show about RL, agents, and the move between pre-training and post-training, but not enough about the layer everything actually…
 • Ravid Shwartz Ziv
1:05:50
Broken Peer Review, AI, and Worms — with Oded Rechavi
Oded Rechavi is a biologist at Tel Aviv University and the co-founder of QED, a company building AI to review scientific work.
 • Ravid Shwartz Ziv and Allen Roush
1:18:04
Will AI Take Our Jobs? With Alex Imas (Google/University of Chicago)
Will AI take our jobs?
 • Ravid Shwartz Ziv and Allen Roush
1:29:00
Why AI Benchmarks Are Lying to You - with Wenhu Chen (Meta/University of Waterloo)
In this episode, we sit down with Wenhu Chen, research scientist at Meta MSL, assistant professor at the University of Waterloo, and the person behind…
 • Ravid Shwartz Ziv and Allen Roush
1:19:03
© 2026 The Information Bottleneck · Privacy ∙ Terms ∙ Collection notice
Start your SubstackGet the app
Substack is the home for great culture