The Information Bottleneck
Subscribe
Sign in
Home
Podcast
Posts
Archive
About
Latest
Top
Editing a Compressed Memory
Linear attention compresses memory into one fixed-size matrix. The hard part is editing it without scrambling everything else.
12 hrs ago
•
Ravid Shwartz Ziv
1
AI for Science with Qichao Hu (Molecular Universe / SES AI)
Most AI-for-science companies are selling shovels. Qichao Hu wants the gold.
Jun 29
•
Ravid Shwartz Ziv
and
Allen Roush
1:00:56
Infrastructure for AI at Scale - With Benny Chen (Fireworks AI)
We talk a lot on this show about RL, agents, and the move between pre-training and post-training, but not enough about the layer everything actually…
Jun 24
•
Ravid Shwartz Ziv
1:05:50
Broken Peer Review, AI, and Worms — with Oded Rechavi
Oded Rechavi is a biologist at Tel Aviv University and the co-founder of QED, a company building AI to review scientific work.
Jun 21
•
Ravid Shwartz Ziv
and
Allen Roush
1:18:04
Will AI Take Our Jobs? With Alex Imas (Google/University of Chicago)
Will AI take our jobs?
Jun 16
•
Ravid Shwartz Ziv
and
Allen Roush
1:29:00
Why AI Benchmarks Are Lying to You - with Wenhu Chen (Meta/University of Waterloo)
In this episode, we sit down with Wenhu Chen, research scientist at Meta MSL, assistant professor at the University of Waterloo, and the person behind…
Jun 13
•
Ravid Shwartz Ziv
and
Allen Roush
1:19:03
Jürgen Schmidhuber - Part 2: JEPA, the Road to AGI, and Who Really Invented Modern AI
In the second half of our conversation with Jürgen Schmidhuber, we focus on the key ideas he's pursued since the early 1990s and discuss why he believes…
Jun 7
•
Ravid Shwartz Ziv
and
Allen Roush
1:29:29
Jürgen Schmidhuber - World Models, RL, and the Year that changed AI (Part 1)
In this episode, we host Jürgen Schmidhuber - the man, the legend, one of the godfathers of modern AI.
Jun 4
•
Ravid Shwartz Ziv
and
Allen Roush
1:37:55
May 2026
AI for Science and the Thermodynamics of Generative AI - with Max Welling (UvA, CuspAI)
In this episode, we sit with Max Welling, Professor of Machine Learning at the University of Amsterdam, co-founder and CTO of CuspAI, and a foundational…
May 29
•
Ravid Shwartz Ziv
and
Allen Roush
1:13:46
After Math Falls, What's Next? with Julia Kempe (NYU/Meta)
Julia Kempe on Why Math Will Fall Next, Superhuman Provers, and the Return of the Renaissance Researcher
May 25
•
Ravid Shwartz Ziv
and
Allen Roush
1:14:43
Intelligence in an Open World - with Mengye Ren (NYU)
We talk with Mengye Ren, Assistant Professor at NYU's Center for Data Science, about what intelligence actually means once you step outside a benchmark…
May 20
•
Ravid Shwartz Ziv
and
Allen Roush
59:15
Language, Cognition, and the Limits of LLMs - with Tal Linzen (NYU/Google)
We host Tal Linzen, Associate Professor at NYU and Research Scientist at Google, for a conversation on the intersection of cognitive science and large…
May 17
•
Ravid Shwartz Ziv
and
Allen Roush
1:23:25
This site requires JavaScript to run correctly. Please
turn on JavaScript
or unblock scripts
