Welcome to The Information Bottleneck!

Episodes

Inside xAI, and the Bet on AI Math - with Christian Szegedy (Math Inc)
May 4, 2026

Inside xAI, and the Bet on AI Math - with Christian Szegedy (Math Inc)

We talked with Christian Szegedy, co-inventor of Inception and Batch Normalization, founding scientist at xAI, now at Math Inc, about what it takes to build a frontier lab, and why he left xAI to work on formal mathematics. C...

Listen to the Episode
Reasoning Models and Planning - with Rao Kambhampati (Arizona State)
April 29, 2026

Reasoning Models and Planning - with Rao Kambhampati (Arizona State)

We sat down with Rao Kambhampati, a Professor of CS at Arizona State University and former President of AAAI, to talk about reasoning models: what they are, when they work, and when they break. Rao has been working on plannin...

Listen to the Episode
What Actually Matters in AI? - with Zhuang Liu (Princeton)
April 24, 2026

What Actually Matters in AI? - with Zhuang Liu (Princeton)

In this episode, we hosted Zhuang Liu , Assistant Professor at Princeton and former researcher at Meta, for a conversation about what actually matters in modern AI and what turns out to be a historical accident. Zhuang is beh...

Listen to the Episode
The Future of Coding Agents with Sasha Rush (Cursor/Cornell)
April 15, 2026

The Future of Coding Agents with Sasha Rush (Cursor/Cornell)

We talked with Sasha Rush , researcher at Cursor and professor at Cornell, about what it actually feels like to we in the heart of the AI revolution and build coding agents right now. Sasha shared how these systems are changi...

Listen to the Episode
The Hidden Engine of Vision with Peyman Milanfar (Google)
April 10, 2026

The Hidden Engine of Vision with Peyman Milanfar (Google)

How Denoising Secretly Powers Everything in AI Peyman Milanfar is a Distinguished Scientist at Google, leading its Computational Imaging team. He's a member of the National Academy of Engineering, an IEEE Fellow, and one of t...

Listen to the Episode
Reinventing AI From Scratch with Yaroslav Bulatov
March 30, 2026

Reinventing AI From Scratch with Yaroslav Bulatov

Yaroslav Bulatov helped build the AI era from the inside, as one of the earliest researchers at both OpenAI and Google Brain. Now he wants to tear it all down and start over. Modern deep learning, he argues, is up to 100x mor...

Listen to the Episode
Why Healthcare Is AI's Hardest and Most Important Problem with Kyunghyun Cho (NYU)
March 23, 2026

Why Healthcare Is AI's Hardest and Most Important Problem with Kyungh…

We talk with Kyunghyun Cho, who is a Professor of Health Statistics and a Professor of Computer Science and Data Science at New York University, and a former Executive Director at Genentech, about why healthcare might be the ...

Listen to the Episode
Stefano Ermon on Diffusion LLMs, Mercury & Why the Future of AI Won't Be Autoregressive
March 18, 2026

Stefano Ermon on Diffusion LLMs, Mercury & Why the Future of AI Won't…

In this episode, we talk with Stefano Ermon, Stanford professor, co-founder & CEO of Inception AI, and co-inventor of DDIM, FlashAttention, DPO, and score-based/diffusion models, about why diffusion-based language models may...

Listen to the Episode
Training Is Nothing Like Learning with Naomi Saphra (Harvard)
March 13, 2026

Training Is Nothing Like Learning with Naomi Saphra (Harvard)

Naomi Saphra, Kempner Research Fellow at Harvard and incoming Assistant Professor at Boston University, joins us to explain why you can't do interpretability without understanding training dynamics, in the same way you can't...

Listen to the Episode
EP28: How to Control a Stochastic Agent with Stefano Soatto (VP AWS/ Pro. UCLA)
March 6, 2026

EP28: How to Control a Stochastic Agent with Stefano Soatto (VP AWS/ …

Stefano Soatto, VP for AI at AWS and Professor at UCLA, joins us to explore how the agentic era fundamentally redefines machine learning, from static train-and-test models to dynamic, interactive control systems. This shift u...

Listen to the Episode
EP27: Medical Foundation Models - with Tanishq Abraham (Sophont.AI)
March 1, 2026

EP27: Medical Foundation Models - with Tanishq Abraham (Sophont.AI)

Tanishq Abraham , CEO and co-founder of Sophont.ai , joins us to talk about building foundation models specifically for medicine. Sophont is trying to be something like an OpenAI or Anthropic but for healthcare - training mo...

Listen to the Episode
EP26: Measuring Intelligence in the Wild -  Arena and the Future of AI Evaluation
Feb. 24, 2026

EP26: Measuring Intelligence in the Wild - Arena and the Future of A…

Anastasios Angelopoulos , Co-Founder and CEO of Arena AI (formerly LMArena), joins us to talk about why static benchmarks are failing, how human preference data actually works under the hood, and what it takes to be the "gold...

Listen to the Episode
EP25: Personalization, Data, and the Chaos of Fine-Tuning with Fred Sala (UW-Madison / Snorkel AI)
Feb. 16, 2026

EP25: Personalization, Data, and the Chaos of Fine-Tuning with Fred S…

Fred Sala, Assistant Professor at UW-Madison and Chief Scientist at Snorkel AI, joins us to talk about why personalization might be the next frontier for LLMs, why data still matters more than architecture, and how weak super...

Listen to the Episode
EP24: Can AI Learn to Think About Money?" -  with Bayan Bruss (Capital One)
Feb. 8, 2026

EP24: Can AI Learn to Think About Money?" - with Bayan Bruss (Capita…

Bayan Bruss, VP of Applied AI at Capital One, joins us to talk about building AI systems that can make autonomous financial decisions, and why money might be the hardest problem in machine learning. Bayan leads Capital One's ...

Listen to the Episode
EP23: Building Open Source AI Frameworks: David Mezzetti on TextAI and Local-First AI
Jan. 31, 2026

EP23: Building Open Source AI Frameworks: David Mezzetti on TextAI an…

David Mezzetti , creator of TextAI, joins us to talk about building open source AI frameworks as a solo developer - and why local-first AI still matters in the age of API-everything. David's path from running a 50-person IT c...

Listen to the Episode
EP22: Data Curation for LLMs with Cody Blakeney (Datology AI)
Jan. 20, 2026

EP22: Data Curation for LLMs with Cody Blakeney (Datology AI)

Cody Blakeney from Datology AI joins us to talk about data curation - the unglamorous but critical work of figuring out what to actually train models on. Cody's path from writing CUDA kernels to spending his days staring at w...

Listen to the Episode
EP21: Privacy in the Age of Agents
Jan. 6, 2026

EP21: Privacy in the Age of Agents

Guest: Niloofar Mireshghallah (Incoming Assistant Professor at CMU, Member of Technical Staff at Humans and AI) In this episode, we dive into AI privacy, frontier model capabilities, and why academia still matters. We kick of...

Listen to the Episode
EP20: Yann LeCun
Dec. 15, 2025

EP20: Yann LeCun

Yann LeCun – Why LLMs Will Never Get Us to AGI "The path to superintelligence - just train up the LLMs, train on more synthetic data, hire thousands of people to school your system in post-training, invent new tweaks on RL-I ...

Listen to the Episode
EP19: Al in Finance and Symbolic Al with Atlas Wang
Dec. 10, 2025

EP19: Al in Finance and Symbolic Al with Atlas Wang

Atlas Wang (UT Austin faculty, XTX Research Director) joins us to explore two fascinating frontiers: the foundations of symbolic AI and the practical challenges of building AI systems for quantitative finance. On the symbolic...

Listen to the Episode
EP18: AI Robotics
Dec. 1, 2025

EP18: AI Robotics

In this episode, we hosted Judah Goldfeder, a PhD candidate at Columbia University and student researcher at Google, to discuss robotics, reproducibility in ML, and smart buildings. Key topics covered: Robotics challenges: We...

Listen to the Episode
EP17: RL with Will Brown
Nov. 24, 2025

EP17: RL with Will Brown

In this episode, we talk with Will Brown, a research lead at Prime Intellect , about his journey into reinforcement learning (RL) and multi-agent systems, exploring their theoretical foundations and practical applications. We...

Listen to the Episode
EP16: AI News and Papers
Nov. 17, 2025

EP16: AI News and Papers

In this episode, we discuss various topics in AI, including the challenges of the conference review process, the capabilities of Kimi K2 thinking, the advancements in TPU technology, the significance of real-world data in rob...

Listen to the Episode
EP15: The Information Bottleneck and Scaling Laws with Alex Alemi
Nov. 13, 2025

EP15: The Information Bottleneck and Scaling Laws with Alex Alemi

In this episode, we sit down with Alex Alemi, an AI researcher at Anthropic (previously at Google Brain and Disney), to explore the powerful framework of the information bottleneck and its profound implications for modern mac...

Listen to the Episode
EP14: AI News and Papers
Nov. 10, 2025

EP14: AI News and Papers

In this episode, we talked about AI news and recent papers. We explored the complexities of using AI models in healthcare (the Nature Medicine paper on GPT-5's fragile intelligence in medical contexts). We discussed the delic...

Listen to the Episode