Welcome to The Information Bottleneck!

Episodes

Why Healthcare Is AI's Hardest and Most Important Problem with Kyunghyun Cho (NYU)
March 23, 2026

Why Healthcare Is AI's Hardest and Most Important Problem with Kyungh…

We talk with Kyunghyun Cho, who is a Professor of Health Statistics and a Professor of Computer Science and Data Science at New York University, and a former Executive Director at Genentech, about why healthcare might be the ...

Listen to the Episode
Stefano Ermon on Diffusion LLMs, Mercury & Why the Future of AI Won't Be Autoregressive
March 18, 2026

Stefano Ermon on Diffusion LLMs, Mercury & Why the Future of AI Won't…

In this episode, we talk with Stefano Ermon, Stanford professor, co-founder & CEO of Inception AI, and co-inventor of DDIM, FlashAttention, DPO, and score-based/diffusion models, about why diffusion-based language models may...

Listen to the Episode
Training Is Nothing Like Learning with Naomi Saphra (Harvard)
March 13, 2026

Training Is Nothing Like Learning with Naomi Saphra (Harvard)

Naomi Saphra, Kempner Research Fellow at Harvard and incoming Assistant Professor at Boston University, joins us to explain why you can't do interpretability without understanding training dynamics, in the same way you can't...

Listen to the Episode
EP28: How to Control a Stochastic Agent with Stefano Soatto (VP AWS/ Pro. UCLA)
March 6, 2026

EP28: How to Control a Stochastic Agent with Stefano Soatto (VP AWS/ …

Stefano Soatto, VP for AI at AWS and Professor at UCLA, joins us to explore how the agentic era fundamentally redefines machine learning, from static train-and-test models to dynamic, interactive control systems. This shift u...

Listen to the Episode
EP27: Medical Foundation Models - with Tanishq Abraham (Sophont.AI)
March 1, 2026

EP27: Medical Foundation Models - with Tanishq Abraham (Sophont.AI)

Tanishq Abraham , CEO and co-founder of Sophont.ai , joins us to talk about building foundation models specifically for medicine. Sophont is trying to be something like an OpenAI or Anthropic but for healthcare - training mo...

Listen to the Episode
EP26: Measuring Intelligence in the Wild -  Arena and the Future of AI Evaluation
Feb. 24, 2026

EP26: Measuring Intelligence in the Wild - Arena and the Future of A…

Anastasios Angelopoulos , Co-Founder and CEO of Arena AI (formerly LMArena), joins us to talk about why static benchmarks are failing, how human preference data actually works under the hood, and what it takes to be the "gold...

Listen to the Episode
EP25: Personalization, Data, and the Chaos of Fine-Tuning with Fred Sala (UW-Madison / Snorkel AI)
Feb. 16, 2026

EP25: Personalization, Data, and the Chaos of Fine-Tuning with Fred S…

Fred Sala, Assistant Professor at UW-Madison and Chief Scientist at Snorkel AI, joins us to talk about why personalization might be the next frontier for LLMs, why data still matters more than architecture, and how weak super...

Listen to the Episode
EP24: Can AI Learn to Think About Money?" -  with Bayan Bruss (Capital One)
Feb. 8, 2026

EP24: Can AI Learn to Think About Money?" - with Bayan Bruss (Capita…

Bayan Bruss, VP of Applied AI at Capital One, joins us to talk about building AI systems that can make autonomous financial decisions, and why money might be the hardest problem in machine learning. Bayan leads Capital One's ...

Listen to the Episode
EP23: Building Open Source AI Frameworks: David Mezzetti on TextAI and Local-First AI
Jan. 31, 2026

EP23: Building Open Source AI Frameworks: David Mezzetti on TextAI an…

David Mezzetti , creator of TextAI, joins us to talk about building open source AI frameworks as a solo developer - and why local-first AI still matters in the age of API-everything. David's path from running a 50-person IT c...

Listen to the Episode
EP22: Data Curation for LLMs with Cody Blakeney (Datology AI)
Jan. 20, 2026

EP22: Data Curation for LLMs with Cody Blakeney (Datology AI)

Cody Blakeney from Datology AI joins us to talk about data curation - the unglamorous but critical work of figuring out what to actually train models on. Cody's path from writing CUDA kernels to spending his days staring at w...

Listen to the Episode
EP21: Privacy in the Age of Agents
Jan. 6, 2026

EP21: Privacy in the Age of Agents

Guest: Niloofar Mireshghallah (Incoming Assistant Professor at CMU, Member of Technical Staff at Humans and AI) In this episode, we dive into AI privacy, frontier model capabilities, and why academia still matters. We kick of...

Listen to the Episode
EP20: Yann LeCun
Dec. 15, 2025

EP20: Yann LeCun

Yann LeCun – Why LLMs Will Never Get Us to AGI "The path to superintelligence - just train up the LLMs, train on more synthetic data, hire thousands of people to school your system in post-training, invent new tweaks on RL-I ...

Listen to the Episode
EP19: Al in Finance and Symbolic Al with Atlas Wang
Dec. 10, 2025

EP19: Al in Finance and Symbolic Al with Atlas Wang

Atlas Wang (UT Austin faculty, XTX Research Director) joins us to explore two fascinating frontiers: the foundations of symbolic AI and the practical challenges of building AI systems for quantitative finance. On the symbolic...

Listen to the Episode
EP18: AI Robotics
Dec. 1, 2025

EP18: AI Robotics

In this episode, we hosted Judah Goldfeder, a PhD candidate at Columbia University and student researcher at Google, to discuss robotics, reproducibility in ML, and smart buildings. Key topics covered: Robotics challenges: We...

Listen to the Episode
EP17: RL with Will Brown
Nov. 24, 2025

EP17: RL with Will Brown

In this episode, we talk with Will Brown, a research lead at Prime Intellect , about his journey into reinforcement learning (RL) and multi-agent systems, exploring their theoretical foundations and practical applications. We...

Listen to the Episode
EP16: AI News and Papers
Nov. 17, 2025

EP16: AI News and Papers

In this episode, we discuss various topics in AI, including the challenges of the conference review process, the capabilities of Kimi K2 thinking, the advancements in TPU technology, the significance of real-world data in rob...

Listen to the Episode
EP15: The Information Bottleneck and Scaling Laws with Alex Alemi
Nov. 13, 2025

EP15: The Information Bottleneck and Scaling Laws with Alex Alemi

In this episode, we sit down with Alex Alemi, an AI researcher at Anthropic (previously at Google Brain and Disney), to explore the powerful framework of the information bottleneck and its profound implications for modern mac...

Listen to the Episode
EP14: AI News and Papers
Nov. 10, 2025

EP14: AI News and Papers

In this episode, we talked about AI news and recent papers. We explored the complexities of using AI models in healthcare (the Nature Medicine paper on GPT-5's fragile intelligence in medical contexts). We discussed the delic...

Listen to the Episode
EP13: Recurrent-Depth Models and Latent Reasoning with Jonas Geiping
Nov. 7, 2025

EP13: Recurrent-Depth Models and Latent Reasoning with Jonas Geiping

In this episode, we host Jonas Geiping from ELLIS Institute & Max-Planck Institute for Intelligent Systems, Tübingen AI Center, Germany. We talked about his broad research on Recurrent-Depth Models and late reasoning in large...

Listen to the Episode
EP12:  Adversarial attacks and compression with Jack Morris
Nov. 2, 2025

EP12: Adversarial attacks and compression with Jack Morris

In this episode of the Information Bottleneck Podcast, we host Jack Morris, a PhD student at Cornell, to discuss adversarial examples (Jack created TextAttack , the first software package for LLM jailbreaking), the Platonic r...

Listen to the Episode
EP11: JEPA with Randall Balestriero
Oct. 27, 2025

EP11: JEPA with Randall Balestriero

In this episode we talk with Randall Balestriero, an assistant professor at Brown University. We discuss the potential and challenges of Joint Embedding Predictive Architectures (JEPA). We explore the concept of JEPA, which a...

Listen to the Episode
EP10: Geometric Deep Learning with Michael Bronstein
Oct. 20, 2025

EP10: Geometric Deep Learning with Michael Bronstein

In this episode, we talked with Michael Bronstein, a professor of AI at the University of Oxford and a scientific director at AITHYRA, about the fascinating world of geometric deep learning. We explored how understanding the ...

Listen to the Episode
EP9: AI in Natural Sciences with Tal Kachman
Oct. 12, 2025

EP9: AI in Natural Sciences with Tal Kachman

In this episode we host Tal Kachman, an assistant professor at Radboud University, to explore the fascinating intersection of artificial intelligence and natural sciences. Prof. Kachman's research focuses on multiagent intera...

Listen to the Episode
EP8: RL with Ahmad Beirami
Oct. 6, 2025

EP8: RL with Ahmad Beirami

In this episode, we talked with Ahmad Beirami, an ex-researcher at Google, to discuss various topics. We explored the complexities of reinforcement learning, its applications in LLMs, and the evaluation challenges in AI resea...

Listen to the Episode