Welcome to The Information Bottleneck!
The Information Bottleneck

The Information Bottleneck

Two AI Researchers - Ravid Shwartz Ziv, and Allen Roush, discuss the latest trends, news, and research within Generative AI, LLMs, GPUs, and Cloud Systems.

The player is loading ...
Stefano Ermon on Diffusion LLMs, Mercury & Why the Future of AI Won't Be Autoregressive

Recent Episodes

Stefano Ermon on Diffusion LLMs, Mercury & Why the Future of AI Won't Be Autoregressive
March 18, 2026

Stefano Ermon on Diffusion LLMs, Mercury & Why the Future of AI Won't Be Autoregressive

In this episode, we talk with Stefano Ermon, Stanford professor, co-founder & CEO of Inception AI, and co-inventor of DDIM, FlashAttention, DPO, and score-based/diffusion models, about why diffusion-based language models may...
Training Is Nothing Like Learning with Naomi Saphra (Harvard)
March 13, 2026

Training Is Nothing Like Learning with Naomi Saphra (Harvard)

Naomi Saphra, Kempner Research Fellow at Harvard and incoming Assistant Professor at Boston University, joins us to explain why you can't do interpretability without understanding training dynamics, in the same way you can't...
EP28: How to Control a Stochastic Agent with Stefano Soatto (VP AWS/ Pro. UCLA)
March 6, 2026

EP28: How to Control a Stochastic Agent with Stefano Soatto (VP AWS/ Pro. UCLA)

Stefano Soatto, VP for AI at AWS and Professor at UCLA, joins us to explore how the agentic era fundamentally redefines machine learning, from static train-and-test models to dynamic, interactive control systems. This shift u...
EP27: Medical Foundation Models - with Tanishq Abraham (Sophont.AI)
March 1, 2026

EP27: Medical Foundation Models - with Tanishq Abraham (Sophont.AI)

Tanishq Abraham , CEO and co-founder of Sophont.ai , joins us to talk about building foundation models specifically for medicine. Sophont is trying to be something like an OpenAI or Anthropic but for healthcare - training mo...
EP26: Measuring Intelligence in the Wild -  Arena and the Future of AI Evaluation
Feb. 24, 2026

EP26: Measuring Intelligence in the Wild - Arena and the Future of AI Evaluation

Anastasios Angelopoulos , Co-Founder and CEO of Arena AI (formerly LMArena), joins us to talk about why static benchmarks are failing, how human preference data actually works under the hood, and what it takes to be the "gold...
EP25: Personalization, Data, and the Chaos of Fine-Tuning with Fred Sala (UW-Madison / Snorkel AI)
Feb. 16, 2026

EP25: Personalization, Data, and the Chaos of Fine-Tuning with Fred Sala (UW-Madison / Snorkel AI)

Fred Sala, Assistant Professor at UW-Madison and Chief Scientist at Snorkel AI, joins us to talk about why personalization might be the next frontier for LLMs, why data still matters more than architecture, and how weak super...