Welcome to The Information Bottleneck!
The Information Bottleneck

The Information Bottleneck

Two AI Researchers - Ravid Shwartz Ziv, and Allen Roush, discuss the latest trends, news, and research within Generative AI, LLMs, GPUs, and Cloud Systems.

The player is loading ...
EP26: Measuring Intelligence in the Wild -  Arena and the Future of AI Evaluation

Recent Episodes

EP26: Measuring Intelligence in the Wild -  Arena and the Future of AI Evaluation
Feb. 24, 2026

EP26: Measuring Intelligence in the Wild - Arena and the Future of AI Evaluation

Anastasios Angelopoulos , Co-Founder and CEO of Arena AI (formerly LMArena), joins us to talk about why static benchmarks are failing, how human preference data actually works under the hood, and what it takes to be the "gold...
EP25: Personalization, Data, and the Chaos of Fine-Tuning with Fred Sala (UW-Madison / Snorkel AI)
Feb. 16, 2026

EP25: Personalization, Data, and the Chaos of Fine-Tuning with Fred Sala (UW-Madison / Snorkel AI)

Fred Sala, Assistant Professor at UW-Madison and Chief Scientist at Snorkel AI, joins us to talk about why personalization might be the next frontier for LLMs, why data still matters more than architecture, and how weak super...
EP24: Can AI Learn to Think About Money?" -  with Bayan Bruss (Capital One)
Feb. 8, 2026

EP24: Can AI Learn to Think About Money?" - with Bayan Bruss (Capital One)

Bayan Bruss, VP of Applied AI at Capital One, joins us to talk about building AI systems that can make autonomous financial decisions, and why money might be the hardest problem in machine learning. Bayan leads Capital One's ...
EP23: Building Open Source AI Frameworks: David Mezzetti on TextAI and Local-First AI
Jan. 31, 2026

EP23: Building Open Source AI Frameworks: David Mezzetti on TextAI and Local-First AI

David Mezzetti , creator of TextAI, joins us to talk about building open source AI frameworks as a solo developer - and why local-first AI still matters in the age of API-everything. David's path from running a 50-person IT c...
EP22: Data Curation for LLMs with Cody Blakeney (Datology AI)
Jan. 20, 2026

EP22: Data Curation for LLMs with Cody Blakeney (Datology AI)

Cody Blakeney from Datology AI joins us to talk about data curation - the unglamorous but critical work of figuring out what to actually train models on. Cody's path from writing CUDA kernels to spending his days staring at w...
EP21: Privacy in the Age of Agents
Jan. 6, 2026

EP21: Privacy in the Age of Agents

Guest: Niloofar Mireshghallah (Incoming Assistant Professor at CMU, Member of Technical Staff at Humans and AI) In this episode, we dive into AI privacy, frontier model capabilities, and why academia still matters. We kick of...