--- title: The Death of the Code Review category: talks date: '2026-06-30' time: '12:05pm-12:25pm' track: 'AI Architects: Tokenmaxxing' room: Leadership 2 speakers: - Laurie Voss sourceLabels: - Official conference schedule - Public YouTube metadata last_auto_summarized: '2026-07-03T15:24:27.004Z' scheduleTrack: "AI Architects: Tokenmaxxing" scheduleRoom: "Leadership 2" scheduleLabels: ["AI Architects: Tokenmaxxing", "Leadership 2", "session", "confirmed"] --- # The Death of the Code Review ## Conference Context - Date/time: 2026-06-30 · 12:05pm-12:25pm - Track/room: AI Architects: Tokenmaxxing · Leadership 2 - Speaker(s): Laurie Voss - Session type/status: session · confirmed - Track: AI Architects: Tokenmaxxing - Room: Leadership 2 - Session type: session - Status: confirmed ## Session Description Code review was built for a world where humans wrote all the code. Now, the question isn’t “does this diff look good?” — it’s “can this system safely ship code on its own?” This talk will show why and how traditional code review will quietly be replaced by automated verification harnesses. We’ll show how prompt learning can be used to clone your best internal code reviewers, turning their judgment into automated evaluation loops. We’ll also open source a code review training harness that captures review patterns and turns them into reusable checks for AI-generated code. ## Media Evidence [Ship Real Agents: Hands-On Evals for Agentic Applications — Laurie Voss, Arize](https://www.youtube.com/watch?v=Xfl50508LZM) (speaker-match related prior/adjacent AI Engineer video; captions: English auto-captions). - [[youtube-Xfl50508LZM-transcript]] — full cached transcript markdown for the related YouTube source. - Source video: `youtube-Xfl50508LZM` - Slide deck: [[youtube-Xfl50508LZM-dense-slides|Dense Slides: Ship Real Agents: Hands-On Evals for Agentic Applications — Laurie Voss, Arize]] — 7 visible slide image(s); 7 HTML recreation(s). ![[assets/dense-slides/Xfl50508LZM/slide-001.jpg]] ![[assets/dense-slides/Xfl50508LZM/slide-002.jpg]] ![[assets/dense-slides/Xfl50508LZM/slide-003.jpg]] - Additional slide evidence: [[youtube-Xfl50508LZM-slides|Slides: Ship Real Agents: Hands-On Evals for Agentic Applications — Laurie Voss, Arize]], [[youtube-Xfl50508LZM-reconstructed-slides|Reconstructed Slides: Ship Real Agents: Hands-On Evals for Agentic Applications — Laurie Voss, Arize]] - Slide-derived themes for `youtube-Xfl50508LZM`: phoenix, prompt, settings, general, detect, regressions, change, compare. ## Evidence Graph This evidence graph is generated from currently linked source material: official schedule text, related video pages, cached transcripts, visible slide text, dense/reconstructed slide pages, and AI slide-classification audits. ### Media Signals - `youtube-Xfl50508LZM` — 22,591 transcript words; 6 slide-derived text signals - Transcript signals for `youtube-Xfl50508LZM`: evals, eval, data, should, judge, output, whether, phoenix. - Slide-derived themes for `youtube-Xfl50508LZM`: phoenix, prompt, settings, general, detect, regressions, change, compare. - Evidence links for `youtube-Xfl50508LZM`: [[youtube-Xfl50508LZM]], [[youtube-Xfl50508LZM-transcript]], [[youtube-Xfl50508LZM-slides]], [[youtube-Xfl50508LZM-dense-slides]], [[youtube-Xfl50508LZM-reconstructed-slides]] ### Agent Reading Notes Use these signals to refine the synopsis, topic links, people/company context, and method notes. If a source is a related external video rather than an exact official recording, keep it framed as supporting evidence. ## Summary Laurie Voss frames code review as a process built around human-authored diffs and argues that AI-native software teams need a different control point: automated verification that can decide whether generated code is safe to ship. The connected supporting material, especially Voss's AI Engineer talk on hands-on evals for agentic applications, points toward evaluation harnesses as the replacement layer: systems that capture reviewer judgment, test agent behavior, and turn recurring review patterns into repeatable checks. In the World's Fair context, this session sits squarely in the Software Factories theme: moving from artisanal review toward production pipelines where coding agents, prompts, tests, evals, and observability form the release gate. ## Transcript Status Related video transcript availability: English auto-captions. Treat this as supporting context, not a recording of this exact scheduled session unless later confirmed. Cached at `raw/sources/youtube-transcripts/Xfl50508LZM.txt` (22,591 words). ## People - [[laurie-voss]] ## Supporting Slides - [[youtube-Xfl50508LZM-slides]] — extracted from the related public AI Engineer video. ## Slide Evidence - Slide-only cropped deck: [[youtube-Xfl50508LZM-dense-slides]] (7 viable slide images). - Related slide/OCR pages: - [[youtube-Xfl50508LZM-dense-slides]] - [[youtube-Xfl50508LZM-reconstructed-slides]] - [[youtube-Xfl50508LZM-slides]] - Slide-derived terms: `phoenix`, `claude`, `tome`, `setting`, `tracing`, `alengineer`, `europe`, `ages`, `notebook`, `cloud`, `comma`, `swiss`, `cheese`, `braintrust`, `workos`, `openal`, `frage`, `gers` ## Synthesis ### Synthesized Breakdown Hi everybody. Uh my name's Laurie Voss. I am head of developer experience at Arize AI. Uh in a former life, I co-founded npm Inc. ### Speaker And Company Context - No speaker profile is attached in the official schedule data. ### Topics Covered - [[agent-security]] - [[agentic-search]] - [[agentic-web]] - [[ai-sandboxes]] - [[coding-agents]] ### Derived Links And Source Material - [[youtube-Xfl50508LZM-transcript]] — transcript markdown; source cache `raw/sources/youtube-transcripts/Xfl50508LZM.txt` (22,591 words). - [[youtube-Xfl50508LZM]] — related YouTube source page. - [[youtube-Xfl50508LZM-slides]] — slide evidence. - [[youtube-Xfl50508LZM-reconstructed-slides]] — slide evidence. - [[youtube-Xfl50508LZM-dense-slides]] — slide evidence. ### Novel Concepts / Clever Methods - No highlighted novel concept has been detected yet. ### Evidence Boundary This synthesis uses the official schedule plus cached video transcripts. Official AI Engineer World's Fair San Francisco 2026 livestreams and cut videos are primary event video sources for transcript/slide evidence; external, historical, or speaker-matched videos remain supporting context unless manually verified as exact official event recordings.