Slides: Ship Real Agents: Hands-On Evals for Agentic Applications — Laurie Voss, Arize
Source Video
Ship Real Agents: Hands-On Evals for Agentic Applications — Laurie Voss, Arize
Relationship To World's Fair 2026
These slides are extracted from a public AI Engineer YouTube video connected to World's Fair 2026. Speaker-matched clips are supporting context unless later confirmed as exact session recordings; official livestream recordings are day-level/event-level source material.
Related Scheduled Sessions
- No individual scheduled session mapping has been assigned yet; treat this as an event livestream deck.
Extracted Slides
OCR text:
PLATINUM SPONSORS
Braintrust WorkOS OpenAI
OCR text:
De AE Frage Sg an gers tm cde tome eget x BB true ing mewagees on EP tet aeiativn xt =
. Ste andes Com ALL Mes 7 tf OQ» D & rm |
What are we talking about?
¢ What is an eval, and why you need them
© Setting up tracing with Phoenix
© Building an Al agent with the Claude Agent SDK
OCR text:
AlEngineer
Whatarewetall
EUROPE
Whatisan evatand why youne
Setting up tracing with Phoenix
Building an Al agent with the Cl
AlEngineer
EUROPE
OCR text:
Os Aa erage Ene tee Agere an rime tence agent ok BD Freee ting few ages wo et enianten ox + ~
. CNS thekes COMER AL Lee w aqo°’no + Han;
1. Learner notebook: bit.ly/build-real-agents
2. Claude API key: platform.claude.com/settings/keys
3. Phoenix Cloud account: app.phoenix.arize.com/login/sign-up
¢ Phoenix hostname: app.phoenix.arize.com/s/yourusername
¢ Phoenix API key: app.phoenix.arize.com/s/yourusername/settings/general
' ‘ = s
[elo [a] OP nO pened
arp Ae S: we R
= . =at s A . t oat, re
Le e a a 7 a
ine tor a Paine:
ba | =! a
[a ee, [=] a el ete taly
1. Notebook 2. Claude key 3. Phoenix cloud
These slides: slides.com/seldo/ship-real-agents
OCR text:
© 0 etree etna x7 ee cmaetenee mer on Bru nome ages on Ee medttec 8 # .
« Zk akan COMMA NER te O° DO & Mim ;
This is not theoretical
Everybody vibes until they can’t any more
OCR text:
OO a Eras re aen ge e mine tome apert ok BP a ee tew age on She ma agetatten ox + -
. te ahhes comma aun ee & 0+ DO un |
e
The Swiss Cheese Model
Zooming Out: The Swiss Cheese of Quality
s —F
\ AS we . © Automated evel:
\ 4 win evtuarica partes
© Nc eee
LS &) \ cman
Ps Sym. cone
Bo Me
OCR text:
0 Vork
PHOENN Trace 229901 share
TraceStaus OUNSET $0 TotalCost Latency 42.8s Ou.00 u0.00 Ou1.00 u1.00 lew Ses
1&E Trace New Annotation Config
financial_report Annotatios Nane Unlock 1Pass
WebSearch
RESTAP WebSearch
4 WeeSearch LditAn
8Cla
Categorica Freeform
- wn-g0-5
HO
Minimize None
cxhgherle score the beerg.com
Aoscategory
CogOut Pyorie 2.*Convers1onzesults Jmped g7y-Ths specific figuze 1snot corrobotated by Meta's actual eaznings disclosures and aopears financial disclotute.
Slide-Derived Subjects To Review
Subject extraction uses video title, related session titles/descriptions, transcript context, and OCR text when available. OCR is best-effort and should be reviewed against the embedded slide images.