Don't Ship Skills Without Evals

Official Schedule Context

Official Description

There are thousands agent skills. Almost none of them are tested. They get vibe-checked with two

manual runs, maybe a thumbs-up from a colleague, then shipped. You wouldn't merge code without tests

— so why are we shipping skills without evals? This talk covers the full lifecycle of building

reliable agent skills: what a skill actually is (and isn't), how to write one that triggers

correctly, and how to build a lightweight eval harness that catches failures before your users do.

Related YouTube Video

Why (Senior) Engineers Struggle to Build AI Agents — Philipp Schmid, Google DeepMind (speaker-match related prior/adjacent AI Engineer video; captions: English auto-captions).

Transcript Status

Related video transcript availability: English auto-captions. Treat this as supporting context, not a recording of this exact scheduled session unless later confirmed. Not fetched yet.

People

Notes

Supporting Slides

Slide Evidence