Markdown source

Slides: Task Fidelity Scaling Laws — Kobie Crawdord, Snorkel

Source Video

Task Fidelity Scaling Laws — Kobie Crawdord, Snorkel

Relationship To World's Fair 2026

These slides are extracted from a public AI Engineer YouTube video connected to World's Fair 2026. Speaker-matched clips are supporting context unless later confirmed as exact session recordings; official livestream recordings are day-level/event-level source material.

Related Scheduled Sessions

Extracted Slides

slide-003.jpg

Slide text:

Does Task Quality Actually Matter?

AI model capabilities are fundamentally bounded by training data quality

this holds regardless of model architecture, scale, or agent harness.

For agentic benchmarks and evals, task quality is data quality

but the field currently lacks empirical evidence that curating higher-quality tasks leads to meaningfully better training outcomes.

Can we measure the impact of task quality on model performance?

slide-004.jpg

Slide text:

Thank You

snorkel.ai/research/

snorkel.ai/leaderboard/

Engineering the future of AI

Hidden Non-Slide Evidence

Classification audit: raw/sources/slide-ai-classification/slides/YYH0DMQr30A/audit.json

Slide-Derived Subjects To Review

Subject extraction uses video title, related session titles/descriptions, transcript context, and OCR text when available. OCR is best-effort and should be reviewed against the embedded slide images.