Markdown source

Build with Perception Agents

Conference Context

• Date/time: 2026-06-29 · 2:20pm-4:20pm
• Track/room: Workshops Day 1 · Track 8
• Speaker(s): Emile Baizel, Shruti Arora
• Session type/status: session · confirmed

• Track: Workshops Day 1
• Room: Track 8
• Session type: session
• Status: confirmed

Session Description

Human-agent collaboration is changing, becoming more visual. Models can perceive, point, and verify, but most agents still rely on us typing a paragraph to explain what we're looking at. Meet perception agents: computer use agents that see screens how you see screens. They understand, reason, and verify their own work. They let you point, draw, and describe, just as people collaborate in real life. We call this shared perception, and at AGI Lab we just open-sourced the first two primitives of our perception agent harness: visual verification and visual annotation. In this workshop, you'll get hands-on with both, build one sample use case end-to-end, then take the primitives back to your day-to-day in a mini hackathon. Best ideas win prizes.

Media Evidence

No related AI Engineer channel video found yet.

Evidence Graph

This evidence graph is generated from currently linked source material: official schedule text, related video pages, cached transcripts, visible slide text, dense/reconstructed slide pages, and AI slide-classification audits.

Media Signals

No linked video, transcript, or slide source has been attached yet.

Agent Reading Notes

Use these signals to refine the synopsis, topic links, people/company context, and method notes. If a source is a related external video rather than an exact official recording, keep it framed as supporting evidence.

Transcript Status

No official session recording transcript was found by exact title match on the AI Engineer YouTube channel during this run.

People

• emile baizel
• shruti arora

Notes

• Pending transcript synthesis when an official recording or confirmed matching video is available.

Synthesis

Synthesized Breakdown

Build with Perception Agents ## Conference Context - Date/time: 2026-06-29 · 2:20pm-4:20pm - Track/room: Workshops Day 1 · Track 8 - Speaker(s): Emile Baizel, Shruti Arora - Session type/status: session · confirmed - Track: Workshops Day 1 - Room: Track 8 - Session type: session - Status: confirmed ## Session Description Human-agent collaboration is changing, becoming more visual. Models can perceive, point, and verify, but most agents still rely on us typing a paragraph to explain what we're looking at. Meet perception agents: computer use agents that see screens how you see screens. They understand, reason, and verify their own work.

Speaker And Company Context

• Emile Baizel — role not listed at Amazon AGI Lab.
• Shruti Arora — Member of Technical Staff and Customer Engagement at Amazon AGI Lab.

Topics Covered

• Topic links are pending transcript-backed classification.

Derived Links And Source Material

Novel Concepts / Clever Methods

• No highlighted novel concept has been detected yet.

Evidence Boundary

This synthesis is based on the official schedule and linked source pages. It should be revisited when exact session recordings or transcript-backed secondary sources are available.