Open-Source Inference Engineering for the Agentic Era

Official Schedule Context

• Date/time: 2026-06-29 · 9:00am-11:00am
• Track/room: Workshops Day 1 · Track 8
• Speaker(s): Zain Hasan, Yubo Wang, Qingyang Wu, Jue Wang
• Session type/status: sponsor · confirmed

Official Description

Agentic coding workloads demand long contexts, multi-turn conversations, and throughput at a scale

that most inference engines weren't built for. TokenSpeed is a new open-source engine purpose-built

for this regime, built collaboratively by NVIDIA DevTech, AMD Triton, Qwen Inference, Together AI,

and others. In this 2-hour hands-on workshop, Together Inference Research Engineers and a TokenSpeed

co-creator will cover TokenSpeed architecture, deploying your first model, optimizing for agentic

workloads, kernel and hardware tuning, and throughput/latency trade-offs.

Related YouTube Video

No related AI Engineer channel video found yet.

Transcript Status

No official session recording transcript was found by exact title match on the AI Engineer YouTube channel during this run.

People

• zain hasan
• yubo wang
• qingyang wu
• jue wang

Notes

• Pending transcript synthesis when an official recording or confirmed matching video is available.