Slides: WF2026: Software Factories & Keynotes ft. Microsoft, OpenAI, OpenClaw, Z.ai (GLM), MiniMax, HF

Source Video

WF2026: Software Factories & Keynotes ft. Microsoft, OpenAI, OpenClaw, Z.ai (GLM), MiniMax, HF

Relationship To World's Fair 2026

These slides are extracted from a public AI Engineer YouTube video connected to World's Fair 2026. Speaker-matched clips are supporting context unless later confirmed as exact session recordings; official livestream recordings are day-level/event-level source material.

Related Scheduled Sessions

Extracted Slides

slide-001.jpg

OCR text:

AIEngineer

aws

Microsoft

World's

W

AlEngineer

AIEngineor

中au

World'sFair

World'sFair

AIE

oraintrust

Worle

ne04j

W

AlEngineer

AIEnginee

slide-002.jpg

OCR text:

ee eee eee Pe

ee . 1 Te ear ear etek OrnesieE ee 6 Me Be BD tome

ENT ee ag ‘2

, . a Monit bg *

World Ss alg 3 Loopcraft: The Art of Stacking Loops

e bone .

°

= arrest dass coat begs” oo ee ae

ea a a -

a

c SB automa a ee eek cae ates wads engl + Bays

a & peal loop rae rut pie tearted shears

: asaaeeeean sere BRS retire wie mB PY

°

e reat fied He tee ten tented whee

e

UPpenal a . . .

a Gree “erplan ecurten! evant at toch ves Ky Lae R

a

: Vv Ve ila ° me cata

ad 7 e *

co

"I gd

s I

in

A

ee

a i .

slide-003.jpg

OCR text:

| World's Fair | Microsoft

[... en ;

OpenAl VAY olalekow arsl ig

Al Engineer

World's | Akamai

Welcome to the Al Engineer World's Fair Sree

bo § ar Te - 5

5 SEY sae) aaa "(ela le koe at) |p

slide-004.jpg

OCR text:

onAGl Lab

World'sFair

AlEngineer

enAl

rld'sFair

Wor

ogetherai

air

AIEngineer

A

rld'sFair

DOG

Wor

slide-005.jpg

OCR text:

Eye oe

World's Fair

mE acorseus Intrinsic

31 Lab fora CekcMarlig

on OpenAl

A or acl

erenl @ Oreeeee DOIG)

slide-006.jpg

OCR text:

AlEngineer

World'sFair

OpenClaw-sized apps, not a single line written by hand

Opus4.5 ships,agents write entire simple apps

Cursor launches.GitHub Copilot X expands to chat,PRs,etc.

IntelliSense: type-driven autocomplete

PRESENTED BY

GitHub Copilot suggests whole lines & functions

IntelliCoderankscompletionswithML

Microsoft

World'sFair

OpenA.

W

World's

Engineering the future of Al

DATAD

W

slide-007.jpg

OCR text:

rere | Your people. Your agents. Your IQ.

m2

2 Ne cere Microsoft 1Q

Worle air Fi nt Ee a a b . of

Or Al

Ww . S

Engineering the future of Al

te

slide-008.jpg

OCR text:

eal: eal Foundry |Q

World's Fair

} - | i lh |

TINEA World's

1's Fair Open

ore) Riek

Pay sxe ile

slide-009.jpg

OCR text:

Pad

V A ry Y

World's Fair yulon=<-Tae-} <1 m et ee(\r)

Taal Leeh ceil cme lant ia) 3 “eee

Lier —

es

* Dynamic agentic retrieval boop Ln

UD ica RieC anil od ee

Pama sieehce ce eth otameS TLS aa tay

Pate mCP ica iery sit leelay a ny

Pe

Pa Mem Ro PACs: Re Gla Mee raed Ra Pe —"

ce

World's Fair Ama eo as ~

https feaka ms FoundryiQ esas

OpenA tN)

vor ; , Fi ri

Engineering the future of Al

sien W

slide-010.jpg

OCR text:

sectior

Update

AIEngineer

EXPLORER

main.pyu

(1evoljsonfUx

World's Fair

AEWF

{“name”:“order_status_inquiry”,“query”:“Hi,Iordered a Smart Thermostat last week and I haven't

srciaiewf

agent_conngs

{name":warranty_clain”,“query":“My Laptop Pro screen started flickering after 8months.Is this

venv

(nane:“troubleshoot_thermostat”,query”:“My Smart Thermostat isn't turningon at all.The screen

skills

{“nane":"troubleshoot_earbuds","query:“My wireless Earbuds won't connect to my phone anynore.The

Fagentignore

U

PROBLEMS

OUTPUT

AZURE

TERMINAL

PORTS

dockerignore

U

PS C:\temp\fopt\aiewf>azd aiagent optimize status opt_3a57877364c84fa2b4fe39cbaabe175d

PRESENTED BY

erv.example

U

agent.manifest...

U

Results:

Candidate

Score Eval Strategy

agentyaml

Microsoft

U

Dockerfile

U

baseline

0.68View

[1eval-quickjsonl

U

candidate_1

0.78Vlew

systee_prom

(1evaljsonl

U

candidate_2

0.52Viewskills

!evalyaml

candidate_3

0.62 View skills,system_prompt

U

main.py

candidate_4

0.50Viewskills

U

①READMEmd

U

Candidate IDs:

Erequirements.txt

baseline

cand_5b4a46a388bb47fb8ddfdc54e64c6b2e

*candidate_1

cand_b6d9dab7feff48929e63e08282bd6acc

aoubgb

candidate_2

cand_7a088cf58b114461b8b32cafe5728d57

L.AI

!azure.yaml

candidate_3

cand_57bf26def3514a9388ed812845ac70bc

candidate_4

cand_e6be2af2a37e41ad9d936288953ef49b

OUTLINE

TIMELNE

Apply the best candidatelocally,then deploy:

azd aiagent optimize apply--candidate cand_b6d9dab7feff48929e63e00282bd6acc

ch

d'sFair

naino

uShre

Ln3.Col9Spaces4UTF·8LF(]JSONLines

bamy

927AM

Engineering the future of Al

slide-011.jpg

OCR text:

ALEXANDER

ROMAIN

EMBIRICOS

HUET

HEAD OF ENTERPRISE PRODUCT

HEAD OFDEVELOPEREXPERIENCE

OpenAl

OpenAl

AIF

slide-012.jpg

OCR text:

World's Fair a . ~S ie

; a oe 3)

a Microsoft aaa . ers hes care

a ey ra

4 A ola ole —_ a 1”. 2 es

arias.

Engineering the future of Al

4 at

slide-013.jpg

OCR text:

renee a a sa = —

World's Fair

7 o ose |

ee TT =

a Microsoft i oe. | s

| pa = sie »

Lh iy iy ; ; a!

ee | F i t 4 . |

Trae | ui a BPerUee LUTTE

, Keynote

ees Embiricos re rey T :

slide-014.jpg

OCR text:

“oe Al Engineer a

t aaa Crab aa eae as

ome ererermes 1 ce ae ee " ey I BR if Ree :

owe. as A ee ag

wa oe <

cae : wl Wy oC \ ra ee ee ee oe

.. Ms | ie

2 . arene ; Meranb os

aes WP de y ane Se a x Sa ae Raa nee eames eer a:

La De ee 5 Rees ee ann ‘ ARE enirae Es oe Dora a an ee

s Sema aa ‘ tl Rsodluaes : No ce eae ene PEs 2,8 Ae WEEE i Rs

oo 1? Sn Mich d bor o ine eas EOL es 5 area ee to ere ae,

Sar Es ne eo eas Fe thy * 8 Se NSE ee

F ad ca ree ee ae ee a Son ae ee e A v

Ree nae rant tL Sra Noe d Serra ag oo Sa oe ree? Es}

caer. 3 ee:

= ‘ ss

; ny

slide-015.jpg

OCR text:

World's Fair 7

i 7 r gn May

¢. : : a 5 7 :

F a ee} . : dP

| : i ae.

a Microsoft (~ en 7 | F ,

3 = - ;

— << a .

or 7 a L | , “5 7

aa noes oe wal a ie y

Nad ot

ai a Engineering the future of Al

slide-016.jpg

OCR text:

AlEngineer

World's Fair

Build anopen

ecosystem

slide-017.jpg

OCR text:

World's Fair | oe

eee Build an open

[Oferel> marae) ecosystem

World's Fair Models

rans

| Engineering the future of Al

f

slide-018.jpg

OCR text:

World's Fair -

TerminalBench 2.1 _ 3 |

ox ee

Engineering the future of Al

slide-019.jpg

OCR text:

AIEngineer

Cloud

World'sFair

PRESENTED BY

Microsoft

AIEngineer

World'sFair

Engineering the future of Al

slide-020.jpg

OCR text:

CTS ed

World's Fair

Wor' “air

[= Siecoaeea eS iy

Wo! oF oy ep oe ee

Pearl

te i

slide-021.jpg

OCR text:

AlEngineer

World's Fair

Paul Solt

@PauSolt-Follow

MyNEWCodexworkflowisbetterthanIexpected.

8new featuresready forrelease in my app.

bugs.Feels like the future.

PRESENTEDBY

Thanks@Dimillian @emanueledpt and @steipetefor the

inspiration.

Microsoft

10min

PRs

AlEngine

World's

W

W

Engineering the future of Al

slide-022.jpg

OCR text:

Deeg la) SE CLC nn

7 _ fidsFar Y Sore" Re eer Ronn en rail rene A

oe an TTS 7 UGE ToL Teg areronse en pelos

; World: * ernie snyk rare Fair

be ~ ra ota 7

; aay ma Pte Ora EINES rere a

Pera nag a , ,

ana 7 a Toe Ca ae

slide-023.jpg

OCR text:

ias Fair | al edi Babel

licrosoft | | ad Ee |

,

d's Fair [ Worl

Lightrun q She

slide-024.jpg

OCR text:

Fa

slide-025.jpg

OCR text:

an More than a “coding” model

World's Fair

: Not currently avedenie

, “ee He sarees 2. Antica) Anata

AAHAVOTAGEERERHGanee

GLELBRESI RI PSLARBE ERE ES BMG ESF

MPs CRY) SEs fh GF ELLA EMS Fi

Pane Oo

wey: ; ; ;

GLM-5.2: Frontier Intelligence, Open Weights.

as Zixuan Li Z.AI

slide-026.jpg

OCR text:

Z ZCODE ; a>

on oro ra a . A Af Ge Se es v

World's Fair a

PPE ike cesxene

7 a :

TOS

GLM-5.2: Frontier Intelligence, Open Weights.

op Zixuan Li y aN

slide-027.jpg

OCR text:

7 i alaietieieteingl = i ns ee 2 ee ee

a i. a ee aeties iL aL

ole ' VVJorld’s Fair ean rire) ale

r "oanea = A a OM Re ' at

a 5 DATADOG Worles: sae NS

7 a H ene te

7 ; a PV saeatas tf See lh tht

| Rack ANE las A Jorid

vy . ‘ Nerelelaloase im . , SIAN

—_ J \ Loe _

a a0 06 °

slide-028.jpg

OCR text:

a ae $.37 AY

<>) Wort. p wy,

a re yf UY

slide-029.jpg

OCR text:

a oa ane AM

1 (0) dls een )

7 / of We

slide-030.jpg

OCR text:

: Pane: 3 mal (e

TAY (ol ata een .« y |

fe

a

slide-031.jpg

OCR text:

| ae mse

TOT a a !

ae

| i f "tLe

slide-032.jpg

OCR text:

abl | vvoriaS ral | Atl a O Ry

AlEngineer —

| ey ota World's Fe

aR staleit

World; Akamai

a AlEngincer ——

| BAT, Ty ee ee

slide-033.jpg

OCR text:

ngineer

AlEngineer

d's Fair

Amazon

I Lab

World'sFa

AIEn

intrust

OpenAl

W-

ngineer

AIEngineer

d's Fair

World'sFa

W

DATADO

FLARE

slide-034.jpg

OCR text:

[ Wortd’s Fair |

Your agent failed in prod.

good luck reproducing tt.

\ &) Tisha Chawla - Susheem Koul - Microsoft

slide-035.jpg

OCR text:

# unedited, from the threads HARD DATA

r/LocalLLaMA 1,000 prompts

“different outputs at temperature = 0, — 80 answers

mostly the MoE architecture.”

temp O vLLM Qwen-3-8B

t/LocalLLaMA

“even at temp 0 you get different

answers, you‘re using GPUs.”

Hacker News

“completely correct or completely wrong,

depending on minute numerical diffs.”

slide-036.jpg

OCR text:

X wrong question: can we make the model deterministic.

V right question: can we debug & test a run we can't reproduce.

@

slide-037.jpg

OCR text:

7 My actual job is carrying context

5 A

World's Fair |

Dozens of projects, different col abaratars,

and loose threags that stay open for weeks

Decisions travel thraugn Siack, email,

meetings, documents, reposttanes,

spreadsneects, ana people's heads

fay

t cig |

: Engineering the fut f Al

slide-038.jpg

OCR text:

re Three acts

Retee of working in Codex

. Microsoft

aa lel ayy

af ce

ia NL Engineering the future of Al

slide-039.jpg

OCR text:

Peed ; ,

World's Fair Build your own plugin

Vans geyser eenentce

a Microsoft or ; Te ne

SS mete

manne. Ne YeepMir

ri

; tas Engineering the future of Al

slide-040.jpg

OCR text:

PM apevaeecg :

World's Fair Self improvement and memory

Exel area [a] : : [a]

TRG 4d

elem tas

Re Sea

an [ahaa ee | ane

ec ware Pa ae [a]

aoe ZA

a

wo ON Engineering the future of Al

slide-041.jpg

OCR text:

ae “° Get me refunds, fill out forms, coordinate documents

World's Fair ~ Test Native Applications

Weems Orel) ¢c0) aah’ malas ale)al-mar-B-\ek 1am aay acelalale|

ir LN

. "5 Fair

- - Engineering the future of Al

slide-042.jpg

OCR text:

Alora te bod orl g

# unedited, from the threads HARD DATA

r/LocalLLaMA 1,000 prompts

“different outputs at temperature = 0, —~+ 80 answers

mostly the MoE architecture.”

temp 0 vLLM - Qwen-3-S8

r/LocalLLaMA

“even at temp 0 you get different

answers, you‘re using GPUs.”

Hacker News

“completely correct or completely wrong,

depending on minute numerical diffs.”

a) f

slide-043.jpg

OCR text:

Pere

Reet

HE agent replay whetedoard men ® oO sn0 (Q)

She ome mer Otaw Deen Thanuhoms — Anematam Shue Show Renew Vaew Help. @ DD cconmeets Prnet ~ DP latayy

® g

*

" . P|

‘cette 1

Ww

~“

13 cas esasg

« ,

waar) :

DT

slide-044.jpg

OCR text:

ene Fair ;

as ; Pomel se eh ole wee Cle Ci ele ee ae eT)

World'sFair| = geveloping software that runs autonomously

a Microsoft signal > triage > plan > execute » valiaate 7

; ceria nee on

en aarel a /

mi Engineering the future of Al

slide-045.jpg

OCR text:

folate kala

Ed AUYVPLINIY ALIS TUL LIIe SAIC ad VOEIMIY VUILL UII AI

‘ a

World's Fair |

Al Implementor Loses Its Sheen

" : a

80% C1Oh ae a1 Ob.

of eng-neering time :s not Accerture’s cash- low ' \

; . writing code fare OR ma Cetial Mts eet ih,

mnie cexe)s he a! ae wih

a . A Hy of

x Rut vai} ie rh Re

es , we “

Gap between Al ieaders and Reveaseso: tims en \

lagqards -- and st ll widen.ng Seana cn

SRR aa O nas Ola aes _ | sae

transform SSMS . .

Engineering the future of Al

slide-046.jpg

OCR text:

Nie We need to build software factory

es primitives that work for everyone

Work across interfaces

5 e Cloud, loca}, CI, or IDE - In what domains are agents deployed?

one agent?

7 Microsoft e nnd fare) ; —__-"

e =6Portability beats lecK-in ” =

Works with your subscriptions i =

ry Bring your own model keys - . ’

os : : e Bring your own machine . wt

Engineering the future of Al

slide-047.jpg

OCR text:

ola Routing doesn’t improve just cost, but also

es reliability and speed

oer peek pala

a Microsoft eruRe ron Coa 7 99% sal

price, uptime)

Ce Os ohe tub ee eale)

' acne fara ree 20% rer

a Engineering the future of Al

slide-048.jpg

OCR text:

meee —— Factory Missions nail the validation part

World's Fair

ta at te Ce ele

ree ra ae . 185 agent runa

se ee CMM SCUCT SST (Case

RO C20 lc Oa eee es)

Les eae 2) tLe

F . 27 validators (+82

OT ae

. Py rat ee Mee el eee

a Hi rs ye

| Microsoft ATites validation contract nines on haha

9.98n (68.5%) CU rats 3]

Fresh context per feature Adversarial review. Never

Tests first. then acplement, seoo the code. Surfaces gaps,

commit, and nard off never fixes then

Engineering the future of Al

slide-049.jpg

OCR text:

eee In Al adoption, you either

9, bs . . a

World's Fair | — succeed big or fail big. monte ng te

e Gap between leaders and laggards Ht

; in AI has been 12x in last 3 i =

7 years, and continues growing " ee a

o H _— — ie “_

a Microsoft e S§tructured AI coding practices d -— Sa a

cut code quality degradation Pooteeiemy Gates by Tas & depres Overt Apri 204

from AI by 3x . aida

e 30x productivity gap between . can

leaders and laggards eo a

: —_

| Engineering the future of Al

slide-050.jpg

OCR text:

AlEngecer Stop repeating to agents how you

leeks want things done

Plugins

a Microsoft |

EVhee bee

Context engine

Engineering the future of Al

slide-051.jpg

OCR text:

ree ;

World's Fair

——s

Step lof 30 - Browse? Nawiqutice Chatenge

0. .

Na va poe Tetsage he cone tctoe ao - Click here for amazing desis!

Sane coca seca aay co cere 8 vena pocue meine fata tone

cs ware -

a SS

Ee WR Sine emia em dare

Becton? meets alerts e

3 - © ~~ Th a a ote “ata Te cove tor

Fate Se ONIN eee

Secton 3 we &

De atm

none ESD

IS Tee

cS

“This Claude with Chrome

} @ tecnee | trying to navigate a browser challenge

slide-052.jpg

OCR text:

Ree

: : ae 1 abet MAK ced sha wa DRS eaten hed ender dich DleatG wut Deed woe cli Sods dons;

7 ce 2. cay eecedrtd riahulll; ecg wah, timid he myer df waden) Mchabd atth cnatts checkin mechs andes! At

tndeed oG) Sabah, ababs

. LDL Trees thous De boceed otteat! | Gayt m odrance further advance DOE ng are Ghowed ory upto S dayt

sien ee eee

=

7 : Dicer tM vev Enea)

«Ilr. e UL AleSE tx MEAL Lory

Ed apneeenenes

ieTUUNOURI RS SET 2OT I)

7] : bs | _ =:

; 80898 reo © O@ FB: -44+7 °C" OG OL

aOBSs ae Yd CO Oew®- -44+7 + Q@rvOGe Qi

slide-053.jpg

OCR text:

orate kala

YX

; ch tb,

2,

cog an ~

The Agentic Al Engineer

An Al agont is never “done.” It lives in a development loop — and the speed of that loop is the whole

gamo.

® ¢

CO EE

slide-054.jpg

OCR text:

| St

Fer nCrntaee Gere ears etre

Reet gee € ee ee eee

o ae rar Scar

ee a re, ee 8 8 . of _

A , en saa ae i 1 “ are vi \ 4 ar i mn care A as one AL

7 mn or. oe 7 ne cp hee EG Sans

ce er a ee eae Mi dial ree ene eee a

Fe i 7 cea 7 a

eat in ane dare te i cael ar) i} or a Se

ee en a | y ee 2 am [ ao

con aie a ace ene

SPE OnE 7 PETE Ta

RL ee Oe ee eT

ell Vitale 6h

eet Meo Ee ats ee en or

} |

slide-055.jpg

OCR text:

rete |

. an 1. Stay near the frontier

WorkOS World's

ate aa iS erenr an

oa ae Engineering the future of Al

slide-056.jpg

OCR text:

fCreate PR

AIEngineer

CConductor

World's Fair

test.py

HiCharlie!

Whatcanhelpyouwithtoday?

Isee youre on the cohi23/test-python-f1le branch andtheres

PRESENTED BY

/api0bb554a9

Microsoft

Pr

ORumingincoui

[vercel-sandooxg7cb9c1b-7]

acels

AI

Nedak.2a/s

Fair

Engineering the future of Al

slide-057.jpg

OCR text:

World's Fair ;

1. Stay near the frontier

2. Don’t try to beat the market

3. Create slop-free zones

4. Feed the beast

5. Free-range agents

6. Orchestras, not factories

| wy

rs

| Engineering the future of Al

slide-058.jpg

OCR text:

World'sFair

You are watching an AlE Online Talk

Pre-RecordedforWorio'sFair2026.

TWOBRAINS,ONEREVOLVINGDOOR

Every time someone left,the company forgot a little more.

slide-059.jpg

OCR text:

eee slg

NINE REAL JOBS, EVERY DAY

‘2-4 "a Wy ec

te >). 2 ae

Rie = | a

e rc ie Cy .

tap, Pt cole |

a , os - <— sa , KS 7 "

slide-060.jpg

OCR text:

Seid rd alia’ ee Wer he tt Pee Caan mow ral weet Senter

re ee 2 iy erry ad om et Sear wee re be) e

See 5 ete STN aI een ES Oe ee corre mre

od went fine eed rs A a re ona i

rd Pree) end a) eed etd 5

Ree fies een a e O or

<> tt &. 7: | World's Fair | =." = -

Ve meee Pa ned o ee ee *

er ts id Ca oe or ae

. ed aed er ere red men oars ore ons Pr ered wie

mente Be ed oon Sead yan ered ~ ted cael ed oa.

Peer ee a ere etd ree wet tae mne ae aed ern ee or

eres el rary roy vents eter oe oreo oe tome poeenr ns ww oot

ee ee a ST Ci) Sed erred — aed Pa wean tem

Perea reed erry ny ory ere — oo rere ees yee wee

agen «EE ‘ . wine an erry 5 eres Se Co ti ro ead a e

wn te oh teat weet pirene ern Steen on = weet

roa) f re toe eed Cte eed ro ined a % c

Cad aa i Dane ead eae

slide-061.jpg

OCR text:

AI Engineer

World's Fair

slide-062.jpg

OCR text:

Rei

AGENT

Things overlap in weird ways, you can't see the text,

slide-063.jpg

OCR text:

World's Fair .

Imagine a language that...

describes visual layout

has mountains of training data

models understand it intuitively

renders straight to pixels

runs basically everywhere

that they understand intuitively, that renders to pixels and can run everywhere.

slide-064.jpg

OCR text:

AEngie

World'sFair

You are watching an AlE Online Talk

Pre-Recorded for Worid's Fair 2026.

slide-065.jpg

OCR text:

Ree

Sen Pececi ne teliaeran (a ict onc ee cto ete eee Te EL OLentreeerae Oe

m ;

-

Aa

slide-066.jpg

OCR text:

AEngi

World'sFair

You are watching an AiE Online Talk

Pre-Recorded for Worid's Fair 2026.

slide-067.jpg

OCR text:

renee ltd

This is when productivity

Designer pT=a) QA

Works directly on running code yo eee ae ey oe RY Tells agent directty in browser

eee

7 * Ba Berets ist Rata e- eV iiss) seh

slide-068.jpg

OCR text:

Pare 3

Ree

IRA © MACHINECRAFT

Rushabh Doshi «° Machinecraft - AI Engineer World's Fair >

slide-069.jpg

OCR text:

. i PAs ra aa Sara tae a ag

can (0,0 Ue _!| World's Fair ae matome ale ko ar: ) 14

or ° 5 DATADOG LV, (0) gn . Re) Mowet!

7 7 —— AlEnginecr t

em (°\ ae ko a1 14 ba atslYisvalh) Ey ¢

er a

cf reais

|

q , N a Ore) io) : aan s

slide-070.jpg

OCR text:

WY

esolve

ineer

Ravel

sFai

AIEr

slide-071.jpg

OCR text:

oe DON

el

Nal nts lVou 3Fa

slide-072.jpg

OCR text:

| a cee ee het nl | Baa Pd

v4

——_—___ | —_ Fi a1 a : a

a) ar 7 . * ae )

rll an eae

——_—! a ne ; a

~ D

v Na

7 ae i) a ©

STS &

slide-073.jpg

OCR text:

Sa RO) atone

Rave -air

slide-074.jpg

OCR text:

syLal

ZERZ

:Fair

slide-075.jpg

OCR text:

|

ose Jaz

ae

9ercor ‘or :

a ells

slide-076.jpg

OCR text:

eee tbe

AI systems evolved faster than fi

our evaluation methods

The Illusion The Reality

. AAA - ta Modes

z Behavior

—_— a

Reliability Gaps

90% 25%

Benchmark Accuracy of

T-0 T+10ms T+S0ms T+100ms

slide-077.jpg

OCR text:

Agent-First.

Ma lraxekxese

’ Google Antigravity IDE 2.0)

ir | ommeny\ eee ae Coe

a t a4

tf Engineering the future of Al

rl J 7

slide-078.jpg

OCR text:

AIEngineer

AGoogle Antigravity

World'sFair

PRESENTED BY

Microsoft

Autocomplete-Chat

Agents

Agent Manager

Embeddingsearch

Chet-Agents only

Multiple agents in parallel

Rulesfiles

Customtools

Skills &plugins

Code snippets around cursor

MCPserverintegrations

2026era?

Tree sitter ASTparsing

Hooks

Permissions

Artifacts (ie.plan& walkthrough docs)

nAI

Deterministiccontextretrieval

Agenticresearchforcontext

Agent-first management Uls

f

Fair

Engineering the future of Al

slide-079.jpg

OCR text:

Id Biases

World's Fair

| Worl! Far Scaling with intelligence isn't always easy

orm ewe

mE Viacerxenie 7 ferns a

a | Engineering the future of Al

slide-080.jpg

OCR text:

Ela S ed ery aoe a

World's Fair

P Reeryeriorerels and

@ £8 papew atid -0 Gearon 9

_ -

=

a -

-—_

ENA les\ahe Malas] sae) Gemini now much better at

| Google™ Mind aarcTATet LIAS Ratet Ua eM lan erzec) (cl managing agents in parallel

an

° cd

| Engineering the future of Al

rr

slide-081.jpg

OCR text:

AIEngineer

AGoogleAntigravity

World'sFair

CUSTOM UE

URAGENTS/TASKS

LEAO AGENT

Googler

Mind

AF

Engineering the future of Al

slide-082.jpg

OCR text:

Ea Sead Po ned .

World's Fair |

: Hond engineenng a abell.ng judge Niale Rorelgeri arts

. Mi ft Type the prompt yourself for each phase of Agent sets up the subagert qraph:

| | Icroso pipeline and scrape the eval data:

Nae enaneenng dane by the user

Write async poo: yourself to fan out to 100¢

Judge processes Generative Up vars decat plug ntyutens

Shared wath the entire Getr pr research tear

Fear a ce Bee es eT eT

: . - . - ;

eT] ay Fae Oe a ee ne eee

alr a

os I eed

oo A

3 Fair

ae ° Cd

oa i Engineering the future of Al

oa =

Lae ]

slide-083.jpg

OCR text:

PU Spend Genomes

World's Fair

ee, °

: Long lived utilities ser the aa ioe ae ©

. Neen model can run & edit itself. on

on a

sires esaesnea tee a.

} oOo 4 an -—

rs

po Engineering the future of Al

rn 7

slide-084.jpg

OCR text:

World's Fair

Get out of the model’s way

With the right primitives, the agent can do more than you expect

J oy an

nd

7 Engineering the future of Al

4 Iva 7

slide-085.jpg

OCR text:

World'sFair

You are watching an AiE Oniine Talk

Pre-Recorded for Worid'sFar 2026.

specification

implementation

slide-086.jpg

OCR text:

as ne

er en

A cd

ee

aera enn EE OO ENE nEOENan EIN

slide-087.jpg

OCR text:

Reco The evolution of

agentic development

a Microsoft Chat Al Autocomplete Interactive Agents Automated Agents

‘air | — AGI

gUrS} _# cs *

‘air | os Engineering the future of Al

slide-088.jpg

OCR text:

ie eres enn . olarz=) | en lg reducto a

Lab eee, Microsoft Wenta | male . eae enee rel P

ie OpenAl Wee et ov ae ones re ZAI Vv

i World's Fair yen . / Unblocked . Velate ae :

vig - DATADOG World's Fair . . 7 aa | World's Fair cq Vi

io ace Fair Ni Ch A

is menial OCR ait | ce | ener la

Mn \

ar en 0 0 ° a ioe) rs a -

slide-089.jpg

OCR text:

Ls eee ee a a

M4 j eke 4 Ecard ne Po wm oe ie -

Str eee ee ear gle fen age f3,

tod rs ae ih en ere aE iene, LL

|

N ; _ — 7

8 Ri Seen

Pe bora cee S _

he i

# , % cs . ae

ilisaine ates rasa pan|

Wis Gs! baa 23 Peaks ned

a 2

2

, a ; at

ne fra an

ee -

a ae “4 a | gS 7 wml i 2 con oa

slide-090.jpg

OCR text:

eee izle

Agenda

| Meet OG Assist

2. | The Origin Story

| Betting on Effect

| The Core Agent Loop

s. | A2A. Evals & Sandboxing i

6. | Long Context Handling f

Monitoring & Observability ‘ q

3. | Tools, Skills & Dev Workflowslong context. We're going to talk al Ss

slide-091.jpg

OCR text:

reese eld ;

: a

id H

“ ee ee a ape ste sees a eee + 8 @ — Onigin Story

Cle a. a: 00 hase :

One bet on

DR nwo meee Eres sore seria on, + canes een — ce

— concn agents, one

Dery tenes OW onateng, Les ot Arment Oammt Total Parpments lates Yetey

O --— $69 oO eee a .

: : immediate yes.

Cet erpte try Payment Mates soe ant

oO ae . TTT

Your baling brestdown ewats: eee g eee A principal engineer spun up a team focused on Al agents and

eee paca . ° asked me to join. OG Assist grew from there. We started to

« Bee eee - . 4 integrate deeply with our products through frontend and

backend tools.

Okay, so just a

slide-092.jpg

OCR text:

AEngi

World'sFair

You are watching an AIE Online Talk

Pre-Recorded for Woria's Fair 2026.

OpenGov

Effect

ontheagentsteamreallyhelping

slide-093.jpg

OCR text:

Poe @

Ree

Example oe .

wtnver s Cnat. LanguageModel fon HRs wpa O t |

start Effect: Stream tras “etter® 8 if age al (ole) OF

.

// Steeaming chat with tool support b Bi

const streamingChat - Effect gen furctione ao eT

const chat vievce Chat empty Eff 5

ect-native

yin’ te chat Cy

streanText

prompt “ieeeeaste a cteative stat”

pipe Stream. runforEach. part =~ Effect. sync t+ console log part

language model if we were to uh

slide-094.jpg

OCR text:

ene Fair

OpertenF ier pang. tem ee ee eee fate ne bm me oe ® evi eat,

Cloud City, USA Eueiserece , S h . . r

ee oreersit ipping is the

Rwesttte | Rventinen cee: ann. foes nme oo a penates wn eseca

vse =——_e_ Start, not the

Onryt tates Outstanding tetas Amount Cured Totes Payments Taken Todoy Negeri Menegemes Conte

Q nee $69 Oo capcom caer ecer ea

Os Pos eee a nis h ;

Recowns by Poymere Method ee Tere teersien Note

O mo, -

Your bilng breakdown wets! eee + tee ee re

Cr eee Bam nme tas mama ge we alae ¥ ° ee ee ee eed

wt ne we be . * - - can hes

ways we do evals and collect ( \

slide-095.jpg

OCR text:

AIEngineer

World'sFair

PRESENTED BY

Microsoft

(4}ALIALL

woria'sFair

Brarust

Engineering the future of Al

slide-096.jpg

OCR text:

en Pamir ,

World's Fair en

nn Ode _.

roo a ae —

sae an Ao we

a ie f

ia Microsoft ean s ee

- ; Ne ; “ 1

ee lL ae . . i re

: iia ae a 7 oan,

atiere le Goa arc lim a d ; a

PS en ere ; : ae 7 ; >

- Engineering the future of Al

slide-097.jpg

OCR text:

AIEngineer

World'sFair

QUESTS(6

CAMPAIGN

TRACLS AHALVTICS

MEMORT

rld'sFair

AIE

rowserbase

Worl

AlEng

rld'sFa

Crus

Engineering the future of Al

dailv

AIE

IAlard

slide-098.jpg

OCR text:

AIEngineer

World's Fair

We'renotalone

TEAMMATES

-air

MINIMA:

HERE NOW

NETFLIX

AlEn

base

orld'sFa

-air

be游

Engineering the future of Al

dE

slide-099.jpg

OCR text:

World's Fair |

We raised the ceiling

m Engineering the future of Al

slide-100.jpg

OCR text:

= ae gears rete Hi . ower. A - S a ; a a

“tooeeer pe. ar a A

7 3 A a Mer eg Se peter og EROS Peo se

World's Fair re eC h cere Ce ma Re

Re ia eee if FON

ae EEE, ©. checking the product guida er es eee ae

sg aw ). guidance before!... » -*q , hae eo Kae i

FT Ae a ae pa

PA eo Ss Se ; oe ear

are See eo i YF oe mary ed

sy 4 Pad ; fe rn A Es ~~ o* a tt

pk a ee 5 af et NS ee

ic a _ ; * es iT ee: oy i) fi Zs : : «, a

a x aed ¢ > a i A Ae

a 5k oe O ed - a

mal Pao EB ~ ~ ne oe oe

<. : > ee eGo 7

elt wedding vow draft v= A ea * v cn

- s = ian ra y..

by low “~~ os ae:

STE AOrs! Cenk = > ~~ arc Pres:

ere a a 8 seine: a te age

P Rd Pa wo eS re Fe ee re

_ 4 care 4. . Coe Tbe T+. See

I's Fair Bone. 7 > e 0 . s “ a : Siete fats ey ae eit * "7 met ~ a

aa : os iar > < ee ii eas a4 7 . Cn ele a { or aaa

= ne Somer ne Rr ca 247

aa fortd’s Engi y th f ri

Petes an

slide-101.jpg

OCR text:

World'sFair

You are wartching an AiE Online Talk

Pre-Recorded for Worid'sFair 2026.

User Signal dies at the

Retrieval Boundary.

Sonam Pankaj

CEO&Co-FounderStarlightSearch

agentRTX

slide-102.jpg

OCR text:

The missing layer between evals and action

Observability Ae

Your observability ; ; The GAP

stack captures every [i= €<-

tcall,everyLLM & ne

lompletion, and

‘very exception.

slide-103.jpg

OCR text:

In practice, most agent memory frameworks have focused on user continuity: preferences,

profile facts, conversation history, and long-lived personalization.

chat experiences is not self-improving learning system for production agents. Gg

Approach What it stores Retrieval signal Learns from outcomes?

Somerset WA om Raa chat history Recercy Ne

wemente memery '/ ae tatracted tacts preference, benbedaep ue iarty Neo

\ lemporal inwatecge gape ot. Petty relations) ps cee hme Graph teawerad srececcy NO

' Partial, reotection: capture

Temaec + Refhowen verbal sett roflectices, Sm aety TOCUTORT Task lessens Dutreteega seat

farsed Dy Outcowe

Tae med rete ors tthe Sem acty wegnted by wa Fogerty

“ i staan ceo ty vee

i

slide-104.jpg

OCR text:

AEngi

World'sFair

You are watching an AIE Online Talk

Pre-Recorded for Worid's Fair 2026.

*reflect

Features

Cet Started

HLE

Lifelong-D

dedgeFront

DeTask

pen

slide-105.jpg

OCR text:

World's Fair ed ‘

Your supplier is also your competitor

SLES EES Lock in with no exit

Fie changuard foe oh al eoehesego

Value you can’t defend

herueecctte ier aatiail

; Engineering the future of Al

slide-106.jpg

OCR text:

AIEngineer

World'sFair

Tellpeopleto

ouy NotionAI

ALE

raintrust

Worl

AE

rld'sFair

tos

Engineering the future of Al

AIE

Worl

UDFLARE

slide-107.jpg

OCR text:

ee? Show anetes teats :

AS Engineer

‘i ~ B Noteon Ha V ay Seem cette bax am tee OS

World's Fair » FL aR as nan an ana RST RMT RE

1h Crate Agere

Cerue D OR te the fe gcany ont Damn 8 [onpamded by Geter) haved on Ihe yer cetee sh

TN 2 ner 6 CoMONECE HORTON A Grace meth tod bacagrourd + sinmattrogy for ae P Bloce

TrOwe Meche Gees get 4 gerene fdacerinaer Deleted lapye CAG wn ‘ender Gathered rare A

*Canbage Genes Ua a BING UES BIN FOG) oF Ihe TT woth wR Age Dir entOe 1 tone et

Wate o wacenets

00 PIRAT Sere ae teted DINK OM owe

Case arpane:

* Cotrey

fen Can yeu renee the be?

@ Codes Agent

Revewsd 19 63047 — overs tye okt told and ihe UX dvectan meses rerio

103 Catch: Dap Samal thang (7p case where Te deleted SracAre CALE Deg Some ran Neat Sete

IRer CENT and U2) a ground yt Cate IML ORAS mene ere

| pried fume te BOY ipa A Qare AQPELAEY SONt) Shen ba 3600 12 Lord ence Cl a gener

ar 4, I

a f

re

; Lies.

slide-108.jpg

OCR text:

World'sFair

You are watching an AlE Online Talk

Pre-Recorded for Worio's Fair 2026.

OpenGov

Effect

ontheagentsteamreallyhelping

slide-109.jpg

OCR text:

rare s

Rei

Example a gammy

strat + Chat. LanguageMogel fear Tt tena” O Fs e i | re)

CL Ge emenmones ur agent loop,

a

+/ Streaming chat with tool support = b hg

const streamingChat Effect.gen functions fs 8 I

const chat sie .Ge Chat empty .

Effect-native.

yie’ te chat

stregnTert

prompt “Lecrrgte a cemative stata”

Pipe Stream runforfach part ~ Effect. sync “+ console log part

we could pass in a different

slide-110.jpg

OCR text:

eyes ete

Opener FT ity Rang. tanmee e teteen meeps wet tte dee tom ee 0 @ or ee

Cloud City, USA uroniseee ‘ S rr Fi 5 P

omen ipping is the

Prmerntte | Bremen Sa" ern. fone ee 2 cccmenenee em

ne Sooo eee alee tars

Ouys Lanes Outetanceng, fetal Ament Cured Tota Prpments Taken tedey ore Ae Cot Rempel Cater

Qo wens $69 o sagas beeen eerie _—s

ot > ee a] nis h ;

Roc enp's by Poyrnert Method ate Anerng be Se seeton oer . :

wee ‘ a si oe ae ~

O , . -

Your billeng breakdown mwerts' eee - tee ne i eo ni

oo ea econ tee me eer err errr

Cee ee ee . = ” ns ad

team is we have kind of multiple ( \

slide-111.jpg

OCR text:

World's Fair

Pleats croate a POF wth beaut at to

greet the folks of the Al Engineer

Corterorce 7076 Pisate allow me to

Gownioad +t to share with them

aeerege & Sandboxing

Done

oat ne nln MN Room to act

ond made it wreisble for donnioad T incudes orginal Ai 3

Epa GENO ative art Worl and 8 warm greeting Mestage

tor comMerence attendees

safely.

in) At Ungerer Contorence 2026 Greeting FOF

© comes

ho se

Code runs in isolated sandboxes. so agents can take feal action

without putting production systems or customer data at risk.

hype sur menage a.

& ¥ ——

wees Or tries to create files, it does soina

slide-112.jpg

OCR text:

-pun

UpgradetoPro

AIEngineer

Fpipeline.baml A

Faoent.bamlA

Esimple.bamlA

Fcalc.

FBAMLPlayground×

World'sFair

baml_src>ns_images)

Fpipeine.baml

sictx.output_rormat;

udeao

Trace

FLane

QSearch functions

Mode:

Include

function inproving_inage(goal: string="a founder building a progre

POpe

Function

Origin Thread

systes

calls

leting:inage=generate_inage(goal);

let judge:JudgeResponse=evaluate_inage(ing,goal);

FUNCTION

ORIGIN

SELF TIHE

user.inages.inpro.

0.06ns

letattenpts:int=0;

user.inages.gener-

s.genera.

vhile (judge.score<e.956attenpts<10){

iser

9799es

ing=generate_image(goal);

judge evaluate_inage(ing.goat):

user,inages.evalu.

User

6467ms

return ing:

user.inages.AiGat..

0.16ms

FE

.<tagged(generate

0.01ns

class JudgeResponse

score:float,

reason:string.

inplements baml.ToString

function to_string(self)->string throwsnever{

oFair

return'Score:s(self.score),Reason:s(self.reason):

main*+Launchpadweek-2O0Lve ShareGitGraphBAML

Engineering the future of Al

slide-113.jpg

OCR text:

pipeline.baml-ale-indexAdded

AIEngineer

Fpipeline.bamlAX

Fagent.bamlA

New Agent Terminal

World'sFair

baml_src>ns_images)

Fpipelne.baml

s(ctx.output_rormat)

function is_true

(assert.is_true)builtin>/assert/assert.banl:4-1e

// Hard assertions - throv and stop execution on fallure.

Op

Piayoround

functionis_true(condition:bool)-→null{

functioninproving_inage(goal:string="afounder builds

if(icondition){

let ing:inage =generate_inage(goal);

banl.sys.panic("assertion failed:expected true)

PRESENTED BY

let judge:JudgeResponse evaluate_inage(ing,goal)

)else.

null

let attemptsi int=0;

Microsoft

vhite(judge.score<0.956attempts<10){

ing=generate_inage(goat):

o(aie)vbv@Vaibhavs-MacBook-Pro-3aie

references (e):

judge=evaluate_inage(ing,goal):

return ing:

class JudgeResponse

score:float,

reason:string,

inplementsbaml.ToString

6E

function to_string(self)->string throws never

d'sFair

return'Score:s(self.score),Reason:siself.

d+

Ln30,Col1Spaces:4UTF-8LFBAMLPrettier

te

Engineering the future of Al

slide-114.jpg

OCR text:

"eva (e ka 2) a

_ BAML is a data-driven language.

Seed

Ae te pp FRM ar eget we at ae ae od ehat a ee feed

ue @ Re ete neeteee -

a s, Sateen

° Senisheqpremeanien wspuumemen ous on basal

i" (Ge cE RR, SERIE, 00h cI OE hee thy SUE STO

a

ee

SRAL ms aoses't reraon Dap shel retin T? (opted. cautang @ compute error

«Nem ogere

Type Scr gt bie tyre made the Beas Erredaton a drect Uansaton

rece

| t's Fair

band apert

wer |

oe i ; i f Al

Coo Engineering the future o

slide-115.jpg

OCR text:

handler.baml-aie-IndexAdded

Upgrade toPro+

AIEngineer

World'sFair

aml1,M

handler.bamlAX

main.pyM

baml_src>ns_timer>Ehandler.baml>.

main.py>

Open

Playground|You,1hour ago |1 author[You)

function with_timeout<T>(millis:int,f:

let work:Future<T,null>=spawn

f()

def safe_python():

defwork():

PRESENTED BY

let timer:Future<never,baml.errors.Io

tine.sleep(10)

baml.sys.sleep(delay:baml.time.Dur

return"Done"

Microsoft

work.cancel():

throw TimeoutErrormessage:Oper

#Set a timeout of 1eee milliseconds (1 second)

result=root.timer.with_timeout(1ooe,work)

print(f"Result:(result)")

let result:Future<T,baml.errors.Io

awaitresult

class TimeoutError

message:string,

AL!

Worl

implements baml.ToString

function to_string(self)->string

raturn calfmeceane.

main*+Launchpadweek-2

@0A1

Live Share Git Graph

BAML

UTF-8LF()BAMLPrettier

Engineering the future of Al

slide-116.jpg

OCR text:

renee Fair .

The Paradigm Shift: Output vs. Behavior -

Traditional LLM Evaluation Agent Evaluation

Wie a eee Oran itah Te Sennen

Multi-path & Tocl Dependent

slide-117.jpg

OCR text:

eee 1g .

Offline Evals: Scenario-Driven Simulation ee

PO ee eee

i

Agent Sandbox Discrete Outputs

Test Runner : Leama Cas Ges 3

i Tools Update Completion Rate 98.5%

\ Tool Correctness 166%

\ Plan Quality High

- i: Simulated Cost $0.65

Scenario-driven, not prompt-driven.

slide-118.jpg

OCR text:

World's Fair

We're all building loops wrong

| V

: . a ie ee Fr rr ee Eo ce rere

c

slide-119.jpg

OCR text:

Eaten od

World's Fair

Ps Peter Steinberger

a

Don't worry it'll take 3 months until it’s there.

We'll be talking about fleets that design your loops then.

Ree PV

: re ee Pi aden 2 eres an

$3 Br A -

W e e oe

, Engineering the future of Al

v7

slide-120.jpg

OCR text:

World'sFair

You are watching an AJE Online Taik

Pre-Recorded for Worid's Fair 2026.

specification

implementation

Slide-Derived Subjects To Review

Subject extraction uses video title, related session titles/descriptions, transcript context, and OCR text when available. OCR is best-effort and should be reviewed against the embedded slide images.