Slides: Fun stories from building OpenRouter and where all this is going - Alex Atallah, OpenRouter
Source Video
Fun stories from building OpenRouter and where all this is going - Alex Atallah, OpenRouter
Relationship To World's Fair 2026
These slides are extracted from a public AI Engineer YouTube video connected to World's Fair 2026. Speaker-matched clips are supporting context unless later confirmed as exact session recordings; official livestream recordings are day-level/event-level source material.
Related Scheduled Sessions
- No individual scheduled session mapping has been assigned yet; treat this as an event livestream deck.
Extracted Slides
OCR text:
aWS
eee)
@®Graphite WW Windsurf 4 MoneobB
Mdaily £3 augment code WorkOS
OCR text:
vee ere Inference may be the largest market ever in software
ee K
Weltn? Vo1
ve
mney i a
iN
IN
Avice ALEX ATALLAH < OpenRouter
OCR text:
January, 2023: Moderation
r/ChatGPT · 2 yr. ago
Noobrage2112
OpenAI Banning accounts.
Gone Wild
Hi there,
After a thorough investigation, we have determined that you or a member of your organization are using the OpenAI API in ways that violate our policies.
Due to this breach we are halting access to the API immediately for the organization Personal. Common reasons for breach include violations of our content policy, repeated attempts at disallowed use-cases, or accessing the API from an unsupported location. You may also wish to review our Terms of Use.
If you believe this is in error and would like to appeal, please contact us through our help center. We will review appeals within one business day and will contact you if we reinstate access to the API.
Best,
The OpenAI team
That was the E-mail I received just a couple of minutes earlier.
It seems OpenAI does not appreciate people using it's program for D&D/ Text based/ Roleplaying/ Fictional based adventure games that might entail forms of Violence/ Gore/ Fantasy/ Erotic/ Fictional gameplay.
I had just purchased an account for the Beta Playground and shortly after I was removed. I'm not going to be supporting OpenAI anymore after this action. I don't appreciate the weights and aggression they have placed on the filter precautions, and I feel this is highly unfair.
OCR text:
World'sFair AIEnginee January,2023:Moderation
OpenAl Banning accounts. Noobrage2112 r/ChatGPT-2yr.ago
orld's AEngin Hithere, OpenAl APlin ways that violate our policies. Gone Wid
for breachncludevioltionsofourontenlicy,repeated attemptsatisallweducasesoraccessingthe APifromanunsuportedlocation.Youmayalsowishtoreview ourTermsof Use.
Worl AII appeals within one business dayand will contactyouif wereinstateaccess to theAPi.
The OpenAl team Best,
That was the E-mailreceived just a couple of minutes earlier.
orl A 1had just purchased an account for the Beta Playground and shortly after I was removed.I'mnot going to be supporting OpenAl anymore after this action.I don't appreciate the weights and aggression they have placed on adventure games thatmight entailforms of Violence/Gore/Fantasy/Erotic/Fictional gameplay the filter precautions, and I feel this is highly unfair. Itseems OpenAl does not appreciate people usingit's program for D&DyText based/ Roleplaying/Fictio
World'sFair AEng Engineering thefuture ofAl
OCR text:
February, 2023: Open Source race begins...
[D] List of Large Language Models to play with.
Discussion
Hello! I'm trying to understand what available LLMs one can "relatively easily" play with. My goal is to understand the landscape since I haven't worked in this field before. I'm trying to run them "from the largest to the smallest"
By "relatively easy", I mean doesn't require to setup a GPU cluster or costs more than $20:)
Here are some examples I have found so far:
1. ChatGPT (obviously) - 175B params
2. OpenAI API to access GPT-3s (from ada (0.5B) to davinci (175B)). Also CodeX
3. Bloom (176B) - text window on that page seems to work reliably, you just need to keep pressing "generate"
4. OPT-175B (Facebook LLM), the hosting works surprisingly fast, but slower than ChatGPT
5. Several models on HuggingFace that I made to run with Colab Pro subscription: GPT-NeoX 20B, Flan-t5-xxl 11B, Xlm-roberta-xxl 10.7B, GPT-j 6B. I spent about $20 total on running the models below. None of the Hugging Face API interfaces/spaces didn't work for me:(. Here is an example notebook I made for NeoX.
Does anyone know more models that are easily accessible?
Engineering the future of AI
OCR text:
Cee: errs
ed fy Ratt Raz et Ory) renee i MT ft Te ee a
ea iia g Micros Viords Faw
elk) iE: ~
ue [ccc eee ocr ee en ae
a a
Peer ICI) yO an ao (cd
Neod| rere. _ i: Tee oa
i |
—— Sree nrnen e
rr mid Paces Riad io j - = an
See eel a 2 7
Fr i
OCR text:
February, 2023: ... and Llama wins, almost
LLaMA: Open and Efficient Foundation Language Models
Hugo Touvron; Thibaut Lavril; Gautier Izacard; Xavier Martinet
Marie-Anne Lachaux, Timothee Lacroix, Baptiste Rozitre, Naman Goyal
Eric Hambro, Faisal Azhar, Aurelien Rodriguez, Armand Joulin
Edouard Grave; Guillaume Lample*
Meta Al
Abstract performance, a smaller one trained longer will
Wei ' ultimately be cheaper at inference. For instance,
we introduce LLaMA. arcollection of founda- although Hoffmann et al. (2022) recommends
tion language models ranging from 7B to 65B -
parameters. We train our models on trillions training a 10B model on 200B tokens, we find
of tokens, and show that it is possible to train that the performance of a 7B model continues to
state-of-the-art models using publicly avail- improve even after IT tokens.
able datasets exclusively, without resorting
to proprietary and inaccessible datasets. Ip The focus of this work is to train a series of
pesticular, LLaMA-13B outperforms GPT-3 language models that achieve the best possible per-
(1758) on most benchmerks, and LLaMA- formance at various inference budgets, by training
65B is competitive with the best models, on more tokens than what is typically used. The
Chinchilla-70B and Pal.M-540B. We release resulting fels, called LLaMA, ranges from 7B
all our models to the research communily’. . we
to 65B parameters with compctitive performance
OCR text:
enn February, 2023: .. and Llama wins, almost
World's Fair
LLaMA: Open and Efficient Foundation Language Models
aws Hugo Touvron; Thibeut Lavril; Gautier Izacard; Xavier Martinet
el Marie-Anne Lachaux, Timothee Lacroix, Baptiste Rozitre, Naman Goyal
Eric Hambro, Faisal Azhar, Aurelien Rodriguez, Armand Joulin
4 Edouard Grave; Guillaume Lample"
; Meta Al
Tent as A Abstract performance, a smaller one wained longer will
, , _ ultimately be cheaper at inference. For instance,
We introduce Ls MA. « collection of founda: although Hoffmann et al. (2022) recommends
5 bon language models ranging from 7B to 6$B - ep
, ; parameters. We train cur models oa tnitions training a 10B model on 2008 tokens, we find
a of tokens, and show that it ts powsble to train that the performance of a 7B modet continues to
ntl Masc-of-the-an models using publicly avail- improve even after IT tokens.
able datasets caclusively, without resorting
‘au to propnetasy and inaccessible datasets fe The focus of this work is to train a series of
ba) particular, LLaMA-138 outperforms GPT-3 language models that achieve the best possible per-
(1758) om most benchmarks, and LLaMA- formance at various inference budgets, by training
“ compas ee rapes on more tokens than what is typically used. The
inchalla- LM-S40B. We release
all ous models to the research community |. resulting models, called ee from 7B
AlEngmoce > é
‘ a
Tet Engineering the future of Al
OCR text:
World'sFair AIEngin March,2023:Thefirstdistillationsuccess
Alpaca:AStrong.ReplicableInstruction-FollowingModel
VS Authors: Rohan Taori and Tianyi Zhangand Yann Duboisand Xuechen Tatsunori B.Hashimoto
Wetroduce Apac 7Ba moder fine-tuned fro Ie LLaMA78modef n52K dsuqd (6o0S).Ceckout our code release ont
Update:Thepubilicdemoisnow disabiedThe origin mostiyachieved nisgoaandgiventhe hosting wedecided tobring cownthedemo rch in an accessible way. We foe/ thit we nave
4j Stanford Alpaca
Overview
World'sFair AEn Microsoft
OCR text:
April, 2023: Window.ai and BYOM (bring your own model)
window.ai ,
Use your own Al models on the web oa
; . =
a Pry
OCR text:
May, 2023: OpenRouter
The Unified
Interface For LLMs
Better prices, better uptime, no subscription.
Featured Models
View Trending
Gemini 2.5 Pro Preview
by google
215.0B
Tokens/wk
2.4s
Latency
+7.02%
Weekly growth
GPT-4.1
by openai
49.1B
Tokens/wk
815ms
Latency
+4.23%
Weekly growth
Claude Sonnet 4
New
by anthropic
242.8B
Tokens/wk
1.7s
Latency
+47.29%
Weekly growth
OCR text:
LLMRankings
Comparemodelsforall prompts
AllCategories
Programming
Roleplay
Marketing
Marketing/Seo
Technology
Science
Translation
Finance
Health
Trivia
Academia
2.6T
1.95T
10to100%growth
MoMforthelast2y
Mar17
Leaderboard
Token usage across models
Top thisweek
OpenAl:GPT-40-mini>
443Btokens
GPT-4o mnis OpenA's newest model after [GPT-4 Omn]models
Google:Gemini 2.0Flash>
239B tokens
Anthropic:ClaudeSonnet4>
207Btokens
Claude Sonnet 4 signiicanty enhances the ca
Google:Gemini 2.5ProPreview>
183B tokens
Gemni 2.5 Prois Googe's state-of-the-art Ai model des
OCR text:
Themostmodels,providers,andtokens
8.4T
2.5M+
MonthlyTokens
Global Users
Active Providers
Models
Signup
Buycredits
GetyourAPlkey
Create anaccount toget started.You
Creditscanbeused withanymodel or
Create anAPIkeyand startmaking
can setupanorgforyourteamlater.
provider.
requests.FullyOpenAlcompatible.
OPENROUTER_APILKEY
Apr1
Mar30
OCR text:
World'sFair AIEngine Anthropic:Claude3.7Sonnet antzop1c/elaude-3.7-sonet0 Chat
Fair aws Overview Providers Versions Apps Activity Uptime API
Closed-sourcemodels didn'tkeepupwith Uptime statsforClaude3.7Sonnet Uptie satsfor Claude 3.7 Sonet ac
'sFair demand...
Fair neo4j
on
World'sFair Engineering the future of Al
OCR text:
YourActivity
Seehowyou've beenusing modelsonOpenRouter.Privacy
Spend
Tokens
Requests
Last
Last
Lastday 499
Lastwek4.35K
Last day3
Lastwk12
day
From:
To:
Filters
Export
Timestamp
Provider/Model
App
Tokens
Cost
Speed
Finish
O
Jun3,10:11PM
Claude 3.7.Sonnet
OpenRouter:Chatroom
79.0tps
stop
Jun3,10:11PM
Claude37.Soonet
OpenRouter:Chatroom
s
66.0tps
stop
Jun3,10:11PM
Claude.3.7Sonnet
OpenRouter:Chatroom
s69
stop
OCR text:
Will intelligence be winner-take-all?
Token Marketshare by Model Author
June 1, 2025
OpenRouter
google 34.6%
openai 22.9%
anthropic 16.7%
deepseek 14.7%
meta-llama 3.9%
mistralai 2.8%
qwen 1.5%
others 1.3%
x-ai 0.7%
microsoft 0.5%
nousresearch 0.4%
Total 100.0%
OCR text:
World's Fair
elere dime ol hem anele Lacs
; ees
—?
Making an
increasingly
a heterogeneous
J ,
mS <" ecosystem
B homogeneous
nro!)
N
~~ coed
Ce here
World's Fair MTV Iacetvo 1 Cade ES 19900
OCR text:
INT erated WS AlEngincer
xe) it | rita | ey 2, WV vilekw alle |
we A
7 1 ;
ma WorkoO: 7 - & tambo
Ba ad eal ome " Ps Sd
ust | eval Rd rl | 7 fers] | tae Rl |
Ne
~ | hacatean < Wo” fekair| DISTRIBUTIONAL]
OCR text:
rosoft World'sFair AlEngineer aws World'sFair AIlEngineer
sFair Work AIEngineer ld'sFair tambo
trust World's Fair AIEngineer neo4j World'sFair AIEngineer
AIEngineer
OCR text:
oo a ay cr ee / - rd
en
Ls
Technical challenge: a ne
Ih Arcee Tue Ue ete ; ; ,
[Peres Te ree ~, Porraan fa a ron
ee ~ oo |:
OCR text:
We built a middleware for inference called “Plugins”
aa ee ee cieistal Cerone at
complete
[cco [01 oo-0 Gaal or>)0 111 Stak rN Co
i eer oe een
2 gh I Pal Comer O Lae ar Cores Bee
.1isDisabled
next.complete(requestFragment);
foe Oe AL i es wae at o2 010 i 0G ol tole
lisMessagesInput(te:.ecues!) |]
Pie Zeno] a he Fara 0X0 Rear =o 000 Np cit aoe cea gE |
OCR text:
Unlike MCPs, plugins allow transformations
on both inputs and outputs
export class WebSearchPlugin extends BasePlugin {
override async *complete(
const addAnnotationsResult = addAnnotationsToOutput({
output: topChoice,
annotations: this.#cachedAnnotations,
});
if (isErr(addAnnotationsResult)) {
inspectErrorT(addAnnotationsResult.error);
yield event;
continue;
}
event.data.choices[0] = addAnnotationsResult.data;
this.#didSendCitations = true;
yield event;
} else {
yield event;
}
break;
OCR text:
World's Fair
WELCOME
TO THE TEAM
BS Robert .
ne, ; 1 J
More modalities... eo
q ; @ oy
d OpenRouter
_ 4
Co 7 -
"me Cate |
[WortdsFair] Microsoft 2S aypai
OCR text:
World'sFair AIEngine Bettermodeldiscoverability/routing. Betterpromptobservability.
openai/gpt-4o-mini0
Starting at $o.6O/M output tokens $0.217/K input imgs
Technology（#1) Science（#1) Marketing/Seo (#6) Programming（#6) Translation(#6) +3categories
GPT-4ominiisOpenAl'snewestmodel after GPT-4 Omni supporting both textand image inputs wit Asthelrmost acvanced smallmodelis.many Trivia(#9) Finance (#7) perthanGPT-3.5
Academia(#10)
Overview Providers Apps Activity Uptime API
World'sFair AEnc Engineering the future of Al
Slide-Derived Subjects To Review
Subject extraction uses video title, related session titles/descriptions, transcript context, and OCR text when available. OCR is best-effort and should be reviewed against the embedded slide images.