Harshul Jain
Official Role
Senior Software Engineer - ML/AI at Audible.
Official Bio
Harshul Jain is a Senior Software Engineer at Audible (Amazon) who builds ML and LLM infrastructure at scale — AI Search serving 10M users, a feature store processing 100K transactions per second, and LLM serving and evaluation systems powering GenAI in production. He is writing LLM Inference at Scale, a benchmark-driven handbook on GPU memory engineering, attention optimization, and production LLM serving backed by a companion repository that gained 100+ clones in its first week with zero promotion.
Scheduled Sessions
- 2026 06 29 harshul jain 2 hr deep dive on llm inference at scale part 1 of 2 — 2 hr deep dive on LLM Inference at Scale — Part 1 of 2 (2026-06-29, 12:10pm-1:10pm)
- 2026 06 29 harshul jain 2 hr deep dive on llm inference at scale part 2 of 2 — 2 hr deep dive on LLM Inference at Scale — Part 2 of 2 (2026-06-29, 1:15pm-2:15pm)