All right, so So, when we're serving uh an auto regressive model, these these ch

All right, so So, when we're serving uh an auto regressive model, these these chips are memory bound.

Why This Quote Matters

This quote was chosen because it surfaces context management as an engineering concern. In the context of Text Diffusion — Brendan O’Donoghue, Google DeepMind, it is a useful pointer into Inference Engineering rather than just a memorable line: it captures a reusable engineering judgment readers can compare against the source transcript, slides, and related scheduled sessions.

Related Topics

• Inference Engineering — primary transcript signal
• Coding Agents — secondary transcript signal
• Agent Memory — secondary transcript signal
• Agentic Search — secondary transcript signal

Source

• youtube r305 aQTaU0 — Text Diffusion — Brendan O’Donoghue, Google DeepMind