Dense Slides: Real-time Experiments with an AI Co-Scientist - Stefania Druga, fmr. Google Deepmind

Source Video

Real-time Experiments with an AI Co-Scientist - Stefania Druga, fmr. Google Deepmind

Method

This deck is slide-only. The existing captured video frame set supplies candidate frames, then local OpenCV rejects sponsor/title/speaker-only frames, crops visible slide surfaces, deduplicates, and saves the cropped slide images.

Cropped Visible Slides

Recreated text/layout view: open HTML recreation
AI slide classifier: content_slide confidence 0.98
Text source: agent_vision.
OCR decision: ready — Dense product UI screenshot with multiple small labels and panels.

Slide text:

LabMind

Recreated text/layout view: open HTML recreation
AI slide classifier: content_slide confidence 0.97
Text source: none.
OCR decision: ready — Readability is best handled by OCR because the slide is a UI screenshot with small control labels and buttons.

Recreated text/layout view: open HTML recreation
AI slide classifier: content_slide confidence 0.98
Text source: agent_vision.
OCR decision: ready — Dense multi-panel product UI screenshot with charting and assistant text suitable for OCR.

Slide text:

LabMind

Recreated text/layout view: open HTML recreation
AI slide classifier: content_slide confidence 0.98
Text source: agent_vision.
OCR decision: ready — Dense product UI screenshot with charts, assistant panel, and multiple small labels.

Slide text:

The AI Co-Scientist

Recreated text/layout view: open HTML recreation
AI slide classifier: content_slide confidence 0.96
Text source: advanced OCR rapidocr-live/bright-screen/contrast.
OCR decision: ready — Architecture diagram with multiple labels and a small hardware photo; OCR is the cheapest reliable read path.

Slide text:

Input Sources Backend Servlces

AIE express

Jacdac USB LabMind App

Do SensorsModule

reCamera Webcam WebcamModule

8- AChatVodule Real-time AIAPI

Text Inpu! 8 8

aws

Recreated text/layout view: open HTML recreation
AI slide classifier: content_slide confidence 0.98
Text source: advanced OCR rapidocr-live/bright-screen/contrast.
OCR decision: ready — Diagram plus labeled hardware collage with many small labels and logos; OCR is appropriate.

Slide text:

AIE SensorArray ·C humidity

sound motion Processing

CNMERNS DB sound Request beaker crystals

WebUSB API Response

Microbit boards, Jacdac Sensors, Recamera

Microsoft smol ai

Recreated text/layout view: open HTML recreation
AI slide classifier: content_slide confidence 0.97
Text source: agent_vision.

Slide text:

Fermentation

Recreated text/layout view: open HTML recreation
AI slide classifier: content_slide confidence 0.99
Text source: agent_vision.

Slide text:

Lab in a box (kind of)

Recreated text/layout view: open HTML recreation
AI slide classifier: content_slide confidence 0.99
Text source: advanced OCR rapidocr-live/bright-screen/opencv-adaptive.
OCR decision: ready — Dense multi-column slide with small body text and embedded chart/image content; OCR will likely be more reliable than manual transcription.

Slide text:

The Science of Supersaturation Demo 1: Crystal Growth

AIE supersaturatcd solution - more salt than water con nowhere to go oxcept to arrango themselves into cools and watcr cvaporatcs, salt molcculcs have Organizcd crystal structures. Tho scod crystal providos a template, and layers build up atom by atom. When balt dissolves in hot water, we create a normally hold at room temperature. As the solution: 21- o94*.

Koy Scicntific Concopts:

- Solubllity curvos: More salt dissolves in hot water than cold

. Nuclentlon sltes: Vhere crystals begin to form

. Growth ratos: Affected by temperature. concontration, and purity

: Crystal lattico: How atoms srrange in repeating

3D.natterns

aws

Recreated text/layout view: open HTML recreation
AI slide classifier: content_slide confidence 0.93
Text source: none.

Recreated text/layout view: open HTML recreation
AI slide classifier: content_slide confidence 0.98
Text source: advanced OCR rapidocr-live/right-72/contrast.
OCR decision: ready — Dense slide with small bullet text and plotted charts; OCR is the right extraction path.

Slide text:

· Nucleation is not gradual - it happens in bursts

52 · Critical supersaturation reached - sudden ·Energy barrier overcome → rapid cluster formation crystal seed formation

Ootectiee (uoMSe

Mio(CrrtalGronth

Microsoft smol ai

Recreated text/layout view: open HTML recreation
AI slide classifier: content_slide confidence 0.99
Text source: advanced OCR rapidocr-live/bright-screen/opencv-adaptive.
OCR decision: ready — Dense slide with paragraph text and multiple screenshots; OCR will be more efficient than manual transcription.

Slide text:

Demo 2: Yeast Fermentation

AIE produce CO, gas as waste. In bread dough, this CO, gets trapped by gluten proteins, creating bubbles that Yeast are living mlcroorganisms thot eat sugo! and Wobcam Wobcam

the same process used to make bread, beer, and wine for thousands of ycars. make the dough riso. This is anoerobic fermontation -

Key Scientific Concepts:

. Enrye setivity Yoast enzymes break down

complex sugars

. Metsbollc rate: How quickly organisms process nutricnts

. Gss laws: CO, production creates pressure and volume changes

. Growth phatot: Log - Exponontial - Statiorary - Decline

aws

Recreated text/layout view: open HTML recreation
AI slide classifier: content_slide confidence 0.97
Text source: advanced OCR rapidocr-live/full.
OCR decision: ready — Dense UI screenshot, chart, and small embedded labels are better handled by OCR.

Slide text:

AIE 26-89

Yeast Enzyme Activity vs Temperature

Ag27.6°C Actual Range Enzyme Activity

Fermentation experimentrecording speedup

Microsoft smol?

Recreated text/layout view: open HTML recreation
AI slide classifier: content_slide confidence 0.98
Text source: agent_vision.
OCR decision: ready — Dense multi-panel imagery and small embedded UI labels are better handled by OCR.

Slide text:

The Future...

Classification audit: raw/sources/slide-ai-classification/dense/wNH3q9pqn0U/audit.json