Visualizers

Learn by moving things

Interactive explainers for the ideas behind retrieval, embeddings, and agents. A formula tells you what is true; dragging a vector shows you why. Each one also appears inside the article it belongs to, and runs entirely in your browser, so drag, poke, and break it.

Portrait of Sachin Gupta rendered in binary

FLARE: retrieve mid-generation

From: RAG That Thinks

Forward-looking active retrieval woven into generation. As the model writes, confident words stream straight out, but whenever it is about to say something it is unsure of, it pauses, retrieves on that span, and continues.

FLARE: retrieve only for the words it is unsure ofinteractive
The Eiffel Tower was completed in

Confident words are written straight out; retrieval only fires on the shaky ones.

Self-RAG: grade yourself as you write

From: RAG That Thinks

The model emits special reflection tokens that gate its own flow: whether to retrieve, whether a passage is relevant, and whether the answer is actually supported. A 'not supported' verdict sends it back to revise, in-band, before anything is shown.

Self-RAG: the model grades itself as it writesinteractive
[ Retrieve? ]yesthe question needs external facts, so pull passages
[ Relevant? ]yesthe retrieved passage is on-topic, keep it
[ Supported? ]nothe draft claims a number the passage never states, so do not trust it
reviseredorewrite the answer using only what the passage actually supports
[ Supported? ]yesnow every claim traces to the passage, so emit the answer

Special reflection tokens decide whether to retrieve, whether a passage is relevant, and whether the answer is actually supported. A “no” on the last one sends it back to revise, in-band, before anything is shown.

Speculative RAG: draft several, verify, pick

From: RAG That Thinks

A small model drafts several candidate answers in parallel, each from a different retrieved subset; a larger verifier model scores them and picks the best. Parallel drafting plus one verify beats a long serial loop.

Speculative RAG: draft several, verify, pick the bestinteractive
draft from
subset A
...
draft from
subset B
...
draft from
subset C
...
drafts generated in parallel

A small model drafts several candidate answers in parallel, each from a different retrieved subset of the documents.

Visualizers — Sachin Gupta