Visualizers

Learn by moving things

Interactive explainers for the ideas behind retrieval, embeddings, and agents. A formula tells you what is true; dragging a vector shows you why. Each one also appears inside the article it belongs to, and runs entirely in your browser, so drag, poke, and break it.

Portrait of Sachin Gupta rendered in binary

Do not ship the whole dictionary

From: In the Machine Room

A production trick from DSpark. Training the small guesser needs the big model's answer per word, and the whole answer is a score for every possible word, over a hundred thousand numbers, which floods the link between computers. Auto-playing: it shows the heavy old way, then DSpark sending only the short summary and doing the last step locally, with a size comparison.

Why training used to clog the networkauto-playing
big modelits computerits answer, per wordguesserits computer

To train the small guesser, the big model has to send its answer over to the guesser's computer, for every word it teaches.

A scheduler that cannot wait

From: In the Machine Room

Why the neat sweet-spot rule needs real-world help. Auto-playing: the scheduler assumes GPU speed changes smoothly as the batch grows, but real hardware jumps in steps, a staircase not a ramp, and the pipeline cannot pause to measure it, so DSpark predicts the next batch a step ahead.

Why the scheduler has to guess aheadauto-playing
GPU speedbatch sizethe assumption: a smooth ramp

Part five picks the batch size by finding where the GPU's speed peaks. To do that, it assumes speed changes smoothly as the batch grows.

Navigate vs grab: vectorless retrieval

From: Vectorless RAG

The same question against the same structured document, two ways. Navigate the table-of-contents tree root to leaf by reasoning, or grab the top chunks by similarity and watch them arrive scattered and out of context. Similarity is not relevance.

Query
How long do I have to return a defective laptop?
Employee Handbook: table of contents
  • 1. Getting Started
  • 2. Compensation and Benefits
  • 2.1 Salary
  • 2.2 Health Insurance
  • 2.3 Paid Time Off
  • 3. Workplace Policies
  • 4. Equipment and Returns
  • 4.1 Company Laptops
  • 4.2 Returning Equipment
  • 4.3 Defective Devices
  • 5. Leaving the Company

Start at the top. Read the section titles and pick the branch that fits the question.

Visualizers — Sachin Gupta