Learning Hub

One question per lab. Play until you can predict the fix. Harness research is the study the labs cite — keep it on the path, not in a drawer.

Context physics — four labs, one occupancy decision

Same tokens, four costs. Click a box. Labels stay short on purpose. The first box splits further — look vs store: DSA cuts softmax, KDA cuts occupancy, MLA only thins each stored token.

one extra token in the live window KV grows re-read every decode recall dies middle of the prompt prefix reuse skip recompute, not RAM compact / pin don’t keep the token bandwidth softmax bytes, not T shrink T

Labs — one topic each (problem and the stack that fixes it)

No tabs. No packed files. If two names shared a page, they were not the same topic.

Why KV grows

What grows when I add one token?

K and V, every layer, every KV head — then that whole cache is re-read on the next decode step. A 128k window is a larger tax, not a discount.

servingbytes = 2·L·H·d·T

Look vs store

If decode got cheaper, why is the GPU still full?

DSA stops looking at most tokens and still stores them. KDA stops storing them in 3/4 of the layers. MLA only thins each stored token.

servingsparse ≠ smaller KV

Why recall dies

Advertised window, or effective window?

Attention is a budget. More tokens thin every key; the middle of the prompt is where the budget runs out. Pin at the edges; don’t keep the haystack.

servingU-curve

Prefix reuse

What does the provider key its cache on?

Exact byte-prefix. Change one character, prefill is billed again. Keep the key stable — that is the fix, not a cleverer cache.

servingbyte-stable

Compaction / pin

What is allowed to pass through a lossy summarizer?

Unpinned rules die when their turn is dropped (38% if dropped, 0% if they survive). Pin them in the system prompt so they never enter the summarizer. Constraint survival is this topic, not a second lab.

P01pin is the fix

Goal drift

The objective is still in context. Why did the run stop serving it?

Completes against a different target. Detect-only is theater. Isolate noisy work, echo goal and rules as two channels, gate completion against the original instruction. P25 T1–T6 are in the lab, not a tab next door.

P25problem + stack

Premature termination

The objective is still unmet. Why did the run call itself done?

63% of failures are agent-initiated self-stops: its own smoke test passed, the real bar didn't. Goal drift's mirror image — this stops early against a weaker target instead of wandering to a different one.

P2863% self-stops

Model routing

What fraction of traffic actually needs the expensive model?

Pay frontier only for the hard slice. The bill is that fraction, not “which model is best.”

P3460× gap

Memory supersede

What does retrieval serve after the world changed?

The stale pattern, until v2 replaces v1. Contradiction is not an update. Lazy staging; consolidate on recurrence.

P03 / P04supersede

Test-time training

Should every token rewrite memory?

No. Write on surprise, forget on a schedule. Train-on-every-token is the bug Titans exist to fix.

TTT

Harness research — the study

21 areas · 35 problems · ledger. The labs cite this corpus; they do not replace it. Open the atlas, then walk the path. Serving is area 09; P17 is the byte-key; 19–21 are the later territories.

Harness research atlas

What must a harness actually solve?

Dashboard, ⌘K, lifecycle map, 21 syntheses, 35 problem deep-dives, paper notes, ledger. Suggested path is on the dashboard — including serving, prospective memory, identity, and metrics.

the study21 areas35 problems
T0TaxonomyThe 21 sub-problems every harness must solve. T1Lifecycle mapWhere each of the 35 problems fires. T2Area 01Context management — densest lever. T3Area 09Serving: look, store, thin, reuse. T4P01Compaction amnesia. T5P17Prefix-cache instability. T6Areas 19–21Prospective memory, identity, metrics. T7FrontiersWhat remains unsolved. T8RoadmapTransformation map and backlog.

Catalogs

TTT briefing

Which buffer may you write to at inference, and when?

Survey + verdict. Play the simulator first; this page is the evidence table and the serving-tier map.

read after the sim

Lifecycle heat map

Where do the 35 problems actually fire?

A catalog tape, not a mechanism. Useful after you have felt compaction and drift.

onboarding

Muscle & nutrition

What actually drives hypertrophy — timing tricks, or tension + daily protein?

3D map and tables. Different domain. Start at MPS if you want the one transferable timing fact.

catalog

Cortisol & inflammation

Wired and tired, puffy, stuck at the same weight — what's actually driving it?

Causes, a self-check to find your biggest lever, fixes, and signals you can track at home with no equipment. Different domain.

catalogself-check

Working memory & communication

Why does the idea vanish mid-sentence — and why is it worse in a group?

One shared buffer, three demands, and a fourth one a group adds for free. Production blocking explains the group case. Self-check + fixes.

catalogself-check