Learning Hub

One question per lab. Play until you can predict the fix. Harness research is the study the labs cite — keep it on the path, not in a drawer.

Context physics — four labs, one occupancy decision

Same tokens, four costs. Click a box. Labels stay short on purpose. The first box splits further — look vs store: DSA cuts softmax, KDA cuts occupancy, MLA only thins each stored token.

one extra token in the live window KV grows re-read every decode recall dies middle of the prompt prefix reuse skip recompute, not RAM compact / pin don’t keep the token bandwidth softmax bytes, not T shrink T

Play — one intuition each

Why KV grows

What grows when I add one token?

K and V, every layer, every KV head — then that whole cache is re-read on the next decode step. A 128k window is a larger tax, not a discount.

play firstbytes = 2·L·H·d·T

Look vs store

If decode got cheaper, why is the GPU still full?

DSA stops looking at most tokens and still stores them. KDA stops storing them in 3/4 of the layers. MLA only thins each stored token. Three labs, three bills.

play firstsparse ≠ smaller KV

Why recall dies

Advertised window, or effective window?

Attention is a budget. More tokens thin every key; the middle of the prompt is where the budget runs out. Needle tests hide this; 2-hop does not.

U-curvecontext rot

Prefix reuse

What does the provider key its cache on?

Exact byte-prefix. Change one character, prefill is billed again. Reuse skips recompute; it does not shrink this request’s KV.

cross-requestbyte-stable

Compaction

What is allowed to pass through a lossy summarizer?

Unpinned rules die when their turn is dropped (38% violation if dropped, 0% if they survive). Pin them in the system prompt.

P01named constraints

Goal drift

What happens if you detect wander but cannot steer hard enough?

Detection without an effort cap above the drive is theater. Slide steering across the phase transition.

P25detect then steer

Model routing

What fraction of traffic actually needs the expensive model?

Pay frontier prices only for that slice. The bill is the size of the hard share, not “which model is best.”

P3460× gap

Memory supersede

What does retrieval serve after the world changed?

The stale pattern, until you consolidate. Contradiction is not an update until v2 replaces v1.

P03 / P04lazy vs eager

Constraint survival

Why can the run look healthy after the rules are gone?

Nothing measures survival. Erasure has no runtime signal. Same sentences, unpinned, opposite fate from the compaction lab.

P01 / P13

Test-time training

Should every token rewrite memory?

No. Write on surprise, forget on a schedule. Train-on-every-token is the bug Titans exist to fix.

play this, not the survey

After the four boxes

Same occupancy decision, other surfaces.

05Look vs storeSparse cuts softmax. Linear cuts occupancy. They are not the same tax. 06DriftDetect, then steer with enough authority. 07RoutingPay only the hard slice. 08MemoryStale until supersede. 09TTTBound KV by folding, not storing.

Harness research — the study

21 areas · 35 problems · ledger. The labs cite this corpus; they do not replace it. Open the atlas, then walk the path. Serving is area 09; P17 is the byte-key; 19–21 are the later territories.

Harness research atlas

What must a harness actually solve?

Dashboard, ⌘K, lifecycle map, 21 syntheses, 35 problem deep-dives, paper notes, ledger. Suggested path is on the dashboard — including serving, prospective memory, identity, and metrics.

the study21 areas35 problems
T0TaxonomyThe 21 sub-problems every harness must solve. T1Lifecycle mapWhere each of the 35 problems fires. T2Area 01Context management — densest lever. T3Area 09Serving: look, store, thin, reuse. T4P01Compaction amnesia. T5P17Prefix-cache instability. T6Areas 19–21Prospective memory, identity, metrics. T7FrontiersWhat remains unsolved. T8RoadmapTransformation map and backlog.

Catalogs

TTT briefing

Which buffer may you write to at inference, and when?

Survey + verdict. Play the simulator first; this page is the evidence table and the serving-tier map.

read after the sim

Lifecycle heat map

Where do the 35 problems actually fire?

A catalog tape, not a mechanism. Useful after you have felt compaction and drift.

onboarding

Muscle & nutrition

What actually drives hypertrophy — timing tricks, or tension + daily protein?

3D map and tables. Different domain. Start at MPS if you want the one transferable timing fact.

catalog