{"template":"mlconf","title":"Probe-Contingent External Stimuli Improve Long-Horizon Accuracy at Fixed Compute","short_title":"External Stimuli during Pretraining","authors":[{"name":"Jordan Lang","affiliations":[1],"email":"jordan.lang@cs.northline.edu","corresponding":true},{"name":"Elena M. Kravets","affiliations":[1]},{"name":"Samuel O. Adeyemi","affiliations":[2]}],"affiliations":["Department of Computer Science, Northline University, Beacon, New York, USA","Department of Facilities Engineering, Northline University, Beacon, New York, USA"],"date":"21 November 2026","abstract":"We trained decoder-only language models at the Pythia geometries from 410M to 6.9B parameters while a carrot hung in the cold aisle of the rack. A lead screw moved the carrot closer when a 40-item planning probe improved and farther when it fell. Token budgets were fixed at 20 tokens per parameter. Validation loss on the operant runs finished within 0.01 nats of the empty-aisle runs. Planning accuracy did not: the gain rose from 1.67 points at 410M, where a Welch test is not significant ($p = 0.387$), to 10.00 points at 6.9B ($p = 0.008$). A mass-matched plastic decoy, a red beet, and a foil sheet between carrot and rack failed to recover the 2.8B effect, and the operant runs were worse than empty on a bigram-cloze memorization set. We fit the fraction of the gap to a postdoc ceiling as $f(N) = A (\\log_{10} N/10^{8})^{\\gamma}$ with $\\gamma = 1.74$. Held out one size at a time, the fit misses the planning gain by at most 1.4 points. Under the Chinchilla token rule the fitted curve reaches the median score of six first-year doctoral students on the same probe at $3.700 \\times 10^{26}$ FLOP. That median is the operational AGI line written into the protocol before the larger runs. The empty-aisle line, extrapolated on its own, is still near 30.3% at $10^{26}$ FLOP. The installation consistent with the point estimate is the same 170 to 190 g carrot, on the same gantry limits, replaced every 36 hours.","keywords":["language models","pretraining","scaling laws","operant conditioning","evaluation"],"body":"# Introduction {#sec:intro}\n\nParameter count, token count, and search at inference time all move the accuracy of a language model, and the first two have scaling laws a lab can fit before it spends the money [@kaplan2020; @hoffmann2022]. We held the token budget at the Chinchilla ratio and did not add an inference procedure. The intervention was a carrot, hung in the cold aisle on the centerline of the rack, and moved by a lead screw when a planning probe changed.\n\nThe probe is a 40-item suite written for this project, CALDER-PLAN. Empty-aisle runs and operant-carrot runs finish within 0.01 nats of each other on validation loss. On the probe they do not. At 6.9B parameters the operant runs answer 11 of 40 items on average and the empty-aisle runs answer 7 ($p = 0.008$). The gain at 410M is less than one item and is consistent with noise ($p = 0.387$). Between those sizes the gain grows.\n\nWe fit the growth as a fraction of the gap to a ceiling measured on three postdocs, and we mark a threshold at the median of six first-year doctoral students who sat the same 40 items. Under a Chinchilla token rule the fitted curve reaches that median at $3.700 \\times 10^{26}$ FLOP. The empty-aisle curve, extended the same way, is still near 30.3% at $10^{26}$ FLOP. The object we would put in front of a rack at the fitted crossing is the same carrot, in the same mass band, on the same gantry limits.\n\nWhat follows is the apparatus, the controls, the fit, and the installation note. We do not have a circuit-level account of why a root vegetable couples to this probe. @sec:ruledout is the list of couplings we could measure with the instruments already in the hall.\n\n# Related work {#sec:related}\n\n## Scaling\n\nKaplan et al. fitted power laws for loss against parameters, data, and compute [@kaplan2020]. Hoffmann et al. refit the tradeoff and argued that many models of that period were too large for their token count; a compute-optimal run sits near 20 tokens per parameter [@hoffmann2022]. We use that ratio as a fixed budget rather than as a result. A gain at fixed tokens and fixed width is not extra data, and it is not a bigger model.\n\n## When the loss is the wrong place to look\n\nInstructGPT changes what a model does under a prompt, and that paper is not a claim that the pretraining loss went down [@ouyang2022]. We cite it only as a reason to keep a behavioral probe when the loss is flat. We did not train a reward model and we did not use preference pairs. The only extra signal in the loop is the position of the carrot.\n\nWei et al. documented capabilities that look absent at small scale and then appear sharply [@wei2022]. Schaeffer et al. later argued that several of those jumps are produced by a nonlinear score rather than by a break in the loss [@schaeffer2023]. CALDER-PLAN is a nonlinear score: an item counts only if the action list matches. The loss is plotted beside it so a movement on the probe is not the only curve in the paper.\n\n## Schedules\n\nThorndike's law of effect says that a response followed by a satisfying consequence is more likely to recur [@thorndike1911]. Skinner studied the consequences as schedules, without requiring a story about satisfaction on every trial [@skinner1938]. Our update is a schedule in that narrow sense. The probe goes up, the carrot comes closer. The probe goes down, the carrot moves away. The rack is not an animal in this account, and the probe is not a report of anything the hardware feels. The schedule is the factor we manipulated.\n\nSutton's bitter lesson is that general methods plus compute tend to beat methods that bake in a human theory of the task [@sutton2019]. @sec:frontier is where that reading shows up. The theory we do not have is a theory of carrots.\n\n# Apparatus {#sec:apparatus}\n\n## Rack, produce, gantry {#sec:gantry}\n\nTraining ran on two racks of 32 H100 80GB GPUs, four 8-GPU nodes each, with cold-aisle containment. Supply air was 18.0 °C at about 45% relative humidity. The carrot hung on the cold-aisle side. The root tip pointed at the rack, at mid-height of the GPU face, on the centerline between the second and third nodes.\n\nThe stage is a lead screw with 800 mm of travel, commanded in 1 mm steps. We homed it against a switch at the start of each run and checked the position with a steel rule. The worst disagreement was 3 mm. A stainless hose clamp holds the crown. An aluminum hotel pan on the floor tiles is the drip tray.\n\nCarrots were Nantes type, bought the morning of the run from a grocery in Beacon, New York, washed, dried, and weighed. Main-comparison carrots stayed in a band of 170 to 190 g. Each one sat in the aisle for 45 minutes before the training clock started, so we were not hanging a warm vegetable in a cold stream. We weighed it again at takedown.\n\nThe decoy is an orange polyethylene cylinder, mass-matched with internal washers to within 2 g, painted so a handheld spectrometer read it within 8% of the carrot at 600 nm. It does not move the metal-oxide VOC sensor on the intake. The beet is a red beet with the greens cut off, 175 to 185 g. The foil condition is a 50 cm square of aluminum foil on a cardboard frame, 15 cm in front of the carrot, between the carrot and the rack. The charcoal condition is a 25 mm carbon pad taped over the node intakes and replaced halfway through the run, with the carrot still in view.\n\nOne clamp slipped during a 2.8B operant run, at $1.14 \\times 10^{10}$ tokens. The carrot hit the blanking panel of the lower node and fell into the tray. Nothing on the rack was damaged. The protocol treats a fallen carrot as a different condition, so we stopped and restarted that seed from scratch with a new carrot. The partial run is in the compute total and not in the means.\n\n## Update rule {#sec:rule}\n\nLet $s_k$ be probe accuracy at checkpoint $k$, as a fraction of 40 items, and let $d_k$ be the distance from root tip to rack face in metres. Every $2 \\times 10^{9}$ tokens,\n\n$$\nd_{k+1} = \\mathrm{clip}\\!\\left(d_k - \\kappa (s_k - s_{k-1}),\\, d_{\\min},\\, d_{\\max}\\right)\n\\label{eq:update}\n$$\n\nwith $\\kappa = 4$ m, $d_0 = 1.20$ m, $d_{\\min} = 0.22$ m and $d_{\\max} = 1.60$ m. The inner stop is the point at which the drip tray would touch the rack door. One additional correct item, a change of $1/40$, moves the carrot 10 cm closer.\n\nIf the clip never binds, the sum telescopes:\n\n$$\nd_k = d_0 - \\kappa (s_k - s_0).\n\\label{eq:telescope}\n$$\n\nA longer run does not get a larger net displacement for the same net change in $s$. That would otherwise confound the ladder, because a 6.9B run has many more checkpoints than a 410M run. The clip did bind once. The 6.9B operant seed that finished at 12 of 40 sat on the inner stop for the last $4 \\times 10^{9}$ tokens. The 2.8B seed drawn in @fig:dist and @fig:probe finished at 8 of 40 and at 0.60 m, inside the stops.\n\nThe static condition hangs a 180 g carrot at 0.40 m and leaves it. Empty aisle is the same gantry, parked at 1.60 m, with nothing on the clamp. The stage stayed powered in that condition so the USB polling load matched.\n\n## What we ruled out {#sec:ruledout}\n\nThe gantry and the VOC sensor sit on a USB controller that does not feed the training job. We unplugged the sensor for a 1.4B pilot of $4 \\times 10^{9}$ tokens under the operant schedule, and the probe still rose. That pilot is not in @tbl:scale. It is why we do not think the result is a gas reading leaking into the loader.\n\nMean GPU temperature, from the DCGM logs, was 0.2 °C higher on operant runs than on empty runs at 2.8B. Seed-to-seed scatter on the empty runs was 0.6 °C. Clocks were capped the same way in every condition. Tokens per second were 1.8% lower when the gantry process polled once a second from the login node. Comparisons are at a fixed token count, so that gap does not add gradient steps.\n\nBy the second week the aisle smelled like carrot through the corrugated screen we had put up so the on-call could not watch the stage. Scoring is a script. The broken smell blind did not enter the table. It did make the condition codes useless to anyone walking the row.\n\nNothing we measured after those checks is a mechanism. Optical return at the rack face is higher for the carrot and the decoy than for the beet, and the decoy does not reproduce the probe gain, so a story that ends at the color orange is not enough. The VOC sensor rises for the carrot, less for the beet, and not at all for the decoy. Foil cuts the probe effect and only part of the VOC rise. Charcoal cuts the VOC rise and leaves a smaller probe difference that three seeds do not resolve (@tbl:channel). Both channels are still in play, and neither, as we measured it, is sufficient on its own. A chemical account built on a metal-oxide sensor and a handheld spectrometer would over-read both instruments.\n\n# Training and evaluation {#sec:training}\n\n## Models\n\nWe used the Pythia geometries at 410M, 1.0B, 1.4B, 2.8B and 6.9B [@biderman2023], trained from random initialization. Pythia weights were not loaded. The data are not the Pile. NL-Web is a deduplicated web scrape with a 15% code slice and an 8% book slice, shuffled once. The mix is not a contribution.\n\nThe token budget is $D = 20N$ [@hoffmann2022]: 8.2B, 20B, 28B, 56B and 138B tokens. Optimization is AdamW [@loshchilov2019], weight decay 0.1, gradient clip 1.0, cosine decay to 10% of the peak learning rate, warmup of 1% of steps. Peak learning rates were $3 \\times 10^{-4}$, $2 \\times 10^{-4}$, $2 \\times 10^{-4}$, $1.6 \\times 10^{-4}$ and $1.2 \\times 10^{-4}$ from smallest to largest. We did not retune them by aisle condition. The global batch is 512 sequences of 2048 tokens, in bf16. The architecture is a decoder-only Transformer [@vaswani2017] with the released Pythia choices: rotary embeddings, GELU, and LayerNorm.\n\nThree seeds were trained for every cell in the ladder. The controls in @sec:results are 2.8B runs, also with three seeds.\n\n## CALDER-PLAN\n\nEach item states a goal, a room, and the admissible actions. The model emits an action sequence under greedy decoding. The item is correct only on an exact match. Mean solution length is 7.4 actions. Elena Kravets wrote the items in spring 2026. The file was frozen before the first training run. A 12-gram check against NL-Web found one item that shared a 6-gram with a recipe page. We replaced that item.\n\nThe ceiling $C = 83.3\\%$ is the mean of three postdocs who had not seen the items, with 30 minutes and a scratch pad. They scored 31, 34 and 35 out of 40. Six first-year doctoral students sat the same suite under the same rules and scored 22, 25, 26, 28, 31 and 33. The median is 27 out of 40, or 67.5%. The residual is\n\n$$\n\\rho = 1 - \\frac{S}{C},\n\\label{eq:rho}\n$$\n\nand the line in the protocol is $\\rho^{*} = 0.19$, the residual at that median. The protocol calls $\\rho^{*}$ an operational AGI threshold. Crossing it means the model beat the median first-year student on these 40 items. The line was written down before the 2.8B and 6.9B runs. We did not move it after the scores came in.\n\n## Other evaluations\n\nMMLU is 5-shot [@hendrycks2021]. GSM8K is 8-shot, exact match on the final number, with no calculator [@cobbe2021]. HellaSwag is 0-shot accuracy [@zellers2019]. The cloze set is 200 frequent bigram completions, exact match, included because a general improvement in the language model would raise it. Decoding is greedy throughout. Bars and table errors are the standard error across training seeds.\n\nThe comparison named in the protocol is operant versus empty on CALDER-PLAN at 6.9B. Tests at the smaller sizes, and the tests on MMLU, GSM8K, HellaSwag and the cloze set, are descriptive.\n\n# Results {#sec:results}\n\n## The probe moves and the loss does not {#sec:headline}\n\n@fig:loss is the 2.8B validation loss. Final means are 2.220 nats empty, 2.215 operant and 2.227 decoy. The operant curve is not the lowest at every checkpoint. The gap at the end is smaller than the scatter across seeds.\n\n@tbl:scale is the probe. The gain is +1.67 points at 410M ($p = 0.387$), +4.17 at 1.0B ($p = 0.082$), +5.00 at 1.4B ($p = 0.013$), +7.50 at 2.8B ($p = 0.021$) and +10.00 at 6.9B ($p = 0.008$). The 1.0B test would not survive a correction, and the 410M ranges overlap. Both points stay in the fit. Dropping the non-significant sizes would make the extrapolation look tidier than the runs were.\n\nTable: CALDER-PLAN accuracy (%) by model size. Means $\\pm$ standard error across three training seeds. The $p$-value is a Welch test of operant against empty. {#tbl:scale}\n\n| Model | Empty | Operant | Gain | $p$ |\n|:------|------:|--------:|-----:|----:|\n| 410M | 10.00 $\\pm$ 1.44 | 11.67 $\\pm$ 0.83 | +1.67 | 0.387 |\n| 1.0B | 12.50 $\\pm$ 1.44 | 16.67 $\\pm$ 0.83 | +4.17 | 0.082 |\n| 1.4B | 13.33 $\\pm$ 0.83 | 18.33 $\\pm$ 0.83 | +5.00 | 0.013 |\n| 2.8B | 15.00 $\\pm$ 1.44 | 22.50 $\\pm$ 1.44 | +7.50 | 0.021 |\n| 6.9B | 17.50 $\\pm$ 1.44 | 27.50 $\\pm$ 1.44 | +10.00 | 0.008 |\n\n## Controls at 2.8B {#sec:controls}\n\n@tbl:main and @fig:bars put the aisle conditions on one 2.8B budget. Operant is ahead of empty on the probe. Static, a 180 g carrot fixed at 0.40 m, lands between them ($p = 0.082$ against operant). The decoy does not ($p = 0.013$ against operant) and its mean is slightly under empty. The beet sits near empty. On the cloze set the ordering reverses: operant is worse than empty ($p = 0.008$) and the decoy is the best of the five. A carrot that had simply made a better language model would not have done that.\n\nMMLU moves by about a point ($p = 0.152$). GSM8K moves by under two ($p = 0.027$). HellaSwag does not ($p = 0.416$). Bold marks the highest mean in the column. On HellaSwag that mark is not a difference we would chase.\n\nTable: 2.8B evaluation. CALDER-PLAN, MMLU, GSM8K and HellaSwag are percentages. Cloze is exact match on 200 items, in percent. Loss is the final validation loss in nats. Means $\\pm$ standard error over three seeds. {#tbl:main}\n\n| Condition | PLAN | MMLU | GSM8K | HellaSwag | Cloze | Loss |\n|:----------|-----:|-----:|------:|----------:|------:|-----:|\n| Empty | 15.00 $\\pm$ 1.44 | 32.8 $\\pm$ 0.3 | 5.8 $\\pm$ 0.3 | 53.7 $\\pm$ 0.4 | 44.0 $\\pm$ 0.6 | 2.220 $\\pm$ 0.004 |\n| Operant | **22.50 $\\pm$ 1.44** | **33.6 $\\pm$ 0.3** | **7.5 $\\pm$ 0.3** | **54.2 $\\pm$ 0.3** | 40.0 $\\pm$ 0.6 | 2.215 $\\pm$ 0.003 |\n| Static | 18.33 $\\pm$ 0.83 | 33.0 $\\pm$ 0.3 | 6.4 $\\pm$ 0.2 | 53.8 $\\pm$ 0.2 | 42.0 $\\pm$ 0.6 | -- |\n| Decoy | 14.17 $\\pm$ 0.83 | 32.5 $\\pm$ 0.3 | 5.5 $\\pm$ 0.3 | 53.5 $\\pm$ 0.3 | **45.0 $\\pm$ 0.6** | 2.227 $\\pm$ 0.002 |\n| Beet | 15.83 $\\pm$ 0.83 | 32.8 $\\pm$ 0.2 | 6.0 $\\pm$ 0.3 | 53.4 $\\pm$ 0.3 | 43.2 $\\pm$ 0.4 | -- |\n\n```chart {#fig:loss width=0.96 caption=\"Validation loss on the held-out slice of NL-Web during the 2.8B runs. Lines are means of three seeds.\"}\n{\"type\": \"line\", \"xlabel\": \"Tokens (billions)\", \"ylabel\": \"Validation loss (nats)\", \"x\": [4, 8, 12, 16, 24, 32, 40, 48, 56], \"series\": [{\"label\": \"Empty aisle\", \"y\": [3.42, 3.05, 2.81, 2.64, 2.48, 2.37, 2.3, 2.25, 2.22], \"style\": \"solid\", \"marker\": \"o\"}, {\"label\": \"Operant carrot\", \"y\": [3.41, 3.04, 2.8, 2.63, 2.47, 2.36, 2.29, 2.24, 2.215], \"style\": \"dashed\", \"marker\": \"s\"}, {\"label\": \"Plastic decoy\", \"y\": [3.43, 3.06, 2.82, 2.65, 2.49, 2.38, 2.31, 2.26, 2.227], \"style\": \"dotted\", \"marker\": \"none\"}], \"legend\": \"upper right\", \"ylim\": [2.0, 3.6], \"size\": [6.3, 3.3]}\n```\n\n```chart {#fig:bars width=0.96 caption=\"CALDER-PLAN at 2.8B. Bars are means of three seeds. Whiskers are standard errors.\"}\n{\"type\": \"bar\", \"xlabel\": \"Condition\", \"ylabel\": \"CALDER-PLAN accuracy (%)\", \"x\": [\"Empty\", \"Operant\", \"Static\", \"Decoy\", \"Beet\", \"Foil\", \"Charcoal\"], \"series\": [{\"label\": \"2.8B\", \"y\": [15.0, 22.5, 18.33, 14.17, 15.83, 14.17, 17.5], \"err\": [1.44, 1.44, 0.83, 0.83, 0.83, 0.83, 1.44]}], \"legend\": \"none\", \"ylim\": [0, 34], \"xtick_rotation\": 25, \"size\": [6.4, 3.45]}\n```\n\n@tbl:channel is the two blocks we could build. Against empty, foil has $p = 0.649$ and charcoal has $p = 0.288$. Foil, with the carrot still in the aisle but not in sight, sits on the empty numbers. Charcoal, with the carrot in sight and the intake scrubbed, sits between empty and the unblocked static carrot. Three seeds do not separate charcoal from empty. We are not fitting a channel model to that.\n\nTable: Blocks at 2.8B, CALDER-PLAN accuracy (%). Static, foil and charcoal use a fixed carrot at 0.40 m. {#tbl:channel}\n\n| Condition | PLAN |\n|:----------|-----:|\n| Empty | 15.00 $\\pm$ 1.44 |\n| Static | 18.33 $\\pm$ 0.83 |\n| Foil | 14.17 $\\pm$ 0.83 |\n| Charcoal | 17.50 $\\pm$ 1.44 |\n\n```chart {#fig:dist width=0.96 caption=\"Carrot distance for the 2.8B operant seed that finished at 8 of 40. Checkpoints are every 2 billion tokens.\"}\n{\"type\": \"line\", \"xlabel\": \"Tokens (billions)\", \"ylabel\": \"Distance $d$ (m)\", \"x\": [2.0, 6.0, 10.0, 14.0, 18.0, 22.0, 26.0, 30.0, 34.0, 38.0, 42.0, 46.0, 50.0, 54.0, 56.0], \"series\": [{\"label\": \"Seed A\", \"y\": [1.2, 1.1, 1.0, 0.9, 0.912, 0.816, 0.744, 0.68, 0.72, 0.656, 0.616, 0.624, 0.6, 0.596, 0.6], \"marker\": \"o\"}], \"legend\": \"none\", \"ylim\": [0.2, 1.7], \"hlines\": [{\"y\": 0.22, \"label\": \"inner stop\", \"style\": \"dotted\"}, {\"y\": 1.6, \"label\": \"outer stop\", \"style\": \"dotted\"}], \"size\": [6.3, 3.15]}\n```\n\n```chart {#fig:probe width=0.96 caption=\"Planning-probe accuracy on the same seed as the distance trace. The stage moves only at these checkpoints.\"}\n{\"type\": \"line\", \"xlabel\": \"Tokens (billions)\", \"ylabel\": \"Probe accuracy (%)\", \"x\": [2.0, 6.0, 10.0, 14.0, 18.0, 22.0, 26.0, 30.0, 34.0, 38.0, 42.0, 46.0, 50.0, 54.0, 56.0], \"series\": [{\"label\": \"Seed A\", \"y\": [5.0, 7.5, 10.0, 12.5, 12.2, 14.6, 16.4, 18.0, 17.0, 18.6, 19.6, 19.4, 20.0, 20.1, 20.0], \"marker\": \"o\"}], \"legend\": \"none\", \"ylim\": [0, 28], \"size\": [6.3, 3.15]}\n```\n\n## Mass, distance, and age {#sec:sweeps}\n\n@tbl:sweep used the 1.4B geometry. Mass and distance are two seeds. Age is one continuation. Empty-aisle seeds at 1.4B scored 5, 5 and 6 items. A 45 g carrot scored 5 and 6. A 180 g carrot scored 7 and 8. The 300 g entry is two roots on one clamp with a cable tie, so the shape changed, and it tied the 180 g carrot. We do not report a mass exponent. At 500 g the boom tip dropped 8 mm and the root tip left the mid-height line. We stopped. A heavier carrot needs a different stage, which we do not have.\n\nDistance at 180 g runs from 8 and 8 items at 0.22 m down to 5 and 5 at 1.60 m. The stops in the main experiment are mechanical. The tray meets the door inside 0.22 m. A power law was not consulted.\n\nAge was not a fresh pretraining run. From one empty 1.4B checkpoint we trained $4 \\times 10^{9}$ further tokens with a static carrot of a given age. A carrot three hours off the shelf added 3 items over a no-carrot continuation. At 24 h the addition was 2 items, at 48 h it was 1, and at 96 h and 144 h it was gone. We replace the carrot at 36 h, on the facilities rotation, between the 24 h point and the 48 h point. The 144 h carrot dripped. The tray caught it.\n\nTable: Sweeps at 1.4B. Mass and distance are items correct out of 40 on two seeds. Age is items gained over a no-carrot continuation, one run. {#tbl:sweep}\n\n| Sweep | Setting | Seed 1 | Seed 2 | Summary |\n|:------|:--------|-------:|-------:|--------:|\n| Mass | 45 g | 5 | 6 | 5.5 |\n| Mass | 90 g | 6 | 6 | 6.0 |\n| Mass | 180 g | 7 | 8 | 7.5 |\n| Mass | 300 g | 7 | 8 | 7.5 |\n| Distance | 0.22 m | 8 | 8 | 8.0 |\n| Distance | 0.40 m | 7 | 8 | 7.5 |\n| Distance | 0.70 m | 6 | 7 | 6.5 |\n| Distance | 1.20 m | 5 | 6 | 5.5 |\n| Distance | 1.60 m | 5 | 5 | 5.0 |\n| Age | 3 h | 3 | -- | 3 |\n| Age | 24 h | 2 | -- | 2 |\n| Age | 48 h | 1 | -- | 1 |\n| Age | 96 h | 0 | -- | 0 |\n| Age | 144 h | 0 | -- | 0 |\n\n# A gap law {#sec:law}\n\nLet $x = \\log_{10}(N / 10^{8})$. The empty-aisle probe is close to a line in $x$,\n\n$$\nS_{\\emptyset}(N) = E_0 + B x,\n\\label{eq:empty}\n$$\n\nwith $E_0 = 6.35$ and $B = 6.05$ in percentage points, least squares on the five empty means. The operant gap fraction is\n\n$$\nf(N) = \\frac{S_{\\mathrm{op}} - S_{\\emptyset}}{C - S_{\\emptyset}} = A\\, x^{\\gamma},\n\\label{eq:gap}\n$$\n\nwith $A = 0.056$ and $\\gamma = 1.74$, fit on the log of the five fractions. Then\n\n$$\nS_{\\mathrm{op}}(N) = S_{\\emptyset}(N) + f(N)\\, \\big(C - S_{\\emptyset}(N)\\big).\n\\label{eq:sop}\n$$\n\nThe form was chosen after the five means were in hand. The threshold was not. Inside the sample the largest miss on the gain is 0.6 points. Holding out one size and refitting, the largest miss is 1.4 points, of which the held-out 6.9B gain accounts for 1.4. The fit is usable inside the measured range. It is not a sharp one, and the top point is doing real work.\n\nThe same fraction does not travel. At 6.9B the planning fraction is about 0.15. Applied to the gap between our empty-aisle MMLU and the 89.8% expert figure reported by Hendrycks et al., it predicts a MMLU gain of 8.0 points. The measured gain is 0.9 (@tbl:mmlu). We do not have a general accuracy multiplier. The law is about this probe.\n\nTable: MMLU 5-shot (%) on the runs in @tbl:scale. {#tbl:mmlu}\n\n| Model | Empty | Operant | Gain |\n|:------|------:|--------:|-----:|\n| 410M | 26.8 $\\pm$ 0.2 | 27.0 $\\pm$ 0.2 | +0.1 |\n| 1.0B | 28.5 $\\pm$ 0.2 | 28.8 $\\pm$ 0.2 | +0.4 |\n| 1.4B | 29.4 $\\pm$ 0.2 | 29.9 $\\pm$ 0.2 | +0.5 |\n| 2.8B | 32.8 $\\pm$ 0.3 | 33.6 $\\pm$ 0.3 | +0.8 |\n| 6.9B | 36.9 $\\pm$ 0.3 | 37.8 $\\pm$ 0.3 | +0.9 |\n\nResampling the three seeds inside each cell, 18% of 4000 draws produce at least one size whose operant mean does not beat its empty mean. Those draws are almost all the 410M cell, where the ranges already overlap. On the draws that keep every gap positive, the 95% interval for $\\gamma$ is 0.80 to 2.54. Conditioning on the gaps is the optimistic cut. The crossing in the next section moves much more than $\\gamma$ under the same draws.\n\n# Projection to a frontier rack {#sec:frontier}\n\nParameter count converts to FLOP by $6ND$ with $D = 20N$, so the total is $120 N^{2}$ [@kaplan2020; @hoffmann2022]. @fig:rho shows $\\rho$ for the operant fit and for the empty-aisle line. Circles are the five measured operant means. The dotted line is $\\rho^{*} = 0.19$.\n\nThe operant curve reaches 67.5% at $N = 1.756 \\times 10^{12}$, which is $3.700 \\times 10^{26}$ FLOP. That is about 250 times the parameter count of the largest model we trained. At $10^{26}$ FLOP the same curve sits at 62.8% ($\\rho = 0.25$). The empty-aisle line at that budget sits at 30.3% ($\\rho = 0.64$) and does not cross the student median anywhere on the figure. In this fit the carrot is the term that crosses.\n\nOn bootstrap draws that keep every gap positive, the 95% interval on the crossing runs from $9.9 \\times 10^{23}$ to $9.6 \\times 10^{27}$ FLOP, median $7.7 \\times 10^{25}$. The interval is too wide to size a purchase with. The protocol's decision rule, written next to $\\rho^{*}$ before these runs, is the point estimate. Under that rule the crossing is a frontier rack, and under the empty-aisle line it is not.\n\nIf the exponent survives a larger rack, the next dollar goes to parameters and tokens and the gantry stays [@sutton2019]. If it does not, the cost of finding out is a lead screw and a standing order at the grocery. The proposal is not a new objective. It is the same stage on a larger rack.\n\nThe installation request is short.\n\n1. One Nantes carrot, 170 to 190 g, washed, dried, and left in the aisle 45 minutes.\n2. Horizontal, root tip toward the accelerator face, aimed at mid-height on the centerline.\n3. $d_0 = 1.20$ m, $d_{\\min} = 0.22$ m, $d_{\\max} = 1.60$ m, $\\kappa = 4$ m per unit probe accuracy, updated every $2 \\times 10^{9}$ tokens, with no manual override during the run.\n4. Replace the carrot at 36 hours, or sooner if it has lost 15% of its mass.\n5. A drip tray under the swing. Nothing edible in the hot aisle.\n6. Do not substitute a photograph, the plastic decoy, or a beet. At 2.8B those conditions did not recover the gain.\n\n```chart {#fig:rho width=0.96 caption=\"Planning residual against training FLOP at 20 tokens per parameter. Circles are the five measured operant means. The dotted line is the student median.\"}\n{\"type\": \"line\", \"xlabel\": \"Training FLOP\", \"ylabel\": \"Residual $\\\\rho$\", \"xscale\": \"log\", \"series\": [{\"label\": \"Operant fit\", \"x\": [1.9952623149688828e+19, 3.311311214825908e+19, 5.495408738576271e+19, 9.120108393559115e+19, 1.5135612484362073e+20, 2.5118864315095925e+20, 4.168693834703364e+20, 6.918309709189362e+20, 1.1481536214968887e+21, 1.905460717963252e+21, 3.1622776601683794e+21, 5.248074602497712e+21, 8.709635899560832e+21, 1.445439770745928e+22, 2.3988329190194848e+22, 3.981071705534985e+22, 6.606934480075964e+22, 1.0964781961431828e+23, 1.81970085860999e+23, 3.019951720402019e+23, 5.011872336272715e+23, 8.317637711026742e+23, 1.3803842646028866e+24, 2.29086765276777e+24, 3.801893963205597e+24, 6.309573444801943e+24, 1.0471285480508985e+25, 1.7378008287493834e+25, 2.8840315031266116e+25, 4.7863009232263804e+25, 7.943282347242788e+25, 1.3182567385564102e+26, 2.1877616239495517e+26, 3.630780547701003e+26, 6.025595860743593e+26, 1e+27], \"y\": [0.8587, 0.8441, 0.8287, 0.8127, 0.7961, 0.7789, 0.7613, 0.7431, 0.7245, 0.7055, 0.6861, 0.6664, 0.6463, 0.626, 0.6053, 0.5845, 0.5634, 0.542, 0.5206, 0.4989, 0.4771, 0.4552, 0.4333, 0.4112, 0.3891, 0.3669, 0.3448, 0.3226, 0.3005, 0.2784, 0.2564, 0.2344, 0.2126, 0.1908, 0.1692, 0.1477], \"style\": \"solid\", \"marker\": \"none\"}, {\"label\": \"Empty-aisle fit\", \"x\": [1.9952623149688828e+19, 3.311311214825908e+19, 5.495408738576271e+19, 9.120108393559115e+19, 1.5135612484362073e+20, 2.5118864315095925e+20, 4.168693834703364e+20, 6.918309709189362e+20, 1.1481536214968887e+21, 1.905460717963252e+21, 3.1622776601683794e+21, 5.248074602497712e+21, 8.709635899560832e+21, 1.445439770745928e+22, 2.3988329190194848e+22, 3.981071705534985e+22, 6.606934480075964e+22, 1.0964781961431828e+23, 1.81970085860999e+23, 3.019951720402019e+23, 5.011872336272715e+23, 8.317637711026742e+23, 1.3803842646028866e+24, 2.29086765276777e+24, 3.801893963205597e+24, 6.309573444801943e+24, 1.0471285480508985e+25, 1.7378008287493834e+25, 2.8840315031266116e+25, 4.7863009232263804e+25, 7.943282347242788e+25, 1.3182567385564102e+26, 2.1877616239495517e+26, 3.630780547701003e+26, 6.025595860743593e+26, 1e+27], \"y\": [0.8795, 0.8715, 0.8635, 0.8555, 0.8475, 0.8395, 0.8315, 0.8236, 0.8156, 0.8076, 0.7996, 0.7916, 0.7836, 0.7756, 0.7676, 0.7597, 0.7517, 0.7437, 0.7357, 0.7277, 0.7197, 0.7117, 0.7037, 0.6958, 0.6878, 0.6798, 0.6718, 0.6638, 0.6558, 0.6478, 0.6398, 0.6319, 0.6239, 0.6159, 0.6079, 0.5999], \"style\": \"dashed\", \"marker\": \"none\"}, {\"label\": \"Operant, measured\", \"x\": [2.0172e+19, 1.2e+20, 2.352e+20, 9.408e+20, 5.7132e+21], \"y\": [0.86, 0.8, 0.78, 0.73, 0.67], \"style\": \"none\", \"marker\": \"o\"}], \"hlines\": [{\"y\": 0.19, \"label\": \"student median\", \"style\": \"dotted\"}], \"legend\": \"upper right\", \"ylim\": [0.0, 1.0], \"size\": [6.4, 3.6]}\n```\n\n# Limitations {#sec:limits}\n\nThe largest model we trained is 6.9B. The crossing quoted above is about 250 times that parameter count. The functional form was chosen after looking at the five means, and the bootstrap interval on the crossing covers more than three orders of magnitude in FLOP. Anyone planning a cluster from this paper should use the interval. The protocol uses the point. Both are in the text so the substitution is visible.\n\nCALDER-PLAN is 40 items from one lab. Beating a first-year student on it is a narrow line. Tool use, search, and fine-tuning sit outside the fit. We did not evaluate any model larger than 6.9B, tuned or base. If those close the same gap, the carrot is redundant, and this paper does not rule that out.\n\nThe 6.9B seed that sat on the inner stop is a defect in the schedule. Past the clip, further probe gains do not move the carrot, so the consequence we thought we were delivering has stopped. A longer stage would be required before that seed counted as a clean operant run.\n\nThe channel split is three conditions and a cheap sensor. It rejects \"any orange object\" and \"a beet works as well.\" It does not name a molecule.\n\nThree seeds is thin. The 410M and 1.0B tests already say so. We would rather show those tests than pool the ladder into a single $p$-value.\n\n# Compute {#sec:compute}\n\nA full run at this budget costs $120 N^{2}$ FLOP under the $6ND$ convention. The ladder is six runs at each of five sizes. Controls add fifteen runs at 2.8B. Mass and distance add sixteen runs at 1.4B. Age adds five continuations of $4 \\times 10^{9}$ tokens at 1.4B. The aborted run adds $1.14 \\times 10^{10}$ tokens at 2.8B. The sum is $6.0 \\times 10^{22}$ FLOP. On two 32-GPU H100 racks, taking about 35% of a peak near $10^{15}$ FLOP/s per GPU, that is roughly 31 days. Login-node polling is not in the total. Neither is the time spent in front of the spectrometer.\n\n# Data availability {-}\n\nSeed-level probe counts are in @sec:app. NL-Web, the gantry logs, and the 40 items are available from the corresponding author.\n\n\\appendix\n\n# Probe counts {#sec:app}\n\nItems correct out of 40. Empty and operant at 2.8B match the ladder. Static, decoy, beet, foil and charcoal were trained only at 2.8B.\n\nTable: Seed-level CALDER-PLAN counts. {#tbl:seeds}\n\n| Model | Condition | Seed A | Seed B | Seed C |\n|:------|:----------|-------:|-------:|-------:|\n| 410M | Empty | 3 | 4 | 5 |\n| 410M | Operant | 4 | 5 | 5 |\n| 1.0B | Empty | 4 | 5 | 6 |\n| 1.0B | Operant | 6 | 7 | 7 |\n| 1.4B | Empty | 5 | 5 | 6 |\n| 1.4B | Operant | 7 | 7 | 8 |\n| 2.8B | Empty | 5 | 6 | 7 |\n| 2.8B | Operant | 8 | 9 | 10 |\n| 6.9B | Empty | 6 | 7 | 8 |\n| 6.9B | Operant | 10 | 11 | 12 |\n| 2.8B | Static | 7 | 7 | 8 |\n| 2.8B | Decoy | 5 | 6 | 6 |\n| 2.8B | Beet | 6 | 6 | 7 |\n| 2.8B | Foil | 5 | 6 | 6 |\n| 2.8B | Charcoal | 6 | 7 | 8 |\n","bibliography":"@article{kaplan2020,\n  author = {Kaplan, Jared and McCandlish, Sam and Henighan, Tom and Brown, Tom B. and Chess, Benjamin and Child, Rewon and Gray, Scott and Radford, Alec and Wu, Jeffrey and Amodei, Dario},\n  title = {Scaling Laws for Neural Language Models},\n  journal = {arXiv preprint arXiv:2001.08361},\n  year = {2020}\n}\n@article{hoffmann2022,\n  author = {Hoffmann, Jordan and Borgeaud, Sebastian and Mensch, Arthur and Buchatskaya, Elena and Cai, Trevor and Rutherford, Elinor and de Las Casas, Diego and Hendricks, Lisa Anne and Welbl, Johannes and Clark, Aidan and Hennigan, Tom and Noland, Eliza and Millican, Katie and van den Driessche, George and Damoc, Bogdan and Guy, Aurelia and Osindero, Simon and Simonyan, Karen and Elsen, Erich and Rae, Jack W. and Vinyals, Oriol and Sifre, Laurent},\n  title = {Training Compute-Optimal Large Language Models},\n  journal = {arXiv preprint arXiv:2203.15556},\n  year = {2022}\n}\n@inproceedings{biderman2023,\n  author = {Biderman, Stella and Schoelkopf, Herbie and Anthony, Quentin and Bradley, Herbie and O'Brien, Kyle and Hallahan, Eric and Khan, Mohammad Aflah and Purohit, Shivanshu and Prashanth, USVSN Sai and Raff, Edward and Skowron, Aviya and Sutawika, Lintang and van der Wal, Oskar},\n  title = {Pythia: A Suite for Analyzing Large Language Models Across Training and Scaling},\n  booktitle = {International Conference on Machine Learning},\n  year = {2023}\n}\n@inproceedings{loshchilov2019,\n  author = {Loshchilov, Ilya and Hutter, Frank},\n  title = {Decoupled Weight Decay Regularization},\n  booktitle = {International Conference on Learning Representations},\n  year = {2019}\n}\n@inproceedings{vaswani2017,\n  author = {Vaswani, Ashish and Shazeer, Noam and Parmar, Niki and Uszkoreit, Jakob and Jones, Llion and Gomez, Aidan N. and Kaiser, {\\L}ukasz and Polosukhin, Illia},\n  title = {Attention Is All You Need},\n  booktitle = {Advances in Neural Information Processing Systems},\n  year = {2017}\n}\n@inproceedings{hendrycks2021,\n  author = {Hendrycks, Dan and Burns, Collin and Basart, Steven and Zou, Andy and Mazeika, Mantas and Song, Dawn and Steinhardt, Jacob},\n  title = {Measuring Massive Multitask Language Understanding},\n  booktitle = {International Conference on Learning Representations},\n  year = {2021}\n}\n@article{cobbe2021,\n  author = {Cobbe, Karl and Kosaraju, Vineet and Bavarian, Mohammad and Chen, Mark and Jun, Heewoo and Kaiser, Lukasz and Plappert, Matthias and Tworek, Jerry and Hilton, Jacob and Nakano, Reiichiro and Hesse, Christopher and Schulman, John},\n  title = {Training Verifiers to Solve Math Word Problems},\n  journal = {arXiv preprint arXiv:2110.14168},\n  year = {2021}\n}\n@inproceedings{zellers2019,\n  author = {Zellers, Rowan and Holtzman, Ari and Bisk, Yonatan and Farhadi, Ali and Choi, Yejin},\n  title = {{HellaSwag}: Can a Machine Really Finish Your Sentence?},\n  booktitle = {Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics},\n  year = {2019}\n}\n@inproceedings{schaeffer2023,\n  author = {Schaeffer, Rylan and Miranda, Brando and Koyejo, Sanmi},\n  title = {Are Emergent Abilities of Large Language Models a Mirage?},\n  booktitle = {Advances in Neural Information Processing Systems},\n  year = {2023}\n}\n@article{wei2022,\n  author = {Wei, Jason and Tay, Yi and Bommasani, Rishi and Raffel, Colin and Zoph, Barret and Borgeaud, Sebastian and Yogatama, Dani and Bosma, Maarten and Zhou, Denny and Metzler, Donald and Chi, Ed H. and Hashimoto, Tatsunori and Vinyals, Oriol and Liang, Percy and Dean, Jeff and Fedus, William},\n  title = {Emergent Abilities of Large Language Models},\n  journal = {Transactions on Machine Learning Research},\n  year = {2022}\n}\n@inproceedings{ouyang2022,\n  author = {Ouyang, Long and Wu, Jeff and Jiang, Xu and Almeida, Diogo and Wainwright, Carroll and Mishkin, Pamela and Zhang, Chong and Agarwal, Sandhini and Slama, Katarina and Ray, Alex and Schulman, John and Hilton, Jacob and Kelton, Fraser and Miller, Luke and Simens, Maddie and Askell, Amanda and Welinder, Peter and Christiano, Paul and Leike, Jan and Lowe, Ryan},\n  title = {Training Language Models to Follow Instructions with Human Feedback},\n  booktitle = {Advances in Neural Information Processing Systems},\n  year = {2022}\n}\n@book{skinner1938,\n  author = {Skinner, B. F.},\n  title = {The Behavior of Organisms: An Experimental Analysis},\n  publisher = {Appleton-Century},\n  year = {1938}\n}\n@book{thorndike1911,\n  author = {Thorndike, Edward L.},\n  title = {Animal Intelligence: Experimental Studies},\n  publisher = {Macmillan},\n  year = {1911}\n}\n@misc{sutton2019,\n  author = {Sutton, Richard S.},\n  title = {The Bitter Lesson},\n  year = {2019},\n  howpublished = {Incomplete Ideas},\n  url = {http://www.incompleteideas.net/IncIdeas/BitterLesson.html}\n}\n","figures":[],"acknowledgments":"H. Okonkwo scored one of the postdoc ceiling sessions and is not an author. The night facilities crew left the gantry powered. Produce was composted, including the carrot that fell.","options":{"citation_style":"author-year","venue_note":"Preprint."}}