The Experience Bottleneck
Physical AI Robotics

The Experience Bottleneck

Language models inherited a corpus. Robots have to earn every hour of theirs, and that changes the arithmetic behind every AGI forecast.

Ibrahim AbuAlhaol, PhD, P.Eng., SMIEEE

AI Technical Lead

Published: July 30, 2026 | Reading Time: 8 min

Language models learned to write from text that already existed. Nobody had to produce it for them. A robot learning to fold a shirt has no comparable library, and that one asymmetry explains more about the state of physical AI than any argument about model architecture does.

The popular framing treats embodiment as the next scaling problem: take the recipe that worked for language, point it at hardware, wait. But scaling laws describe what happens when you add data. They are silent on whether the data can be obtained at all. For text, supply was a stock that human civilization had already written down. Llama 3 was pretrained on more than 15 trillion tokens from public sources, gathered at almost no cost per token. For robots, supply is a flow. Physical Intelligence trained its π0 model on over 10,000 hours of data across seven robot configurations, and the Open X-Embodiment collaboration pooled 60 datasets from 34 laboratories to reach roughly a million real trajectories. Every hour inside those numbers was a physical machine moving in real time.

Text was a stock that already existed. Embodied experience is a flow you buy in wall-clock time, on hardware you own and maintain. Scaling laws say nothing about the purchase rate.

Two kinds of data, two kinds of cost

Put the two training regimes on the same axis and the distance is easier to accept than to argue with. It is roughly four orders of magnitude, and it is not closing through effort alone.

Recorded training experience for a language model compared with a robot policy, on a logarithmic scale Llama 3 was trained on about 1.5 times 10 to the 13 tokens. The pi-zero robot policy used about 9 times 10 to the 8 recorded timesteps. The distance between them is about four orders of magnitude. Recorded training experience, log scale Each gridline is a factor of ten 10⁶ 10⁷ 10⁸ 10⁹ 10¹⁰ 10¹¹ 10¹² 10¹³ 10¹⁴ Language 15T tokens, scraped Embodied 0.9B timesteps, performed about 4 orders of magnitude A token and a timestep are different units. The exponent and the cost per unit are the point.
Figure 1. The comparison is deliberately loose about units, because the honest version of this chart cannot be tight: a text token and a robot timestep measure different things. What survives the unit mismatch is the exponent and, more importantly, the price. A token costs a web crawl. A timestep costs a robot, an operator, a reset, and a second of real time that cannot be parallelized away. Sources: Llama 3 model card; π0 (arXiv 2410.24164).

This is why the binding constraint in physical AI is throughput of practice rather than parameter count. You can rent ten thousand accelerators this afternoon. You cannot rent ten thousand robot-years of contact experience, because nobody has it to lend, and generating it consumes calendar time at a fixed exchange rate. A fleet that collects data eight hours a day produces eight hours of data a day, and no amount of capital changes that ratio without more machines and more operators.

What Moravec got right, and where the story is thinner than it looks

The usual explanation reaches for Moravec's paradox. In Mind Children (1988), Hans Moravec observed that it was comparatively easy to get computers to adult-level performance on intelligence tests or checkers, and difficult or impossible to give them the perception and mobility of a one-year-old. The lesson drawn from it is that human-easy implies machine-hard.

That lesson deserves more scrutiny than it usually gets. Arvind Narayanan has argued the paradox has never really been fact-checked, and that its apparent support comes from selection bias: the anecdotes always compare chess against laundry and quietly skip the tasks that are easy for both humans and machines, and the tasks that are hard for both. Open-domain reasoning in law or science is difficult for current systems, and Moravec's scheme would have filed it under easy. Once the ignored cells return to the picture, the clean inverse relationship stops being clean.

A two-by-two grid of task difficulty for humans and for machines Moravec's paradox draws on two diagonal cells: easy for humans and hard for machines, such as folding laundry, and hard for humans and easy for machines, such as ten digit multiplication. The other two cells, easy for both and hard for both, are usually left out of the comparison. The paradox lives on one diagonal easy for humans hard for humans hard for machines easy for machines CITED BY MORAVEC Folding laundry Opening an unfamiliar door Continuous control, contact, recovery from small errors LEFT OUT Open-domain legal and scientific reasoning Moravec's scheme predicts this should be easy. It is not. LEFT OUT Reading printed text Neither side finds this hard, so it never enters the anecdote CITED BY MORAVEC Ten-digit multiplication Checkers, then chess Discrete, closed, fully specified rules
Figure 2. Keep only the two coloured cells and an inverse relationship appears by construction. The dashed cells are the ones the standard telling omits. The usable claim is narrower than the slogan: difficulty tracks whether competence lives in continuous closed-loop control under contact, where the data is expensive, rather than in a closed rule set, where it is cheap. Sources: Moravec, Mind Children; Narayanan, "Fact checking Moravec's paradox".

The gap you can randomize away, and the gap you cannot

If real experience is the expensive input, simulation looks like the way out. Simulated robots run faster than real time, in parallel, without maintenance. The standard technique is domain randomization: perturb the simulator's physical parameters during training so the policy learns to work across a distribution of dynamics, and the real world becomes one more sample from that distribution. It works. Legged locomotion and gross manipulation have both crossed from simulation into hardware this way.

The limit is specific and worth stating precisely. Domain randomization can only close gaps the simulator represents. Randomizing friction, mass, latency, and lighting covers the parameters someone thought to expose. Sim-to-real surveys point out that it does nothing for the effects the simulator omits entirely: contact and deformation, aerodynamic detail, wear, and response delays that were never in the model. You cannot randomize over a variable that does not exist in your equations.

The reality gap divided into a parameterizable band and a structurally unmodeled band Domain randomization spans the lower band of the reality gap, which holds parameters the simulator already represents such as friction, mass and latency. The upper band holds effects absent from the simulator such as contact deformation, aerodynamics and wear, which randomization cannot reach. Randomization reaches only what the simulator already represents Simulator cheap, parallel Reality slow, serial NOT IN THE MODEL AT ALL Contact and deformation, aerodynamic detail, wear, unmodeled response delays randomization cannot reach what is absent PARAMETERS THE SIMULATOR EXPOSES Friction, mass, actuator gain, latency, lighting, sensor noise domain randomization transfers across these
Figure 3. The practical consequence is a task-selection rule rather than a research agenda. Work whose physics your simulator actually contains can be bought cheaply in simulation. Contact-rich dexterity sits in the upper band, which is why it stays stubbornly expensive and why it still consumes real robot hours. Source: Zhao et al., "Sim-to-Real Transfer in Deep Reinforcement Learning for Robotics: a Survey" (arXiv 2009.13303).

Where the opportunity actually sits

The field's most productive response has been to stop paying for what it can inherit. Google DeepMind's RT-2 showed that a vision-language model trained on web data transfers that knowledge into robotic control, so the robot arrives already knowing what a banana is and what "put it in the bowl" means. Physical Intelligence built π0 on top of PaliGemma, a 3-billion-parameter vision-language model, and added a flow-matching action head. Open X-Embodiment went further and pooled trajectories across 22 different robot bodies, then found that policies trained on the pool beat policies trained on any single embodiment, including in domains that already had plenty of data.

Read together, those results describe a division of labour. Semantics, object knowledge, and language understanding come from data that is already abundant and still growing for free. Scarce robot data gets spent only on the part nothing else can supply: the mapping from intent to actuation on a specific body. That is the opportunity, and it is an engineering strategy rather than a hope.

Two input streams of very different cost feeding a vision-language-action policy Abundant web text and images train the semantic backbone. Scarce robot trajectories pooled across many embodiments train only the action head that maps intent to actuation. Spend the scarce data only where nothing else can substitute ABUNDANT, FREE Web text and images what objects are, what instructions mean SCARCE, PAID IN HOURS Robot trajectories 1M+ pooled across 22 embodiments Vision-language backbone Action head intent to actuation RT-2, π0, RT-X Policy on new tasks Pooling across bodies raised performance even where single-embodiment data was already plentiful.
Figure 4. The economics also explain why cross-embodiment pooling matters beyond the accuracy gain: shared data pools are the only mechanism that lets one organization's robot hours reduce another's. Sources: RT-2 (arXiv 2307.15818); π0 (arXiv 2410.24164); Open X-Embodiment (arXiv 2310.08864).

What this says about AGI

Two camps disagree about whether any of this is on the critical path. One holds that general intelligence requires grounding: that a system with no ability to act on the world and observe the consequences cannot acquire causal understanding, only correlational summaries of someone else's. The other holds that competent physical action is a useful application of general intelligence rather than a precondition for it, and that reasoning can be learned from description alone. The argument is unresolved and will not be settled by assertion.

What the data economics settle is narrower and more useful. If grounding is required, then the arrival of general intelligence is governed by an acquisition rate rather than a compute budget, because the necessary experience has to be generated by machines acting in real time. That reframes the forecast from an algorithms question into a question about fleets, operators, and calendar time, which behaves very differently: it is slower, more capital-intensive, and much harder to accelerate with a breakthrough. Anyone quoting an AGI date on the strength of a training-compute curve is answering a question about text and presenting it as an answer about the world.

The strategic asymmetry follows from the same arithmetic. Deployment is data collection, so whoever fields machines earliest compounds fastest, and the advantage is cumulative in a way model weights are not. A competitor can match your architecture in a quarter. They cannot retroactively collect the robot hours you started gathering two years ago.

What leaders should do

  1. Instrument every deployed machine for data capture before you optimize its autonomy. Deployment is the only faucet you control, and unrecorded operating hours are permanently lost.
  2. Select automation targets by contact complexity rather than by how hard the job looks to a person. Work whose physics your simulator already models is cheap to train. Contact-rich dexterity is not, and no vendor roadmap changes that.
  3. Put teleoperation on the balance sheet with an hourly rate, and track cost per successful trajectory as an operating metric. Teams that do not measure it discover their data cost after committing to it.
  4. Join or fund a cross-embodiment data pool instead of assuming your own fleet will reach useful scale. The Open X-Embodiment result is that pooled data beats private data, including for organizations that already had plenty.

Related Articles

References & Extended Literature

  1. Moravec, H. Mind Children: The Future of Robot and Human Intelligence. Harvard University Press, 1988. Summary of the argument: Moravec's paradox.
  2. Narayanan, A. "Fact checking Moravec's paradox." Normal Technology. normaltech.ai/p/fact-checking-moravecs-paradox
  3. Open X-Embodiment Collaboration. "Open X-Embodiment: Robotic Learning Datasets and RT-X Models." arXiv:2310.08864. arxiv.org/abs/2310.08864
  4. Black, K. et al. "π0: A Vision-Language-Action Flow Model for General Robot Control." arXiv:2410.24164. arxiv.org/abs/2410.24164
  5. Brohan, A. et al. "RT-2: Vision-Language-Action Models Transfer Web Knowledge to Robotic Control." arXiv:2307.15818. arxiv.org/abs/2307.15818
  6. Zhao, W., Queralta, J.P., Westerlund, T. "Sim-to-Real Transfer in Deep Reinforcement Learning for Robotics: a Survey." arXiv:2009.13303. arxiv.org/abs/2009.13303
  7. Meta AI. "Llama 3 model card." Pretraining corpus of more than 15 trillion tokens. github.com/meta-llama/llama3