Nociception as a Control Primitive: Afferent Channels and Nociceptive Memory for Agents Deployed in One Body
Organizations: Saarland University and German Research Center for Artificial Intelligence (DFKI)
Abstract
An agent deployed in a single body cannot learn how fast that body wears, because every trial that would reveal its wear resistance wears the body it would protect. We study this \emph{epoch-one} setting, in which the parameters of a fixed-weight policy are set before the body is drawn and never updated in life. The agent carries a load-gated nociceptive channel and a memory that retains what was felt. We prove that felt cost moves the allocation to the best-\emph{paid} work not yet felt rather than the gentlest, that an agent without retention never sees the felt-cost constraint bind, and that the channel pays only where the threat is individually unpredictable, cheap to avoid and expensive to ignore. We measure per body, setting the agent with channel and memory against the same individual without them, where neither carries a schedule learned across lives. On simulated floor-layer knees, with wear anchored to published loss rates, feeling, retaining and substituting extends the working life from age to and raises career output from to . of bodies gain and \textbf{none lose}. A body that feels but retains nothing past the day gains one of the years, and retention carries the rest. A population-trained agent gains years from the same channel at output. The difference is what a species prior already supplies, and a single body has none. The two are related by an identity, the ablation mean reporting of the per-body value with the share a blind schedule already captures, so we report both. Where the regime map predicts value, a care robot sextuples its certified service life and a field-anchored fleet writes off of its machines instead of . Where it predicts none, a rover gains little over blind caution, so the map holds in both directions.
Figures & tables
| floor layer, absolute | care robot | rover | fleet | |||||||
| what the body does | works to | output | life | output | life | output | life | output | ||
| works at full effort, reads nothing | ||||||||||
| spares from the first day † | ||||||||||
| fixed endowment †§ | — | — | — | — | — | — | ||||
| trained, feels nothing ‡ | ||||||||||
| trained, full stack ‡ | ||||||||||
Appendix figures & tables10 assets
Supplementary material from the paper’s appendix.
Appendix
| wear takes the movement away | no wear | |||
| what the body carries | floor layer | care robot | latent-defect agent | |
| loses trade | decertified | written off | ||
| feels, minds, remembers | ||||
| feels nothing | ||||
| feels, is not moved to act | n.s. | n.s. | ||
| feels and acts, but forgets | n.s. | n.s. | ||
| variant | entr. | full | ignorant | memory heur. | |||
|---|---|---|---|---|---|---|---|
| cascade | / | / | / | / | / | / | |
| cascade | / | / | / | / | |||
| cascade , seeds | / | / | / | / | / | / | |
| defective, | / | / | / | / | / | / | |
| defective, | / | / | / | / |
| what was wrong | what it produced, and the check |
| The floor was switched off in both machine configurations | Sparing costs nothing, so the felt arms lose, output against blind caution, and with the floor restored the same probe gains months. Check that the floor can bind. |
| The rover’s floor was on the wrong quantity | It scored science yield while the mission is the traverse, so a portfolio parked at the instrument station cleared the floor at zero speed and the sparing arm completed of milestones in every life. Fixed with a progress floor at the rover’s own plan rate. |
| The rover’s mission ends long before its career does | Every policy completes all three milestones by month – of and earns the same reward to within , so of the horizon is driving with nothing left to achieve. No floor repairs this, and the run was withdrawn for the design in Table 1 . |
| The horizon censored the protected arms | of felt lives ran into the care robot’s horizon against of insensate ones, understating the effect roughly tenfold, becoming once the horizon was lifted. Check that censoring falls on both arms alike. |
| Career length was not in the objective | Under average-reward training an episode ending on losing the work costs nothing, since episode length does not enter a per-step average, mean reward without an absorbing exit against with it. Every ablation then beat the intact stack. One common functional across arms, and the training signal is never the endpoint. |
| Career length could not move in the capacity-exit acute knee | Every fixed probe reached exactly over bodies, since under maximal load damage reached only by and the only exit was the clock. Re-anchored, the exit fires in of lives and careers end at . Check, before any arm is compared, that the world can express protection at all. |
| the result | the mechanism | |||||
|---|---|---|---|---|---|---|
| what the body carries | works to | output | on the knees | on gentle work | returns | at |
| reads nothing | ||||||
| present signal, no retention | – | – | ||||
| reads the signal and remembers | ||||||
| cell ( , work available) | years | CI | output | CI |
|---|---|---|---|---|
| , | [ , ] | [ , ] | ||
| , | [ , ] | [ , ] | ||
| , | [ , ] | [ , ] | ||
| , | [ , ] | [ , ] | ||
| , | [ , ] | [ , ] | ||
| , | [ , ] | [ , ] |
| world (exit rule) | same body without / with | body endpoint | career (y, CI), and | gain/lose |
|---|---|---|---|---|
| knee, wear with tears, (total-output floor, gate cell) | ignorant / full | early exit ; tears per exposed year unchanged | ; (all) | / |
| knee, wear with tears, | same | cap rarely binds | ; | / |
| fleet (absorbing death) | uniform static / one-shot nociceptive memory | written off in of lives against ; service months, output | ( ) | / |
| care robot, anchored floor | full contact / reads the signal and spares | service months | output ( ) | / |