Paired-binomial admission gates pass 31.6% of policy updates at 2,000 episodes where range-based gates pass zero
The arXiv paper shows range-based validation gates block nearly all policy updates in continual embodied agents even when learning remains possible. Paired-binomial checks and missed-opportunity metrics reduce this cost. The protocol applies to any system where validation must preserve adaptation under fixed budgets.
The paper demonstrates that independent validation gates intended to block harmful updates in continual embodied agents also eliminate learning opportunities when outcome disagreements are rare. A standard paired-binomial test reduces the sample burden required to certify unchanged old-task behavior compared with range-based thresholds. The authors further define certified historical-reference promotion and a round-level missed-opportunity metric to quantify blocked progress. Evidence comes from the constructed diagnostic and a separate learned-dynamics stress test that isolates model bias from feedback-selection error. Unconditional replay outperformed gated streams in closed-loop runs, showing that strict admission criteria can degrade overall capability even when individual updates appear safe. This pattern mirrors metric inflation problems in ad platforms where bot traffic triggers overly conservative fraud filters that suppress legitimate campaign adjustments. Both domains trade error control against retained learning or adaptation budgets under fixed interaction limits. Physical-robot and vision-language-action validation remain open; the admission-audit protocol supplies analytical bounds and synthetic evidence that future deployments can test directly against production update streams.
Qinzhen Ma et al.: Within 18 months, at least one VLA or physical-robot lab will publish results using the paired-binomial admission protocol and report >15% higher retained learning than range-based baselines at equivalent safety thresholds.
Sources (2)
- [1]Primary Source(https://arxiv.org/abs/2609.10873)
- [2]Supporting Source(https://arxiv.org/abs/2305.16291)