arXiv Weekly Digest — Week 37, 2026

Fetched: 2026-09-07 | Categories: cs.RO, cs.LG, cs.HC, cs.CV | Papers: 20

Note: cs.RO API endpoint was rate-limited this run; papers with cs.RO as a secondary category are included from cs.LG/cs.CV/cs.HC results.

VLA-Precision: Asymmetric Co-Bootstrapping for Efficient Real-World Online RL of Vision-Language-Action Models

Authors: Chenyu Su, Zhaolong Shen, Yuan Qian et al. | Submitted: 2026-09-03 | arXiv: 2609.04355 Categories: cs.RO, cs.AI, cs.HC, cs.LG

Research Background: Pretrained VLA models excel at broad manipulation but struggle with precision tasks. Real-world online RL offers a path to self-improvement beyond demonstrations, yet VLA-specific challenges — unreliable value signals and large model overhead — limit throughput.

Technical Approach: VLA-Precision introduces Asymmetric Co-Bootstrapping (ACoB), which pairs a lightweight critic with the full VLA policy to stabilize value estimation and reduce per-step overhead. A distilled small-VLA handles high-frequency inference while the large model provides periodic value anchors, together improving sample efficiency in real-world RL loops.

Key Takeaway: ACoB enables efficient online RL for VLAs without sacrificing manipulation precision, demonstrating that asymmetric architectures can decouple sample throughput from model size.

Toward Physically Grounded JEPA World Models for Goal-Conditioned Robotic Planning

Authors: Muyuan Liu, Yue Huang, Zheng Liang et al. | Submitted: 2026-09-03 | arXiv: 2609.03565 Categories: cs.RO, cs.AI, cs.LG

Research Background: Action-conditioned JEPA world models allow planning toward visual goals without pixel reconstruction, but latent predictions may discard control-relevant information, limiting their utility for robotic policy learning.

Technical Approach: The authors augment JEPA latent prediction with an inverse dynamics module (IDM) to prevent latent collapse and a state alignment (SA) term that grounds consecutive representations in physical states. The combined objective ensures latents remain informative about actions and physically meaningful across time steps.

Key Takeaway: Adding IDM and state alignment to JEPA world models substantially improves goal-conditioned planning by ensuring latent representations preserve action-relevant and physically grounded information.

Authors: Haoyuan Deng, Haichao Liu, Wenkai Guo et al. | Submitted: 2026-09-01 | arXiv: 2609.01596 Categories: cs.RO, cs.LG

Research Background: Sub-millimeter robotic assembly demands spatial precision and compliant contact reasoning — capabilities that general-purpose VLA models trained on diverse demonstrations often lack.

Technical Approach: Facet-0 unifies multimodal representation learning with RL post-training via a joint action-wrench proposal: it aligns causal wrench history with vision-language semantics and kinematic state, and uses flow matching to generate each action chunk together with its predicted wrist-wrench profile. A RL stage then refines the policy against contact outcomes.

Key Takeaway: Predicting future contact forces alongside actions allows Facet-0 to handle contact-rich assembly at sub-millimeter tolerances that elude standard VLA approaches.

Motus2: A Self-Evolving General World Model for Dexterous Manipulation

Authors: Hongzhe Bi, Zihao Zhou, Yihang Tang et al. | Submitted: 2026-08-31 | arXiv: 2608.30237 Categories: cs.RO, cs.AI, cs.CV, cs.LG

Research Background: Embodied agents need to perceive, predict, act, evaluate, and self-improve within a unified system. Existing world models typically bolt an action head onto a simulator without closing the policy-improvement loop.

Technical Approach: Motus2 exposes three control interfaces through a single shared-weight model: a policy (world-action model), a critic for evaluation, and a generator for data synthesis. Scaling both model capacity and training data enables continual self-improvement via the closed decision-and-learning loop without external supervision.

Key Takeaway: A single unified model covering policy, critic, and data generation can self-evolve for dexterous manipulation tasks, making generalist embodied agents feasible without task-specific architectures.

REFACTOR-VLA: Unsupervised Library Learning of Typed Motor Programs

Authors: Riyaaz Shaik, Chandru Venkataraman | Submitted: 2026-09-01 | arXiv: 2609.01215 Categories: cs.LG, cs.AI, cs.RO

Research Background: Monolithic VLA models (OpenVLA, π₀, RT-2, RDT-1B) emit raw motor commands without organizing behavior into reusable skills, causing degradation on long-horizon tasks and poor interpretability. Existing skill discovery methods lack principled criteria for behavioral equivalence.

Technical Approach: REFACTOR-VLA uses a wake/sleep framework: during sleep, it identifies behaviorally equivalent action sequences using typed motor program abstractions calibrated to robot dynamics; during wake, the discovered library is used to decompose new tasks. This avoids relying on language model judgments uncalibrated to physical dynamics.

Key Takeaway: Unsupervised library learning of typed motor programs improves VLA performance on long-horizon tasks by surfacing reusable skills grounded in the robot’s actual dynamics.

RoboTok: An Internet-Scale Data Engine for Human Demonstration Retrieval and Dexterous Manipulation Learning

Authors: Howard Qian, Yiting Chen, Yunfei Xie et al. | Submitted: 2026-09-02 | arXiv: 2609.03199 Categories: cs.CV, cs.RO

Research Background: Robot learning requires broad, diverse demonstrations, but collecting robot-specific data is expensive and poorly covers the long tail of real-world tasks. Web videos of human manipulation offer a scalable alternative if relevant clips can be reliably retrieved.

Technical Approach: RoboTok learns a latent motion space from 3D hand trajectories in actor-centered reference frames, enabling retrieval of manipulation-relevant human demonstrations from web video. Retrieved human clips are then used to train dexterous robot policies via cross-embodiment transfer.

Key Takeaway: Learning embodiment-agnostic motion representations allows internet-scale human video to serve as an effective data source for training dexterous robot manipulation policies.

Does Imitation Learning Preserve Temporal Robustness in Dexterous Manipulation?

Authors: Clinton Enwerem, John S. Baras, Calin Belta | Submitted: 2026-09-01 | arXiv: 2609.01453 Categories: cs.RO, cs.LG

Research Background: Imitation-learned manipulation policies are routinely evaluated for robustness to scene and object variation, but their sensitivity to task execution speed — a common real-world perturbation — is rarely examined relative to expert demonstrators.

Technical Approach: The authors compare expert and imitation-learned policies on ParcelStow, a contact-rich package insertion task, across a systematic range of speedup factors with matched initial conditions. They quantify the gap in temporal robustness between expert and learner and trace failure modes to specific phases of the task.

Key Takeaway: Imitation learning does not fully preserve the temporal robustness of expert demonstrators, with clear degradation emerging at higher speedup factors in contact-rich tasks.

FailureSpot: Label-Efficient Timestamp-Level Failure Detection for Vision-Language-Action Models

Authors: Jie Ma, Zongxi Liu, Yi Zhu | Submitted: 2026-09-03 | arXiv: 2609.04277 Categories: cs.RO, cs.CV

Research Background: VLA policies can fail unpredictably during long-horizon execution, and reliable failure detection is essential for safe deployment. Existing proactive detectors trained on VLA internal representations use trajectory-level labels, causing pre-failure behavior to be mislabeled as normal.

Technical Approach: FailureSpot leverages VLA internal representations with timestamp-level supervision, requiring only a small number of labeled failure moments rather than full trajectory annotations. A label-efficient training scheme propagates temporal failure signals to reduce annotation cost while improving detection precision and timing.

Key Takeaway: Timestamp-level supervision dramatically reduces labeling requirements for VLA failure detection while enabling more timely, accurate identification of impending manipulation failures.

Sensing Which Modality Matters: Evidence-Gated Regularization for Robust VLA Policies

Authors: Yue Yang, Diego Romeres, Chiori Hori et al. | Submitted: 2026-09-02 | arXiv: 2609.03142 Categories: cs.RO, cs.CV, cs.LG

Research Background: VLA policies fuse multimodal inputs but training on limited homogeneous demonstrations encourages spurious inter-sensor correlations — a failure the authors term modality entanglement — leading to brittleness under real-world sensor occlusions and distractors.

Technical Approach: Evidence-Gated Regularization (EGR) introduces a modality-agnostic training objective using evidential uncertainty to weight each sensor’s contribution per sample. The gating mechanism penalizes reliance on uninformative modalities and adds zero inference-time overhead, requiring no architecture changes.

Key Takeaway: EGR substantially improves VLA robustness to sensor corruption and occlusion by training policies to rely on whichever modality carries task-relevant evidence rather than all sensors uniformly.

Humanoid Safe Stop via Learned Stoppability Value

Authors: Junfeng Long, Pieter Abbeel, Koushil Sreenath et al. | Submitted: 2026-09-02 | arXiv: 2609.02358 Categories: cs.RO, cs.LG, eess.SY

Research Background: Humanoid emergency stops typically execute a fixed maneuver regardless of feasibility from the current state, which can itself cause falls or collisions. Reasoning about stoppability in context is an open problem for humanoid safety.

Technical Approach: Safe-Stop casts emergency stopping as a reach-avoid problem and trains complementary estimators: a stop-probability estimator supervised by outcomes of the fixed stop policy, and a Hamilton-Jacobi reach-avoidance estimator over physical state. A learned stop policy then conditions on these estimates to select feasible stopping trajectories.

Key Takeaway: Learning context-aware stoppability values enables humanoids to determine when and how to safely execute an emergency stop, reducing fall risk relative to fixed-maneuver baselines.

Human-Robot Conversation with Multiple Participants in Noisy Public Spaces

Authors: Divesh Lala, Yogeeswaran Muthukumaran, Vincent Fernandes et al. | Submitted: 2026-09-01 | arXiv: 2609.00648 Categories: cs.RO, cs.HC

Research Background: Spoken dialogue systems for public-space robots and avatars must handle noisy acoustic environments and multi-party conversations — conditions that standard single-channel speech pipelines fail to handle gracefully.

Technical Approach: The authors deploy an audio system combining microphone array beamforming with speaker-aware speech enhancement for two scenarios: an attentive-listening android (ERICA) and a remote-operator avatar system. Both were validated at the 2025 World Expo in Osaka with real multi-participant interactions in open public spaces.

Key Takeaway: Dedicated noise-robust audio pipelines combined with speaker tracking are necessary for reliable multi-participant HRI in real-world public deployments.

Adaptive Vision-Language Grasping via Composable Foundation Priors and Generalizable Grasp Synthesis

Authors: Sixu Yan, Shikang Wang, Binhua Huang et al. | Submitted: 2026-09-03 | arXiv: 2609.04096 Categories: cs.RO, cs.AI, cs.CV

Research Background: Existing vision-language grasping (VLG) methods tightly couple foundation models with end-to-end policies, limiting cross-hand generalization and making task-specific adaptation expensive.

Technical Approach: AdaRoboVLG separates a generalizable base policy — which generates and evaluates grasp candidates via kinematic mapping and force-closure stability — from task-dependent foundation model modules that supply composable priors. This modular design allows swapping or combining VLM modules without retraining the grasp policy.

Key Takeaway: Decoupling grasp synthesis from task-dependent VLM priors enables cross-robot-hand generalization and efficient task adaptation without end-to-end retraining.

Spatially Aware World Action Model via Geometric Latent Diffusion

Authors: Javier Alejandro Lopetegui Gonzalez, Paul Pacaud, Cordelia Schmid | Submitted: 2026-09-02 | arXiv: 2609.02531 Categories: cs.CV, cs.RO

Research Background: World Action Models (WAMs) inherit rich priors from internet-scale video pretraining and jointly predict future observations and actions, but prevailing models operate on RGB only, ignoring available 3D structure.

Technical Approach: SA-WAM repurposes a pretrained video diffusion model for joint action, RGB, and depth prediction via geometric latent diffusion. Conditioning on geometric latents enables 3D-aware scene prediction, and the shared diffusion backbone allows efficient joint RGB-depth generation without separate depth models.

Key Takeaway: Incorporating 3D geometric latents into a video-pretrained WAM yields more physically consistent future predictions and improved robot policy performance compared to RGB-only baselines.

Recursive Value Learning for Long-Horizon Offline Goal-Conditioned RL

Authors: Hyeonseong Jeon, Youngwoon Lee | Submitted: 2026-09-02 | arXiv: 2609.02237 Categories: cs.LG, cs.RO

Research Background: Long-horizon offline goal-conditioned RL suffers from compounding value estimation errors and overestimation amplification during max-based Bellman backups, making reliable policy learning across long trajectories difficult.

Technical Approach: DCRL (Divide-and-Conquer RL) recursively decomposes each trajectory segment into a balanced binary tree and trains values from leaves to root. Each parent update is conditioned on children that are already accurate, using exact factorization of the observed trajectory rather than noisy argmax selection.

Key Takeaway: Recursive binary-tree value decomposition eliminates Bellman bootstrapping errors in long sequences, enabling accurate offline GCRL across substantially longer horizons than flat backup methods.

Authors: Zhixin Wang, Chengzheyi Yao, Leyuan Liu et al. | Submitted: 2026-09-01 | arXiv: 2609.00920 Categories: cs.RO, cs.CV

Research Background: Vision-and-Language Navigation requires multi-step instruction following in unseen 3D environments, and explicit reasoning improves semantic grounding but autoregressive generation at each step accumulates prohibitive latency.

Technical Approach: VerNav replaces per-step autoregressive generation with batched action verification: a lightweight verifier checks candidate actions before committing, and an entropy-based adaptive generator is invoked only when verification confidence is low. This verifier-first pipeline preserves reasoning quality while dramatically reducing decision-stage latency.

Key Takeaway: Batched action verification can match or exceed autoregressive LLM navigation accuracy while reducing per-step latency by an order of magnitude, making real-time VLN deployable.

Accelerating RL via MPC Solver-Gradient Guidance for Weights-varying MPC

Authors: Baha Zarrouki, Arslan Thobani, Jasper Hoffmann et al. | Submitted: 2026-09-01 | arXiv: 2609.01061 Categories: cs.RO, cs.LG, eess.SY

Research Background: MPC weight adaptation via RL is sample-inefficient because the mapping from policy parameters to closed-loop behavior passes through a black-box numerical solver, creating nonlinear, nonsmooth dependencies that gradient-free RL must navigate blindly.

Technical Approach: The authors differentiate through the MPC solver to obtain analytical gradient guidance for RL policy updates, combining gradient-based policy learning with RL’s realized-return optimization to trade off bias and variance. The hybrid approach uses solver gradients to accelerate early learning while RL corrects for model mismatch.

Key Takeaway: Analytical MPC solver gradients used as RL guidance dramatically improve sample efficiency for learning context-adaptive MPC weight policies compared to pure RL or gradient-based methods alone.

SV-WAM: An Efficient Surround-View World-Action Model for End-to-End Autonomous Driving

Authors: Jinyang Wang, Shiwei Li, Junjian Wang et al. | Submitted: 2026-09-03 | arXiv: 2609.03602 Categories: cs.CV, cs.RO

Research Background: Driving World Action Models trained on single front-camera input sacrifice spatial coverage needed for safety-critical maneuvers such as lane changes and merges. Multi-camera WAMs incur high computational overhead that limits real-world deployment.

Technical Approach: SV-WAM processes six surround-view cameras simultaneously using a spatially efficient attention design that maintains 360° coverage without proportional compute increase. A shared temporal encoder aligns observations across viewpoints, enabling consistent action prediction under spatially complex driving scenarios.

Key Takeaway: Efficient surround-view world-action modeling closes the spatial coverage gap of single-camera WAMs while remaining deployable under real-world compute constraints.

PRACTICE: From Experience to Expertise in Self-Evolving Embodied Agents

Authors: Ziyi Bai, Siqi Li, Tinglei Huang et al. | Submitted: 2026-08-31 | arXiv: 2608.30760 Categories: cs.LG

Research Background: Multimodal LLMs serving as embodied agents can translate instructions into plans, but continual self-improvement through interaction without manually designed prompting workflows remains an open challenge for adapting to new environments.

Technical Approach: PRACTICE introduces a self-evolving experience system that automatically extracts, organizes, and updates skills from interaction trajectories without fixed prompting templates. A meta-learning procedure over past episodes allows the agent to refine its own skill library and retrieval strategy as it accumulates experience.

Key Takeaway: Allowing embodied LLM agents to autonomously manage their own skill libraries enables continuous improvement from interaction without hand-engineered prompting pipelines.

Aligning Multi-Trajectory Supervision with Policy Optimization for VLA Driving

Authors: Tian Zhang, Zhuo Huang, Hongrui Ye et al. | Submitted: 2026-08-31 | arXiv: 2608.30122 Categories: cs.CV, cs.AI, cs.LG

Research Background: VLA driving methods combining multi-trajectory imitation learning with GRPO (group-relative policy optimization) suffer from trajectory selection misalignment: some high-scoring imitation trajectories induce advantage estimates outside the policy’s feasible behavior distribution, degrading safety.

Technical Approach: The proposed framework aligns trajectory selection with the current policy’s feasible distribution by filtering imitation candidates through a policy-compatibility score before computing GRPO advantages. This prevents high-scoring but out-of-distribution trajectories from destabilizing policy gradient updates.

Key Takeaway: Aligning multi-trajectory supervision with the policy’s behavior distribution during GRPO training is critical for maintaining safe, compliant VLA driving behavior across diverse scenarios.

Subspace Inference Enables Efficient Active Reward Learning from Preferences

Authors: Yutai Zhou, Erdem Bıyık | Submitted: 2026-09-03 | arXiv: 2609.04066 Categories: cs.LG, cs.AI, cs.RO

Research Background: RLHF is sample-inefficient because active learning requires uncertainty quantification over large neural reward models, which is computationally prohibitive with standard Bayesian approaches.

Technical Approach: PreferenceEKF frames active preference learning as sequential Bayesian filtering in a low-dimensional subspace of the reward model parameter space. An extended Kalman filter tracks reward uncertainty efficiently, enabling principled query synthesis without full posterior inference over the high-dimensional parameter space.

Key Takeaway: Subspace-based Kalman filtering reduces active RLHF query count by maintaining accurate reward uncertainty estimates at a fraction of the cost of full-space Bayesian methods.

Quartz 5

Explorer

arXiv Digest — 2026-W37