arXiv Weekly Digest — Week 46, 2026
Fetched: 2026-11-09 | Categories: cs.RO, cs.LG, cs.HC, cs.CV | Papers: 20
OopsieRecover: Learning Transferable VLA Corrections from Semantic Interventions
Authors: Arpit Bahety, Skand Peri, Sriniket Ambatipudi et al. | Submitted: 2026-11-05 | arXiv: 2611.08462
Categories: cs.RO
Research Background: VLA models deployed on robots often fail unexpectedly, and gathering the corrective data needed to recover is expensive — existing methods like DAgger require many interactions yet still generalize poorly.
Technical Approach: OopsieRecover learns recovery policies by associating semantic textual interventions (e.g., “move left”) with failure observations, disentangling the correction signal from the specific task context. This semantic abstraction allows corrections learned on one task to transfer to novel ones without additional robot data.
Key Takeaway: Framing corrections as semantic interventions enables sample-efficient, transferable VLA recovery across tasks without per-task fine-tuning.
Latent RL Priors for Data-Efficient Dexterous Manipulation
Authors: Yixiao Wang, Peiyi Chen, Mustafa Mukadam et al. | Submitted: 2026-11-05 | arXiv: 2611.08458
Categories: cs.RO
Research Background: Dexterous manipulation from visual demonstrations is hard because policies need both perceptual grounding and precise motor control, while RL in simulation provides rich control knowledge but requires privileged state information unavailable at test time.
Technical Approach: A two-stage Latent RL Prior framework first trains a privileged RL policy in simulation, then distills its latent control representations into a visual policy trained from limited demonstrations. The latent prior serves as a structured initialization that embeds manipulation skills before visual learning begins.
Key Takeaway: Pre-training on privileged simulation data and transferring its latent priors dramatically reduces the number of visual demonstrations needed for dexterous manipulation.
VFlash: Fast, Accurate Visual Planning via Flash Primitive Decoding
Authors: Yu-Cheng Chou, Shihao Wang, Jin Huang et al. | Submitted: 2026-11-05 | arXiv: 2611.08449
Categories: cs.RO, cs.CV
Research Background: Robots and autonomous vehicles need to generate spatial visual plans (points, bounding boxes, trajectories), but autoregressive token-by-token decoding of coordinate sequences is computationally expensive and grows costly with richer predictions.
Technical Approach: VFlash introduces Flash Primitive Decoding, which exploits the known geometric structure of visual primitives (e.g., fixed-size bounding boxes, trajectory sequences) to decode entire primitives in a single forward pass rather than token-by-token. This reduces decoding steps without sacrificing accuracy.
Key Takeaway: Matching decoding strategy to geometric structure of visual primitives achieves significant inference speedup for spatial planning in physical AI tasks.
Failure Prediction and Classification in Vision-Language-Action Models Via Calibrated Latent Probing
Authors: Michal P. Podolinsky, Yunhao Yang, Daniel Little et al. | Submitted: 2026-11-05 | arXiv: 2611.08425
Categories: cs.RO, cs.AI
Research Background: VLA models are fragile under distribution shift, and real-world deployment demands runtime monitors that can detect and classify failures in time to prevent equipment damage or safety incidents without burdening on-device compute.
Technical Approach: VLA-Tug trains lightweight calibrated probes on the internal latent activations of a frozen VLA to predict and classify failures at runtime. Probes at different layers capture failure signals at varying granularities, and calibration ensures reliable confidence estimates for safety-critical decision thresholds.
Key Takeaway: Latent probing of a VLA’s internal representations provides efficient, calibrated failure detection suitable for edge deployment without retraining the base model.
T3R: Training-Free Two-Stage Token Refinement Towards Efficient and Robust VLA Models
Authors: Mohammed Hassan, Zhenyang Chen, Zheng Wang et al. | Submitted: 2026-11-05 | arXiv: 2611.08413
Categories: cs.RO, cs.CV
Research Background: VLA inference is expensive because hundreds of visual tokens per camera are processed every decision step, and irrelevant background content degrades both efficiency and robustness under distribution shift.
Technical Approach: T3R applies a training-free two-stage refinement: first spatially pruning irrelevant tokens using saliency-based selection, then redistributing attention among retained tokens to suppress low-relevance content. No fine-tuning is required, and the method stacks on top of any VLA backbone.
Key Takeaway: Training-free token pruning and attention refinement reduces VLA compute cost while improving robustness to background distractors.
Social Humanoid: Socially Responsive Human-Humanoid Interaction
Authors: Vongani H. Maluleke, James Ni, Kie Horiuchi et al. | Submitted: 2026-11-05 | arXiv: 2611.08407
Categories: cs.RO, cs.CV, cs.LG
Research Background: Humanoid robots are typically trained as isolated agents and lack the social responsiveness needed to coordinate physically with human partners who naturally anticipate each other’s movements — a core requirement for safe, fluent HRI.
Technical Approach: Social Humanoid is a hierarchical controller where a high-level policy tokenizes both human and humanoid motion in a shared representation for sequence modeling, and a low-level policy executes whole-body motion on a 29-DoF Unitree G1 conditioned on the partner’s observed motion. The system runs closed-loop in real time on physical hardware.
Key Takeaway: Shared motion tokenization enables a full-sized humanoid to generate socially coordinated whole-body responses to human partners in real time.
A Multimodal Haptic Interface for Simultaneous Softness and Thermal Modulation
Authors: Joshua Brown, Fernando Bello, Lynette Jones | Submitted: 2026-11-05 | arXiv: 2611.08398
Categories: cs.RO, cs.HC, eess.SY
Research Background: Realistic tactile feedback in virtual reality requires combining multiple skin sensations simultaneously, but most haptic displays target only a single modality (stiffness or temperature), leaving no device that jointly controls both.
Technical Approach: The prototype combines particle jamming (for variable softness) with active thermal transfer (heated/cooled fluid circulation) in a single compact display. Both modalities are actuated independently and simultaneously, and characterization experiments validate independent controllability.
Key Takeaway: Particle-jamming plus active thermal control in one device enables simultaneous, independent rendering of softness and temperature — a step toward richer multimodal haptic feedback.
SCALE: Real-Time Latent Communication for Cyber-Physical Agents
Authors: Shanghao Shi, Jian Xiao, Ching-Hsiang Chan et al. | Submitted: 2026-11-05 | arXiv: 2611.08390
Categories: cs.RO, cs.MA
Research Background: Multi-robot systems benefit from sharing intermediate model representations rather than raw sensor data, but existing latent communication methods ignore wireless bandwidth constraints and the tight, heterogeneous deadlines of cyber-physical tasks.
Technical Approach: SCALE exploits the spatio-temporal continuity of physical environments to compress and prioritize latent transmissions, dynamically dropping or delaying lower-priority updates based on task deadline and channel state. The system is designed for bandwidth-limited wireless links and validated on cooperative perception tasks.
Key Takeaway: Deadline-aware latent communication enables reliable multi-robot collaboration over constrained wireless channels without sacrificing task-critical information.
SLA: Scaling Spatial-Language-Action Model via Continual Pre-training
Authors: Fuhao Li, Wenxuan Song, Qizhou Huang et al. | Submitted: 2026-11-05 | arXiv: 2611.08373
Categories: cs.RO
Research Background: VLA foundations inherit 2D visual representations from pre-training and only receive 3D spatial supervision at task-adaptation time, limiting how well spatial understanding generalizes across manipulation scenarios.
Technical Approach: SLA introduces continual pre-training on broad robot experience with explicit 3D spatial supervision signals (depth, point clouds, 3D keypoints), building spatial understanding as a foundation capability before task-specific fine-tuning. The architecture scales the spatial-language-action backbone to leverage larger datasets.
Key Takeaway: Incorporating 3D spatial supervision at the pre-training stage yields VLA foundations with more transferable spatial understanding for downstream manipulation.
MOMASPLAT: Dynamic Novel-View Demonstration Augmentation for Mobile Manipulation
Authors: Sateesh Kumar, Arnav Balaji, Arpit Bahety et al. | Submitted: 2026-11-05 | arXiv: 2611.08372
Categories: cs.RO, cs.AI, cs.CV
Research Background: Visuomotor policies for mobile manipulation are brittle to viewpoint changes caused by navigation uncertainty, yet collecting demonstrations from every possible camera pose is impractical.
Technical Approach: MOMASPLAT uses novel-view synthesis via 3D Gaussian splatting to augment demonstrations with viewpoints unseen during collection, extending prior static-scene NVS methods to dynamic manipulation scenes by separating scene and object representations and compositing them.
Key Takeaway: Separating scene and object Gaussians enables realistic dynamic novel-view augmentation that improves mobile manipulation policy robustness to base-pose variation.
VisionSIM: Beyond Idealized Sensors — A Multi-Modal Simulator for Robot Perception
Authors: Sacha Jungerman, Kaustubh Sadekar, Avery Gump et al. | Submitted: 2026-11-05 | arXiv: 2611.08368
Categories: cs.RO, cs.AI, cs.CV
Research Background: Sim-to-real gaps in robot perception are exacerbated by simulators that idealize sensor physics, hiding modality-specific failure modes that cause deployment failures for cameras, event cameras, depth sensors, and thermal imagers.
Technical Approach: VisionSIM models the raw physical measurement process for each sensor modality — including noise models, saturation, and temporal artifacts — in a unified simulation platform. The platform covers both conventional and emerging sensor types (SPAD, iToF, thermal) and provides reproducible benchmarks for multi-modal perception research.
Key Takeaway: Physically grounded multi-modal sensor simulation narrows the sim-to-real gap by exposing modality-specific failure modes before hardware deployment.
SHORE: Stability-Hybrid On-Policy Reinforcement Learning for Online Bin Packing
Authors: Chang Shi, Ann Majewicz Fey | Submitted: 2026-11-05 | arXiv: 2611.08364
Categories: cs.RO, cs.LG
Research Background: Online 3D bin packing under unknown future arrivals is a challenging manipulation planning problem where stack instability — causing collapse — terminates the episode and wastes volume.
Technical Approach: SHORE combines a learned stability probability predictor with on-policy RL, using the stability signal to jointly influence box selection, orientation, and placement without hard masking. The hybrid objective trades off volume utilization against collapse risk in a principled way.
Key Takeaway: Integrating a soft learned stability prior into RL for bin packing reduces collapses while preserving high volume utilization compared to hard geometric masks.
Radio-to-Pose Information for Gauge-Drift Correction in Cooperative Localization
Authors: Aditya Iyer, Andy Ye, Akshay Narayan et al. | Submitted: 2026-11-05 | arXiv: 2611.08361
Categories: cs.RO, cs.MA
Research Background: Multi-robot cooperative localization drifts in absolute pose over time (gauge drift) because inter-robot measurements capture only relative geometry, requiring an external reference to anchor the team’s global frame.
Technical Approach: Radio-to-Pose Information (RPI) converts received radio signal strength into pose corrections by matching observed attenuation to a pre-built radio map registered in world coordinates. The interface is sensor-agnostic and integrates into standard cooperative localization pipelines.
Key Takeaway: Radio attenuation maps provide a low-cost, infrastructure-based anchor for correcting gauge drift in multi-robot localization without additional dedicated positioning hardware.
USB Gym: A Gymnasium Testbed for Closed-Loop Ultrasound View Matching
Authors: Thanapong Intharah, Zhichao Gao, Yiliang Liu et al. | Submitted: 2026-11-05 | arXiv: 2611.08352
Categories: cs.CV, cs.LG, cs.RO
Research Background: Ultrasound-guided robotic probe positioning requires combining organ segmentation, view quality scoring, and motion planning — but these components are typically evaluated in separate simulators, making end-to-end performance unknown.
Technical Approach: USB Gym provides a unified Gymnasium-compatible testbed that simulates ultrasound images from public CT data with learned organ textures. It decomposes the guidance pipeline into swappable slots (segmenter, quality scorer, controller), enabling systematic end-to-end evaluation and comparison.
Key Takeaway: A modular, CT-based ultrasound simulation testbed reveals significant performance gaps when individually strong components are combined into a full closed-loop guide.
GPWM: Modeling the World as 3D Particle Motion
Authors: Robert Ren, Matthew Bronars, He Zhu et al. | Submitted: 2026-11-05 | arXiv: 2611.08338
Categories: cs.RO
Research Background: Robots need world models that capture physical dynamics — rigid, deformable, cloth, and granular materials — in a unified representation for planning, but most video-based world models work in pixel space and lack physical interpretability.
Technical Approach: GPWM is a Generative Particle World Model that represents scenes as 3D particle sets and predicts their motion over time using an object-aware multi-resolution transformer, combining flow matching with diffusion for multi-material dynamics. The model covers both passive physics and robotic interaction in a single architecture.
Key Takeaway: Directly modeling 3D particle motion enables a single world model to handle diverse material types (rigid, deformable, granular) across both passive physics and robot manipulation.
Learning the Task or Learning the Verifier? Rethinking Criteria Exposure in Embodied Self-Improvement
Authors: Wenbo Huang, Jianxin Bi, Shunyu Yang et al. | Submitted: 2026-11-05 | arXiv: 2611.08318
Categories: cs.AI, cs.RO
Research Background: Self-improving embodied agents are increasingly benchmarked on robot simulation tasks, but several recent methods expose the benchmark’s success criteria directly to the agent — a practice that may inflate reported scores without reflecting genuine task completion.
Technical Approach: The authors analyze “Criteria Exposure” (CE) — giving agents access to the benchmark verifier during training — and show that verifiers written for imitation-learning policies often demand more than the natural language instruction. This creates a scoring artifact where CE agents optimize the verifier rather than the instructed task, particularly under out-of-distribution instructions.
Key Takeaway: Exposing benchmark success criteria to self-improving agents can inflate performance metrics; evaluation should use task-aligned verifiers to distinguish genuine task learning from verifier exploitation.
Transformer-Based Trajectory Prescription for sEMG-Optimizing Robot-Mediated Rehabilitation
Authors: Gabriel Parra, Kimia Khoshnami, Daniel S. Brown et al. | Submitted: 2026-11-05 | arXiv: 2611.08295
Categories: cs.RO, cs.HC, cs.LG
Research Background: Rehabilitation robots typically follow kinematic trajectories rather than targeting the neuromotor activations (measured via sEMG) that underlie motor recovery, limiting therapeutic effectiveness for stroke or injury patients.
Technical Approach: A personalizable transformer model maps target muscle activation profiles to kinematic trajectories that elicit those activations when executed by a rehabilitation robot. The model is trained on individual patient sEMG data to account for inter-subject variability and predicts trajectories that maximize intended muscle engagement.
Key Takeaway: Prescribing trajectories to target specific muscle activations — rather than kinematic goals — enables individualized, neuromotor-optimized rehabilitation robot therapy.
Aligning Policy Encoders with a Shape Teacher
Authors: Madelon Bernardy, Mohammad Mahdi Derakhshani, David M Knigge et al. | Submitted: 2026-11-05 | arXiv: 2611.08275
Categories: cs.RO, cs.AI, cs.CV
Research Background: 3D geometric reasoning improves robot manipulation robustness to viewpoint and occlusion changes, but requiring 3D inputs at deployment adds sensor cost and complexity — image-based policies are more practical but lack explicit shape awareness.
Technical Approach: Shape-teacher alignment trains an image-based policy encoder to mimic the internal representations of a 3D shape encoder (the “teacher”) at training time, via feature-level distillation. At deployment, only the image-based encoder is needed; no 3D input is required.
Key Takeaway: Distilling 3D shape representations into an image encoder at training time gives purely image-based manipulation policies access to geometric structure without 3D sensing at deployment.
Fault-Geometry-Aware Control Allocation for Emergency Quadrotor Landing under Single-Motor Loss of Effectiveness
Authors: Suhas S P, Samridhi Salwan, Arshan Ali Khan et al. | Submitted: 2026-11-05 | arXiv: 2611.08259
Categories: cs.RO, eess.SY
Research Background: Partial motor failure changes the effective control geometry of a quadrotor, making standard control allocators suboptimal or unstable during emergency landing — the choice of allocator should account for the fault’s specific geometry.
Technical Approach: Three allocators are compared in Crazyflie software-in-the-loop simulation under varying degrees of single-motor loss: a pseudoinverse allocator, a finite-candidate residual allocator (QP-lite), and a Cross-Entropy Method-tuned variant. Performance is evaluated as a function of fault geometry and severity.
Key Takeaway: The optimal control allocator for emergency quadrotor landing depends on the fault geometry, suggesting fault-specific allocation selection as a practical fault-tolerance strategy.
RoboARCade: Benchmarking Agentic Robot Control
Authors: Satvik Sharma, Hengyuan Hu, Mihika Kamat et al. | Submitted: 2026-11-05 | arXiv: 2611.08209
Categories: cs.RO
Research Background: Multimodal foundation models are increasingly used directly as robot policies in an “agentic robot control” (ARC) setting, but no benchmark systematically tests their in-context adaptation, memory, and reasoning for precise long-horizon manipulation.
Technical Approach: RoboARCade provides long-horizon manipulation tasks across three robot embodiments, built on existing open-source benchmarks but with wider initial-condition ranges to stress in-context adaptation. The benchmark is modular and easy to extend, with all tasks running in a shared simulation environment.
Key Takeaway: RoboARCade reveals significant gaps between frontier multimodal models and task-specific policies on long-horizon manipulation requiring precise control and in-context adaptation.