arXiv Weekly Digest — Week 35, 2026

Fetched: 2026-08-24 | Categories: cs.RO, cs.LG, cs.HC, cs.CV | Papers: 37

Note: cs.RO failed entirely this run due to arXiv API rate-limiting (HTTP 429/503 after all retries). Papers tagged cs.RO that appear below were retrieved via cs.LG or cs.CV cross-listings. Primary robotics papers submitted only to cs.RO may be missing this week.

Learning Hierarchical Skill Policies with Offline Quality-Diversity Reinforcement Learning

Authors: Tanachai Anakewat, Takayuki Osa, Tatsuya Harada | Submitted: 2026-08-20 | arXiv: 2608.19684 Categories: cs.AI, cs.LG, cs.RO

Research Background: Extracting reusable skills from offline datasets and composing them for new tasks is a promising route to sample-efficient robot learning, but existing two-stage hierarchical approaches produce limited skill diversity that constrains what the high-level policy can accomplish.

Technical Approach: The authors apply offline quality-diversity (QD) RL to the first stage, searching for a behaviorally diverse population of low-level skill policies rather than a single optimal one. A high-level policy is then trained to select among these diverse skills for downstream task completion, benefiting from a richer library than standard offline skill extraction produces.

Key Takeaway: Offline QD-RL yields broader skill libraries that improve hierarchical policy success on challenging downstream manipulation tasks.

Inter-X++: A Comprehensive Benchmark for Multimodal Human-Human Interaction Analysis

Authors: Liang Xu, Chengqun Yang, Zili Lin et al. | Submitted: 2026-08-20 | arXiv: 2608.20312 Categories: cs.CV

Research Background: Accurate perception of human-human interaction is essential for social robots; existing datasets suffer from low-fidelity kinematics, missing dexterous hand detail, and sparse multimodal annotations that limit model training quality.

Technical Approach: Inter-X++ introduces a large-scale multi-person interaction benchmark with high-fidelity full-body kinematics including finger-level hand gestures, paired with rich multimodal annotations (language, audio, contact labels) and consistent cross-modal representations for joint training.

Key Takeaway: Higher-fidelity multimodal interaction data closes key gaps in training social robots to perceive and anticipate human dyadic behavior.

DreamHand: Repurposing Video Diffusion Models for Occlusion-Robust Egocentric 3D Hand Motion Recovery

Authors: Yufei Liu, Xixi Wang, Hao Li et al. | Submitted: 2026-08-20 | arXiv: 2608.20308 Categories: cs.CV

Research Background: Recovering metric 3D hand trajectories from egocentric video is crucial for scalable manipulation data collection, but heavy object occlusion and hands leaving the frame cause regressors to fail at exactly the moments that matter most.

Technical Approach: DreamHand repurposes video diffusion models (VDMs) to hallucinate plausible hand motion through occluded and out-of-frame intervals, replacing slow stochastic multi-step sampling with a deterministic inference mode that preserves temporal coherence while running at practical speed.

Key Takeaway: VDM-based motion completion recovers accurate 3D hand trajectories through occlusion, improving the quality of egocentric video as a data source for manipulation learning.

Towards Surgical World-Action Modeling: A Preliminary Joint Visual-Trajectory Forecasting for Surgical Motion Planning

Authors: Weiliang Huang, Huanrong Liu, Bob Zhang et al. | Submitted: 2026-08-20 | arXiv: 2608.20284 Categories: cs.CV, cs.RO

Research Background: Reliable surgical planning requires jointly anticipating future instrument trajectories and evolving scene appearance, but existing methods treat scene generation and motion prediction as separate tasks with no mutual consistency check.

Technical Approach: A joint visual-trajectory forecasting framework simultaneously predicts future operative scene images and instrument motion paths in a unified model, enabling surgical planners to verify that predicted instrument trajectories are geometrically consistent with the predicted visual scene evolution.

Key Takeaway: Joint world-action modeling enforces scene-trajectory consistency, producing more coherent and reliable surgical motion plans.

RoMAN-Flow: Taming Autoregressive Normalizing Flows for Offline Reinforcement Learning in Robotic Manipulation

Authors: Shaoxuan Wang, Guangting Zheng, Rui Huang et al. | Submitted: 2026-08-20 | arXiv: 2608.20208 Categories: cs.CV

Research Background: Likelihood-based offline RL post-training is attractive for robotic manipulation, but diffusion and flow-matching policies lack tractable likelihoods, preventing their direct use in such frameworks.

Technical Approach: RoMAN-Flow uses autoregressive normalizing flows (AR-NFs) which support exact likelihood evaluation, then addresses their slow sequential sampling bottleneck with a taming technique that parallelizes generation steps while maintaining expressiveness in the learned action distribution.

Key Takeaway: Tamed AR-NFs enable tractable likelihood-based offline RL for robot manipulation without sacrificing action modeling quality.

Gravity-aware partially calibrated absolute pose estimation from affine- or rotation-covariant features

Authors: Marcus Valtonen Örnhag, Alberto Jaenal, Stefan Adalbjörnsson | Submitted: 2026-08-20 | arXiv: 2608.20056 Categories: cs.CV

Research Background: Drones and XR headsets carry IMUs that provide gravity direction; integrating this inertial prior with visual pose estimation speeds and stabilizes localization, but standard solvers ignore it and assume full calibration.

Technical Approach: The method estimates absolute camera pose using affine- or rotation-covariant features combined with the IMU gravity vector as a partial calibration constraint, reducing the effective degrees of freedom in the solver and enabling more efficient and accurate pose recovery.

Key Takeaway: IMU gravity-aware partial calibration substantially reduces solver complexity and improves pose estimation robustness for drones and wearable devices.

PVRA: A Pointwise Key-point Voting Framework for Robotic Assembly

Authors: Kulunu Samarawickrama, Roel Pieters | Submitted: 2026-08-20 | arXiv: 2608.19968 Categories: cs.RO, cs.CV

Research Background: Autonomous robotic assembly requires perception that understands not just individual object poses but also inter-part dependencies across assembly steps — a level of structured reasoning beyond standard detection methods.

Technical Approach: PVRA learns assembly-dependency-aware point cloud representations and uses a pointwise keypoint voting mechanism that aggregates local votes to predict assembly-relevant keypoints, explicitly encoding which keypoints are relevant to each successive assembly step.

Key Takeaway: Assembly-dependency-aware keypoint voting enables more reliable part localization for complex progressive robotic assembly tasks.

A 360-Degree Vision Dataset for Learning Yaw Control on GPS-Denied Micro-UAVs in Disaster-Response-Relevant Environments

Authors: Niklas Voigt, Hartmut Surmann | Submitted: 2026-08-20 | arXiv: 2608.19866 Categories: cs.CV

Research Background: Micro-UAVs operating in GPS-denied disaster environments such as CBRN incidents need autonomous yaw control based on vision alone, but no datasets exist covering the full 360° panoramic view required for reliable directional navigation in such settings.

Technical Approach: The paper captures a novel 360° egocentric dataset across indoor disaster-response-relevant environments, pairing panoramic frames with yaw labels to train data-driven yaw control policies that exploit the full visual context unavailable to forward-facing cameras.

Key Takeaway: A purpose-built 360° indoor UAV dataset enables training of panoramic-aware yaw control policies for GPS-denied disaster-response scenarios.

SafeBranch: Branch-Pair Safety Alignment for Embodied Agents

Authors: Hyunse Lee, Jiwoo Jeong, Haneul Lee et al. | Submitted: 2026-08-20 | arXiv: 2608.19729 Categories: cs.AI, cs.CV, cs.RO

Research Background: VLM-based embodied agents frequently violate safety constraints during task execution; standard supervision struggles because safety-critical decision points are sparse within trajectories, making safety signals diluted by long safe segments.

Technical Approach: SafeBranch constructs branch-pair training examples that diverge at a single safety-critical step — one branch taking the safe action, one the unsafe — and trains the agent via contrastive preference learning to choose the safe branch, focusing supervision precisely where safety matters.

Key Takeaway: Branch-pair safety alignment efficiently teaches embodied agents to avoid constraint violations by concentrating safety supervision on the sparse steps where it diverges.

Authors: Mohammad Arif Ul Alam | Submitted: 2026-08-20 | arXiv: 2608.19710 Categories: cs.CV, cs.AI

Research Background: Optical imagery degrades severely underwater due to turbidity, scattering, and wavelength-dependent attenuation; sonar is complementary but existing visual-sonar methods primarily evaluate nominal performance rather than robustness under degraded conditions.

Technical Approach: A cross-modal fusion framework built on foundation model representations aligns visual and sonar features while systematically evaluating robustness as optical conditions vary, identifying how much sonar benefit is realized at different levels of visual degradation.

Key Takeaway: Cross-modal vision-sonar fusion with foundation model features sustains reliable underwater robot perception even when optical visibility is severely compromised.

What Matters for Latent Actions in Robot Learning

Authors: Xizhou Bu, Qingda Hu, Lei Zhou et al. | Submitted: 2026-08-20 | arXiv: 2608.19613 Categories: cs.RO, cs.CV

Research Background: Latent Action Models leverage large-scale unlabeled video for robot learning by learning compact latent surrogates for physical actions, but inconsistent experimental settings across papers make it impossible to identify which design choices actually matter.

Technical Approach: A systematic controlled evaluation framework tests key LAM design dimensions — encoder architecture, latent dimensionality, reconstruction objectives, and downstream fine-tuning protocols — under standardized settings, enabling apples-to-apples comparisons across design choices.

Key Takeaway: Consistent benchmarking reveals that latent space structure and reconstruction objective dominate LAM performance, providing actionable guidance for future robot learning research.

OrthoSkillVLA: Continual Skill Learning via Gradient-Informed Skill Subspace Adaptation

Authors: Jiaqi Wang, Zhou Fang, Qiongfeng Shi et al. | Submitted: 2026-08-20 | arXiv: 2608.19589 Categories: cs.RO, cs.CV

Research Background: Sequential fine-tuning of VLA models on new manipulation skills causes catastrophic forgetting of previously learned skills; architecture-based isolation approaches that prevent forgetting inflate inference cost.

Technical Approach: OrthoSkillVLA uses gradient-informed subspace adaptation: for each new skill, gradient directions are projected to be orthogonal to the subspace spanned by previous skill gradients, preventing interference with existing skill representations without adding new parameters.

Key Takeaway: Gradient-orthogonal subspace adaptation enables VLAs to continually acquire new manipulation skills without forgetting old ones or increasing inference overhead.

Authors: Eunsoo Im, Junghun Suh, Gyeonggwan Lee et al. | Submitted: 2026-08-20 | arXiv: 2608.19536 Categories: cs.CV, cs.AI, cs.RO

Research Background: Global LiDAR point cloud registration is brittle to sensor variation and viewpoint changes because pure geometric representations fail when scan patterns differ between query and map scans.

Technical Approach: CVSD-Reg distills visual semantic priors from a vision foundation model into LiDAR point representations via cross-modal knowledge distillation, enriching geometric features with semantic context that generalizes across sensor types and viewpoints.

Key Takeaway: Semantic distillation from vision foundation models substantially improves LiDAR global registration robustness for mobile robot localization under cross-sensor conditions.

LF-GICP: Parameter-Free Degeneracy-Aware LiDAR Odometry via a Voxel-Normal Localizability Field

Authors: Eunsoo Im | Submitted: 2026-08-20 | arXiv: 2608.19522 Categories: cs.RO, cs.CV

Research Background: LiDAR odometry accumulates unbounded drift along geometrically degenerate axes in environments like tunnels and corridors; existing solutions require hand-tuned environment-specific parameters that limit deployment generality.

Technical Approach: A parameter-free approach analyzes the Gauss-Newton Hessian of voxelized GICP to construct a localizability field over voxel normals, automatically identifying which translational axes are degenerate and constraining updates along those axes without any manual tuning.

Key Takeaway: The localizability field provides automatic, parameter-free degeneracy handling that generalizes across environment types without requiring re-tuning.

Beyond Multimodal Alignment: Certifying Physical Language through Response Substitution and Ordered Execution

Authors: Kaizhen Tan, Xin Xu, Siru Tao et al. | Submitted: 2026-08-19 | arXiv: 2608.19492 Categories: cs.LG, cs.RO

Research Background: World models increasingly use compact multimodal representations as interfaces between perception and physical action, but it remains unclear whether different sensor modalities encode equivalent executable physical semantics.

Technical Approach: The authors introduce an operational capability hierarchy and the Disjoint-Bridge Operator-Substitution Certificate (DBOSC), a formal framework that certifies whether representations from different modalities produce equivalent physical outcomes when substituted into an action composition.

Key Takeaway: DBOSC provides formal guarantees that multimodal world model representations are physically interchangeable, strengthening safety arguments for sensor-agnostic robot control.

Fine-Tuning VLAs with Self-Demonstrated Generative Control for Multi-Task Manipulation

Authors: Prachi Garg, Steve Xing, Prahit Yaugand et al. | Submitted: 2026-08-19 | arXiv: 2608.19490 Categories: cs.RO, cs.CV, cs.LG

Research Background: State-of-the-art VLA models experience severe performance drops on new robot hardware due to embodiment mismatch, yet collecting expert demonstrations on each new platform is expensive and slow.

Technical Approach: The VLA generates its own synthetic demonstrations through generative control — producing novel task trajectories without human teleoperation — then self-fine-tunes on these demonstrations to adapt to the new embodiment, reducing the need for hardware-specific human-collected data.

Key Takeaway: Self-demonstrated generative control enables efficient VLA adaptation to new robot embodiments, cutting dependence on costly per-platform expert demonstration collection.

SCAPE: Scenario-Conditioned Simulation-Augmented Policy Evaluation

Authors: Dijie Zhu, Seunghun Oh, Ruopeng Huang et al. | Submitted: 2026-08-19 | arXiv: 2608.19425 Categories: cs.RO, cs.AI, cs.LG

Research Background: Policy evaluation for robot learning requires either costly real-world tests or simulation proxies biased by the sim-to-real gap; existing hybrid methods reduce bias but do not systematically surface failure scenarios.

Technical Approach: SCAPE conditions simulation scenario generation on real-world observations, synthesizing targeted test cases that probe specific policy failure modes identified from limited real rollouts, thereby bridging the sim-to-real evaluation gap while scaling coverage.

Key Takeaway: Scenario-conditioned simulation augmentation surfaces policy failure modes that closely predict real-world performance shortfalls, enabling cheaper yet more predictive evaluation.

GS-VLA: Plug-and-Play Viewpoint Canonicalization for Frozen VLA Policies via Gaussian Splatting

Authors: Yechan Park, HyunJin Kim | Submitted: 2026-08-19 | arXiv: 2608.19066 Categories: cs.CV, cs.AI

Research Background: VLA policies trained at a fixed camera viewpoint fail when deployed with different camera positions, but retraining is prohibitively expensive for each new configuration.

Technical Approach: A plug-and-play observation adapter uses 3D Gaussian Splatting to render novel views matching the training viewpoint from the new camera position, canonicalizing the observation before it reaches the frozen VLA policy without any policy modification or retraining.

Key Takeaway: Gaussian Splatting view canonicalization enables frozen VLA policies to generalize across camera configurations as a zero-cost drop-in adapter.

LT-Mem: Volatility-Aware Spatio-Temporal Memory for Lifelong Scene Understanding

Authors: Yumin Lee, Hyoseok Ju, Giseop Kim | Submitted: 2026-08-19 | arXiv: 2608.19059 Categories: cs.RO, cs.CV

Research Background: Long-term robot operation in changing environments requires semantic object memory that persists across revisits while tracking changes, but existing systems either overwrite history (losing past states) or lack consistent cross-session object identity.

Technical Approach: LT-Mem models per-object volatility rates to decide which memory entries to retain long-term versus allow to update, maintaining stable history for static objects while tracking dynamic ones, enabling long-horizon queries about where objects were and how they changed.

Key Takeaway: Volatility-aware memory prevents temporal amnesia in long-running robots, supporting contextual queries about environmental change over extended deployment.

Authors: Benjamin Merryman-Smith, Tony Nguyen, Bilal Dogutas et al. | Submitted: 2026-08-19 | arXiv: 2608.19004 Categories: cs.RO, cs.CV

Research Background: Site-specific weed management in paddy fields can drastically cut herbicide use, but GNSS-denied navigation under crop canopy, real-time crop-weed discrimination, and the high cost of misclassifying rice as weed have blocked practical autonomous deployment.

Technical Approach: An integrated system pairs LiDAR-based crop-row navigation (unaffected by canopy-blocked GNSS) with a vision module for weed detection that incorporates asymmetric misclassification costs, validated across real paddy field conditions through a full season.

Key Takeaway: Combining LiDAR navigation with cost-aware weed detection yields a practically deployable precision herbicide system for autonomous paddy farming robots.

GrabVG: Graph-Attentive Binding for Visual Grounding in UAV Imagery

Authors: Chaowei Wang, Yan Di, Jinshan Sun et al. | Submitted: 2026-08-19 | arXiv: 2608.18996 Categories: cs.CV, cs.AI

Research Background: Visual grounding in UAV aerial imagery is challenged by densely packed, visually similar small objects and repeated local spatial patterns that make feature-matching approaches ambiguous.

Technical Approach: GrabVG models the UAV scene as a spatial relationship graph over detected objects, then uses graph-attentive binding to resolve topological ambiguity by attending over relational context when matching a language description to a target object.

Key Takeaway: Graph-attentive relational reasoning over aerial scenes significantly improves natural-language-guided UAV target localization in cluttered environments.

Beyond Placement and Articulation: Usage-Driven Code Scenes for Embodied Interaction

Authors: Zijian Xiao, Zipeng Ye, Jinkun Hao et al. | Submitted: 2026-08-19 | arXiv: 2608.18840 Categories: cs.RO, cs.CV

Research Background: Indoor scene synthesis for embodied AI and robotic manipulation focuses on geometric placement and articulation, leaving functional affordance structure — where and how objects are used — largely unmodeled, which limits policy training quality.

Technical Approach: RoomWriter generates code-based indoor scenes that explicitly encode functional usage patterns alongside object placement and articulation, producing environments with realistic action affordance distributions for embodied policy learning.

Key Takeaway: Usage-driven scene synthesis produces training environments with accurate affordance structure, improving the realism and utility of simulation data for embodied agents.

Clustering and Token Denoising for Faster and More Robust VLMs

Authors: Baptiste Rossigneux, Inna Kucher, Vincent Lorrain et al. | Submitted: 2026-08-19 | arXiv: 2608.19285 Categories: cs.CV, cs.LG

Research Background: VLMs processing hundreds of visual tokens are computationally prohibitive for edge deployment in robotic systems; existing token pruning methods require retraining, limiting their applicability to pretrained models.

Technical Approach: A training-free token reduction pipeline clusters spatially similar visual tokens and denoises redundant ones before VLM processing, preserving task-relevant visual content while cutting token count — applicable to any pretrained VLM without modification.

Key Takeaway: Training-free clustering-and-denoising reduces VLM visual token count substantially with minimal accuracy drop, enabling robot-facing VLM deployment on edge hardware.

CL4D: Contrastive Language-4D Pretraining for Vision-Language Reasoning in Dynamic Scenes

Authors: Kumal Hewagamage, Isuranga Senavirathne, Sasika Amarasinghe et al. | Submitted: 2026-08-19 | arXiv: 2608.18734 Categories: cs.CV

Research Background: Embodied agents need to reason jointly about spatial geometry and temporal motion in dynamic scenes, but existing encoders handle 2D/3D or temporal video separately, without combining spatial depth structure and motion in a language-grounded representation.

Technical Approach: CL4D aligns language, 3D point cloud, and temporally-indexed video representations through contrastive pre-training objectives across modalities, producing encoders that jointly capture spatial geometry and motion evolution under natural language grounding.

Key Takeaway: CL4D-pretrained encoders enable embodied agents to reason about object dynamics with spatial accuracy, improving performance in manipulation and navigation tasks with moving objects.

DynCur-Geo: Dynamic Curiosity Reward Shaping for Multimodal Active Geo-Localization

Authors: Yiming Sun, Yang Zhang, Pengfei Zhu | Submitted: 2026-08-19 | arXiv: 2608.18673 Categories: cs.CV

Research Background: Active geo-localization for search-and-rescue UAVs must balance area exploration with target convergence under restricted views, sparse feedback, and multimodal target cues — a challenge that fixed curiosity rewards handle poorly.

Technical Approach: DynCur-Geo adapts the curiosity reward at each step based on local area coverage: boosting exploration in under-visited regions and suppressing it in well-covered ones, creating a coverage-sensitive drive that naturally transitions from exploration to exploitation.

Key Takeaway: Dynamic coverage-sensitive curiosity reward shaping improves UAV search efficiency by automatically transitioning between exploration and target convergence as needed.

Vision-Language Models for Egocentric Video: From Hand-Object Interaction to Embodied AI

Authors: Mohammad Zamani, Fatemeh Ziaeetabar | Submitted: 2026-08-19 | arXiv: 2608.18671 Categories: cs.CV

Research Background: Egocentric video is a critical data modality for wearable intelligence, assistive systems, and HRI, but ego-motion, heavy occlusion, and small active objects create unique challenges that general VLMs are not designed to handle.

Technical Approach: A comprehensive survey of VLM approaches applied to egocentric video across hand-object interaction, activity understanding, and embodied AI applications, systematically mapping current capabilities and identifying key failure modes specific to the egocentric perspective.

Key Takeaway: Hand-object interaction robustness and ego-motion compensation are the two most critical open challenges separating current VLMs from effective egocentric embodied AI systems.

Dynamic SpectraFormer for Ultra-High-Definition Underwater Image Enhancement

Authors: Zhiqiang Hu, Tao Yu, Shouren Huang et al. | Submitted: 2026-08-19 | arXiv: 2608.18662 Categories: cs.CV, cs.RO

Research Background: Underwater imagery suffers from wavelength-dependent color distortion and haze that degrade AUV and marine robot perception; low-frequency color errors and high-frequency edge losses require distinct correction strategies.

Technical Approach: SpectraFormer addresses both distortion types with a dual-branch transformer that applies dynamic spectral weighting to adapt low-frequency color/brightness correction and high-frequency edge/texture restoration independently, guided by the specific degradation profile of each input.

Key Takeaway: Adaptive dual-spectral enhancement produces cleaner underwater imagery under diverse turbidity conditions, improving AUV perceptual reliability.

Evaluation of Image Matching Methods for Visual Odometry on UAVs

Authors: Gašper Spagnolo, Luka Čehovin Zajc, Matej Dobrevski | Submitted: 2026-08-19 | arXiv: 2608.18624 Categories: cs.CV

Research Background: UAVs depend on GNSS for navigation but must fall back to visual odometry when signals fail; the choice of image matching method critically determines VO reliability under real flight conditions.

Technical Approach: A systematic benchmark compares classical and learned image matching approaches for visual odometry across UAV-relevant conditions (altitude variation, illumination change, motion blur), evaluating trajectory accuracy and robustness for GNSS-denied navigation.

Key Takeaway: The benchmark reveals that learned matching methods outperform classical ones under challenging UAV conditions, providing principled guidance for GNSS-denied VO system design.

DyG²T: Modeling Object Dynamics with 3D Gaussian Temporal-Spatial Particle Graph Transformer

Authors: Yansong Wang, Zhaobo Qi, Xinyan Liu et al. | Submitted: 2026-08-19 | arXiv: 2608.18498 Categories: cs.CV

Research Background: Accurate object trajectory prediction from visual observations is fundamental for embodied agents planning physical interactions; compressing particles into sparse keypoints discards fine-grained local dynamics that matter for contact-rich manipulation.

Technical Approach: DyG²T maintains 3D Gaussian particle representations at full granularity and models their temporal evolution through a graph transformer that attends over both local neighborhoods and global scene context, preserving fine-grained dynamics without lossy compression.

Key Takeaway: Fine-grained Gaussian particle dynamics modeled via graph attention improves trajectory prediction accuracy for embodied agents performing contact-rich manipulation.

Reproducible Multimodal Affordance Prediction

Authors: Tommaso Apicella, Alessio Xompero, Andrea Cavallaro | Submitted: 2026-08-18 | arXiv: 2608.18317 Categories: cs.CV, cs.RO

Research Background: Affordance prediction — identifying where and how an agent can interact with objects — is central to robotic manipulation, but heterogeneous problem formulations and inconsistent evaluation protocols make cross-paper comparisons unreliable.

Technical Approach: A standardized evaluation framework for multimodal affordance prediction unifies dataset annotations, splits, and reporting protocols, then benchmarks current methods under these consistent conditions to establish reproducible baseline performance.

Key Takeaway: Unified affordance evaluation reveals large performance variance across methods that was previously masked by inconsistent evaluation, establishing a cleaner foundation for manipulation research.

Authors: Qian Yin, Ruiping Liu, Kunyu Peng et al. | Submitted: 2026-08-18 | arXiv: 2608.18292 Categories: cs.RO, cs.CV

Research Background: Assistive robot dogs serving blind users benefit from concurrent task execution (navigation while another retrieves an object), but LLM-generated plans may violate embodiment constraints and standard planners lack multi-robot coordination.

Technical Approach: GuideFetch uses LLM-generated task plans with an embodiment constraint verifier that checks physical feasibility before execution, enabling two robot dogs to safely run concurrent navigation and object retrieval tasks with automatic conflict detection and resolution.

Key Takeaway: Constraint-aware LLM coordination enables safe concurrent multi-robot task execution for assistive applications, improving service efficiency for blind users without sacrificing safety.

Zero-Shot Transfer of Force Map Estimation Across GelSight Mini Sensors

Authors: Julio Castaño Amoros, Pablo Gil | Submitted: 2026-08-18 | arXiv: 2608.18240 Categories: cs.CV, cs.RO

Research Background: GelSight tactile sensors are often handmade, causing unit-to-unit variation that requires retraining force estimation models for each new sensor unit — a significant barrier to scalable tactile sensing deployment.

Technical Approach: A zero-shot domain adaptation method aligns the appearance distribution between sensor units by learning a mapping from one unit’s imagery to another’s, enabling force map estimation models trained on one unit to transfer directly to new units without any new training data collection.

Key Takeaway: Zero-shot inter-unit transfer eliminates per-sensor retraining overhead, making scalable tactile sensing for robotic manipulation practically achievable.

Plug-and-Play Traffic Element Awareness for End-to-End Autonomous Driving

Authors: Zongzheng Zhang, Jijun Wang, Saining Zhang et al. | Submitted: 2026-08-18 | arXiv: 2608.18035 Categories: cs.CV

Research Background: End-to-end autonomous driving models focus on dynamic participants like vehicles and pedestrians but largely ignore traffic lights and road signs, which are critical for safe and legally compliant driving.

Technical Approach: A plug-and-play module detects and encodes traffic element states (light color, sign type) and injects them as additional input channels into existing end-to-end driving architectures without requiring architectural changes or joint retraining from scratch.

Key Takeaway: Traffic element awareness can be grafted onto existing end-to-end driving systems as a drop-in module, substantially improving performance at intersections and sign-controlled scenarios.

Automated ACL Footprint Identification Using 3D Deep Learning

Authors: Ruida Cheng, Gabriel Gibson, Ali Uneri et al. | Submitted: 2026-08-18 | arXiv: 2608.18012 Categories: cs.CV

Research Background: Accurate ACL femoral footprint localization is critical for reconstruction surgery success; malpositioning is a leading cause of failure leading to meniscal damage and osteoarthritis, yet manual identification is expert-dependent and variable.

Technical Approach: A 3D deep learning pipeline processes knee joint volumetric imaging to automatically identify the ACL footprint center and optimal tunnel orientation, learning anatomical landmark patterns from surgical expert annotations.

Key Takeaway: Automated 3D ACL footprint identification matches expert-level localization accuracy, with potential to reduce reconstruction failures from tunnel malpositioning.

Memory Tree Guided Key Frame Querying for Efficient 3D Question Answering

Authors: Hsiang-Wei Huang, Fu-Chen Chen, Li-Wu Tsao et al. | Submitted: 2026-08-18 | arXiv: 2608.18009 Categories: cs.CV

Research Background: Embodied 3D question answering requires efficiently retrieving question-relevant video frames from long observation sequences; exhaustive visual search is computationally prohibitive for resource-constrained embodied platforms.

Technical Approach: A hierarchical memory tree indexes video frames by semantic content at multiple levels, enabling question-guided key frame retrieval through efficient tree traversal rather than exhaustive visual search, reducing compute while preserving access to temporally relevant frames.

Key Takeaway: Semantic memory tree retrieval cuts key frame search cost in embodied 3D QA while maintaining answer accuracy through structured hierarchical indexing.

Beyond Instrument Motion: Recognizing Tissue Tension Toward Surgical Skill Assessment

Authors: Marko Haralović, Zhiqi Miao, Alexander Machiel Bont et al. | Submitted: 2026-08-18 | arXiv: 2608.17935 Categories: cs.CV

Research Background: Surgical skill assessment in minimally invasive surgery relies on manual expert review; existing video models capture instrument motion and phase recognition but miss fine-grained tissue handling quality — a key indicator of surgical expertise.

Technical Approach: A video recognition model trained to detect tissue tension patterns — identifying visual cues of over- or under-stressed tissue from deformation and manipulation dynamics — providing a skill metric complementary to instrument tracking.

Key Takeaway: Tissue tension recognition from surgical video adds a new dimension to automated skill assessment, capturing manipulation quality that instrument motion metrics cannot.

Comparative Study of Out-of-the-Box Technology for Automatic Target Detection and Recognition

Authors: Alma M. Liezenga, Lotte Nijskens, Henrik R. Baumann et al. | Submitted: 2026-08-18 | arXiv: 2608.17917 Categories: cs.CV, cs.AI

Research Background: Military automatic target detection requires reliable small-object and occluded-target localization in aerial imagery, but scarce public military datasets limit applying modern detectors; civilian datasets may proxy for this domain.

Technical Approach: A benchmark of six YOLO iterations and two DETR variants on a newly collected military vehicle dataset, with additional fine-tuning on VisDrone (small objects, aerial perspective) to test cross-domain generalization, evaluated across A2G and G2G viewpoints and object sizes.

Key Takeaway: Larger models outperform smaller ones and DETR variants are competitive with YOLO, but in-domain training remains essential — civilian fine-tuning only marginally improves small-target aerial detection.

Explorer

arXiv Digest — 2026-W35

arXiv Weekly Digest — Week 35, 2026

Graph View

Table of Contents