arXiv Weekly Digest — Week 27, 2026
Fetched: 2026-06-29 | Categories: cs.RO, cs.LG, cs.HC, cs.CV | Papers: 27
A Multi-Attribute Latent Space for Visual Analysis of Watches
Authors: Kai Lawonn, Tobias Günther, Monique Meuschke | Submitted: 2026-06-26 | arXiv: 2606.27897
Categories: cs.CV, cs.HC
Research Background: Catalog and e-commerce interfaces let users filter watches by metadata but offer little support for open-ended exploration of visual similarity and mixed aesthetic-functional criteria. 研究背景: 目錄與電商介面雖能依詮釋資料篩選手錶,卻難以支援視覺相似性與美學功能混合準則的開放式探索。
Technical Approach: The system segments dials with a U-Net, classifies watch type with a Vision Transformer, encodes color via a shared CIELAB palette, and extends UMAP with attribute-specific neighborhood graphs plus a class-aware layout term, exposed through an interactive visual-analysis interface. 技術方法: 系統以 U-Net 分割表盤、用 Vision Transformer 分類錶款類型、以共享 CIELAB 色彩空間編碼顏色,並擴展 UMAP 加入屬性專屬鄰域圖與類別感知佈局項,整合進互動式視覺分析介面。
Key Takeaway: A pilot study with experts and novices suggests the multi-attribute latent space supports discovery and comparison, though scalability and validation remain open challenges. 核心發現: 專家與新手的試驗研究顯示,多屬性潛在空間有助於探索與比較,但可擴展性與驗證仍是待解難題。
Hallucination in World Models is Predictable and Preventable
Authors: Nicklas Hansen, Xiaolong Wang | Submitted: 2026-06-25 | arXiv: 2606.27326
Categories: cs.LG, cs.CV, cs.RO
Research Background: Generative world models produce visually convincing rollouts that can drift from true dynamics; understanding where this hallucination occurs could make world models safer to deploy for robot learning. 研究背景: 生成式世界模型的推演看似逼真卻可能偏離真實動態;理解幻覺發生的位置有助於讓世界模型更安全地應用於機器人學習。
Technical Approach: The authors build MMBench2, a 427-hour 210-task dataset, train a 350M-parameter world model, identify three hallucination modes (perceptual, action-marginalized, scene-diverging), and design coverage-aware sampling plus curiosity-driven data collection to mitigate them. 技術方法: 作者建立 427 小時、210 項任務的 MMBench2 資料集,訓練 3.5 億參數世界模型,辨識出三種幻覺模式(感知性、動作邊緣化、場景偏移),並設計覆蓋感知取樣與好奇心驅動資料收集來緩解問題。
Key Takeaway: Hallucination stems from data coverage gaps, and the same signals that detect it can guide targeted fine-tuning with as few as 50 real trajectories. 核心發現: 幻覺源於資料覆蓋不足,偵測幻覺的訊號同樣可指導僅需 50 條真實軌跡的針對性微調。
Automating Potential-based Reward Shaping with Vision Language Model Guidance
Authors: Henrik Müller, Daniel Kudenko | Submitted: 2026-06-25 | arXiv: 2606.27180
Categories: cs.LG, cs.AI, cs.RO
Research Background: Sparse rewards hinder RL exploration, and hand-crafted potential functions for potential-based reward shaping (PBRS) are labor-intensive and require domain expertise. 研究背景: 稀疏獎勵阻礙強化學習探索,而基於潛能的獎勵塑形(PBRS)所需的人工潛能函數設計耗時且依賴領域知識。
Technical Approach: VLM-PBRS learns the potential function from a lightweight vision-language model’s pairwise image preferences, preserving PBRS’s optimal-policy guarantee while removing the need for expert-designed shaping terms. 技術方法: VLM-PBRS 透過輕量視覺語言模型對影像配對的偏好來學習潛能函數,保留 PBRS 對最優策略的保證,同時免除專家設計塑形項的需求。
Key Takeaway: Even with noisier preference labels from small VLMs, the approach accelerates learning and improves robustness to reward hacking in Meta-World and Franka Kitchen. 核心發現: 即使小型 VLM 給出的偏好標籤較不精確,此方法仍能在 Meta-World 與 Franka Kitchen 中加速學習並提升對獎勵駭客行為的韌性。
Learning to Fold: prizewinning solution at LeHome Challenge 2026 (1st place online, 2nd offline)
Authors: Ilia Larchenko | Submitted: 2026-06-25 | arXiv: 2606.27163
Categories: cs.RO, cs.AI, cs.LG
Research Background: Bimanual garment folding is a challenging deformable-object manipulation task; this report documents a competition-winning approach from the ICRA 2026 LeHome Challenge. 研究背景: 雙臂衣物摺疊是極具挑戰的可變形物體操作任務;本文記錄了在 ICRA 2026 LeHome Challenge 競賽奪冠的方法。
Technical Approach: The system improves a flow-matching VLA policy with an RL loop where the same network predicts actions and success/progress signals for advantage estimation, combined with AWR+RECAP, asynchronous distributed training, Thompson-sampling inference tuning, and a DAgger-like sim-to-real recipe. 技術方法: 系統以強化學習迴圈改進流匹配 VLA 策略,同一網路同時預測動作與成功/進度訊號用於優勢估計,並結合 AWR+RECAP、非同步分散式訓練、Thompson 取樣推論調參,以及類 DAgger 的模擬到真實流程。
Key Takeaway: Recombining existing RL techniques with careful engineering yielded a top-2 result among 62 teams in real-world bimanual folding. 核心發現: 將既有強化學習技術與細緻工程結合,在 62 支隊伍的真實世界雙臂摺疊競賽中取得前二名成績。
DMuon: Efficient Distributed Muon Training with Near-Adam Overhead
Authors: Vincent Chen, Starrick Liu, Regis Cheng et al. | Submitted: 2026-06-25 | arXiv: 2606.27153
Categories: cs.DC, cs.LG
Research Background: Matrix-orthogonalization optimizers like Muon converge well but clash with distributed training infrastructure built for element-wise optimizers, making them costly to scale, including for embodied foundation model training. 研究背景: 如 Muon 等矩陣正交化優化器收斂表現良好,但與為逐元素優化器設計的分散式訓練架構不相容,導致擴展成本高昂,這對具身基礎模型訓練亦有影響。
Technical Approach: DMuon is a drop-in distributed implementation of Muon requiring no framework changes, addressing the costly Newton-Schulz iterations that make vanilla Muon over 2x slower than AdamW per step. 技術方法: DMuon 是 Muon 的即插即用分散式實作,無需修改框架,解決了使原版 Muon 每步比 AdamW 慢逾兩倍的高成本 Newton-Schulz 迭代問題。
Key Takeaway: DMuon achieves 1.48x-3.01x end-to-end speedup and up to 163x faster optimizer steps, bringing Muon’s per-step cost near AdamW levels for large-scale model training. 核心發現: DMuon 達成 1.48 至 3.01 倍的端到端加速,優化器步驟最高加速 163 倍,使 Muon 的單步成本接近 AdamW,適用於大規模模型訓練。
XMSE-Aware Adaptive Empirical Bayes Estimation
Authors: Minghao Chen, Jiale Zheng | Submitted: 2026-06-25 | arXiv: 2606.26975
Categories: stat.ML, cs.AI, cs.LG, eess.SY, stat.ME
Research Background: Empirical Bayes estimators can underperform maximum likelihood at second-order risk when the shrinkage kernel is misaligned with the true parameter, motivating a more robust hybrid estimator. 研究背景: 當收縮核函數與真實參數未對齊時,經驗貝氏估計量在二階風險上可能不如最大似然估計,因此需要更穩健的混合估計方法。
Technical Approach: The paper proposes an XMSE-aware mixed estimator interpolating between ML and empirical Bayes shrinkage, with a closed-form oracle mixing weight, a provably consistent plug-in version, and extensions to growing kernel dictionaries. 技術方法: 本文提出一種在最大似然與經驗貝氏收縮之間插值的 XMSE 感知混合估計量,具有閉式神諭混合權重、可證明一致性的插入式版本,並擴展至可增長的核函數字典。
Key Takeaway: On simulations and real benchmarks (Silverbox, Cascaded Tanks), the estimator retains shrinkage benefits when useful and gracefully reverts toward ML under kernel misspecification. 核心發現: 在模擬與真實基準(Silverbox、Cascaded Tanks)上,該估計量在有益時保留收縮優勢,並在核函數設定錯誤時優雅地回歸最大似然估計。
Accelerated sampling using SamAdams variable timesteps and position-adaptive Langevin dynamics
Authors: Benedict Leimkuhler, Peter A. Whalley | Submitted: 2026-06-25 | arXiv: 2606.26881
Categories: math.NA, cs.LG, stat.CO
Research Background: Standard Langevin sampling struggles with stiff regions of phase space, slowing convergence for difficult posterior or energy-landscape geometries relevant to Bayesian inference. 研究背景: 標準 Langevin 取樣在相空間的剛性區域表現不佳,導致對困難後驗或能量地形幾何的收斂速度緩慢,影響貝氏推論應用。
Technical Approach: SA-PAL combines SamAdams adaptive timestepping, which shrinks integration steps in stiff regions, with position-adaptive Langevin dynamics that concentrates friction along the local force direction, implemented in a single-force-evaluation palindromic integrator. 技術方法: SA-PAL 結合 SamAdams 自適應步長(在剛性區域縮小積分步長)與位置自適應 Langevin 動力學(沿局部力方向集中摩擦),並以單次力評估的回文積分器實作。
Key Takeaway: The method improves mixing rates by 1.5-3x on benchmark potentials and achieves order-of-magnitude efficiency gains on harder Bayesian estimation problems. 核心發現: 該方法在基準勢能函數上將混合速率提升 1.5 至 3 倍,並在較困難的貝氏估計問題上取得數量級的效率提升。
MIRROR: Novelty-Constrained Memory-Guided MCTS Red-Teaming for Agentic RAG
Authors: Inderjeet Singh, Andrés Murillo, Motoyoshi Sekiya et al. | Submitted: 2026-06-25 | arXiv: 2606.26793
Categories: cs.CR, cs.AI, cs.LG
Research Background: Multimodal agentic RAG systems face attacks across text, image, query, and orchestrator surfaces, but existing red-teaming methods are surface-specific and tend to recycle near-duplicate attack templates. 研究背景: 多模態代理式 RAG 系統面臨文字、影像、查詢與協調器等多種攻擊面,但現有紅隊測試方法多侵限於單一攻擊面,且傾向重複近似的攻擊樣板。
Technical Approach: MIRROR performs memory-guided Monte Carlo tree search conditioned on retrieved context, with a deterministic Novelty Gate that rejects candidates matching the retrieval set, enabling cross-surface attack generation without prompt copying. 技術方法: MIRROR 以檢索內容為條件進行記憶引導的蒙地卡羅樹搜尋,並以確定性的新穎性閘門拒絕與檢索集相符的候選攻擊,從而在不複製提示的情況下實現跨攻擊面的攻擊生成。
Key Takeaway: MIRROR substantially outperforms specialized baselines across attack surfaces (e.g., 76% vs 52% ASR on image poisoning) while maintaining the lowest cross-surface variance. 核心發現: MIRROR 在各攻擊面上大幅超越專用基準方法(例如影像污染攻擊成功率 76% 對 52%),且跨攻擊面變異最低。
DroidBreaker: Practical and Functional Problem-Space Attacks on Machine-Learning Android Malware Detectors
Authors: Christian Scano, Diego Soi, Angelo Sotgiu et al. | Submitted: 2026-06-25 | arXiv: 2606.26707
Categories: cs.CR, cs.LG
Research Background: Prior adversarial APK attacks on ML malware detectors are often impractical, causing build failures or producing apps that no longer function correctly despite evading detection. 研究背景: 先前針對機器學習惡意軟體偵測器的對抗性 APK 攻擊往往不切實際,常導致建置失敗,或使應用程式雖能規避偵測卻無法正常運作。
Technical Approach: DROIDBREAKER performs query-efficient white/black-box attacks via fine-grained, build-safe manipulations (API/module/permission/URL injection and obfuscation) and validates results with a semantics-preserving functionality test comparing execution traces. 技術方法: DROIDBREAKER 透過細粒度且建置安全的操作(API、模組、權限、URL 的注入與混淆)進行高查詢效率的白盒與黑盒攻擊,並以比對執行追蹤的語意保留功能測試驗證結果。
Key Takeaway: The framework achieves high evasion rates with minimal side effects and drastically reduces detections by commercial scanners on VirusTotal. 核心發現: 該框架以極低副作用達成高規避率,並大幅降低 VirusTotal 上商用掃描器的偵測率。
Revisiting Action Factorization for Complex Action Spaces
Authors: Timothy Flavin, Sandip Sen | Submitted: 2026-06-25 | arXiv: 2606.26574
Categories: cs.LG
Research Background: Many real-world control tasks, including robotics, involve hybrid discrete-continuous action spaces, but existing benchmarks rarely isolate which factorization method works best under which conditions. 研究背景: 許多現實控制任務(包括機器人)涉及混合離散-連續動作空間,但現有基準鮮少能明確指出哪種動作分解方法在何種條件下表現最佳。
Technical Approach: The authors cross-sectionally evaluate six factorization methods across three RL algorithm families and three action-space types on four lightweight environments (including two new C++ environments), introducing branching-critic variants VDN-PPO and PPO-MIX. 技術方法: 作者在四個輕量環境(包含兩個新建 C++ 環境)上,對六種動作分解方法、三種強化學習演算法家族與三種動作空間類型進行交叉評估,並提出分支評論家變體 VDN-PPO 與 PPO-MIX。
Key Takeaway: Branching dueling architectures best balance compute and performance, with auto-regressive action factorization achieving the overall highest performance. 核心發現: 分支對偶架構在計算量與效能間取得最佳平衡,而自迴歸動作分解整體表現最佳。
Sample-efficient Transfer Reinforcement Learning via Adaptive Reward Shaping and Policy-Ratio Reweighting Strategy
Authors: Wenjie Huang, Yang Li, Jingjia Teng et al. | Submitted: 2026-06-25 | arXiv: 2606.26527
Categories: cs.LG
Research Background: Transfer RL for autonomous highway lane changing suffers from transfer mismatch under domain shift and struggles to guarantee safety during exploratory target-domain adaptation. 研究背景: 用於自動駕駛高速公路變道的轉移式強化學習,在領域偏移下易出現轉移不匹配問題,且難以在目標領域探索性適應過程中確保安全性。
Technical Approach: The framework combines an adaptive teacher-intervention mechanism keyed to instantaneous safety cost, a teacher-guided reward-shaping module that decays as student safety improves, and a likelihood-ratio-based sample reweighting scheme to stabilize transfer. 技術方法: 此框架結合依即時安全成本調整的適應性教師介入機制、隨學生安全性提升而衰減的教師引導獎勵塑形模組,以及基於似然比的樣本重加權方案以穩定轉移過程。
Key Takeaway: Validated on real-world NGSIM data, the method improves safety by over 52% and learning efficiency by 5% over baselines across varied traffic densities. 核心發現: 在真實 NGSIM 資料上驗證,該方法在不同交通密度下相較基準方法將安全性提升逾 52%、學習效率提升 5%。
Mean-Field PhiBE: Continuous-Time Mean-Field Reinforcement Learning from Discrete-Time Data
Authors: Erhan Bayraktar, Martin Hernandez, Qinxin Yan et al. | Submitted: 2026-06-25 | arXiv: 2606.26498
Categories: math.OC, cs.LG
Research Background: Model-free continuous-time mean-field control is hard because the drift and diffusion of the true population dynamics are unidentifiable from discrete-time data alone, while naive discretization loses the differential-equation structure. 研究背景: 無模型連續時間平均場控制困難,因為真實群體動態的漂移與擴散項無法僅從離散時間資料識別,而單純離散化則會失去微分方程結構。
Technical Approach: Mean-Field-PhiBE incorporates discrete-time transition data into a continuous-time PDE on Wasserstein space, replacing unknown drift/covariance with one-step data estimators, and pairs this with a policy-gradient theorem for an actor-critic method. 技術方法: Mean-Field-PhiBE 將離散時間轉移資料納入 Wasserstein 空間上的連續時間偏微分方程,以單步資料估計量取代未知的漂移與共變異數,並搭配策略梯度定理形成演員-評論家方法。
Key Takeaway: The method provably approximates the optimal continuous-time value with error of order Δt, achieving second-order accuracy in the linear-quadratic case from only one-step data. 核心發現: 該方法可證明以 Δt 階誤差逼近最優連續時間值,在線性二次情況下僅用單步資料即可達到二階精度。
Optimizing Human-Machine Interface for Real-Time AI Support in the Operating Room: the CVS Copilot
Authors: Lorenzo Arboit, Nicolas Chanel, Aditya Murali et al. | Submitted: 2026-06-25 | arXiv: 2606.26886
Categories: cs.HC
Research Background: AI systems for assessing Critical View of Safety during laparoscopic surgery are nearing clinical use, but their safety depends as much on interface design as on algorithmic accuracy. 研究背景: 用於腹腔鏡手術中評估安全關鍵視野的 AI 系統即將進入臨床應用,但其安全性不僅取決於演算法準確度,也仰賴介面設計。
Technical Approach: Through user-centered design interviews with 17 surgeons of varying seniority, the authors derive role-adaptive interface requirements and build CVS Copilot, a surgeon-controlled HMI with minimal default overlays and optional on-demand anatomical segmentation. 技術方法: 作者透過與 17 位不同資歷外科醫師進行以使用者為中心的設計訪談,推導出角色適應性介面需求,並打造由外科醫師主導控制的 CVS Copilot,預設僅顯示最簡疊加資訊,並提供按需解剖分割選項。
Key Takeaway: Surgeons overwhelmingly favor AI decision support over autonomous decisions, with attendings wanting minimal feedback and residents preferring optional confidence-indicated guidance. 核心發現: 外科醫師絕大多數支持 AI 決策輔助而非自主決策,主治醫師偏好最少回饋,住院醫師則偏好附信心指標的可選引導。
HiLSVA: Design and Evaluation of a Human-in-the-Loop Agentic System for Scientific Visualization
Authors: Kuangshi Ai, Patrick Phuoc Do, Chaoli Wang | Submitted: 2026-06-25 | arXiv: 2606.26614
Categories: cs.HC, cs.AI, cs.GR
Research Background: LLM agents enable natural-language scientific visualization, but prior systems prioritize autonomy over human control, limiting transparency and oversight in analytical workflows. 研究背景: LLM 代理使自然語言科學視覺化成為可能,但先前系統優先考量自主性而非人類控制,限制了分析工作流程中的透明度與監督。
Technical Approach: HiLSVA integrates a plan-first multi-agent architecture with explicit human oversight, stepwise provenance tracking, and learn-at-test-time adaptation, supporting handoff via natural language and direct manipulation within sandboxed execution. 技術方法: HiLSVA 整合「先規劃」多代理架構與明確的人類監督、逐步溯源追蹤及測試時學習適應,並透過自然語言與直接操作在沙箱執行環境中支援人機交接。
Key Takeaway: A 12-participant study shows mixed-initiative interaction improves task completion and transparency but trades off some execution efficiency for human oversight. 核心發現: 12 人參與的研究顯示混合主動式互動可提升任務完成度與透明度,但會以部分執行效率換取人類監督。
DanceDuo: Bridging Human Movement and AI Choreography
Authors: Gia-Cat Bui-Le, Tuong-Vy Truong-Thuy, Hai-Dang Nguyen et al. | Submitted: 2026-06-25 | arXiv: 2606.26507
Categories: cs.HC, cs.CV
Research Background: Music-driven dance generation has advanced with diffusion models, but tools for letting users practice against and compare with AI-generated choreography remain underexplored. 研究背景: 隨著擴散模型發展,音樂驅動舞蹈生成已有進展,但讓使用者練習並與 AI 生成編舞進行比較的工具仍待開發。
Technical Approach: DanceDuo uses diffusion models to generate music-synchronized choreography and integrates human pose estimation to let users compare their own recorded dance performance against AI-generated sequences. 技術方法: DanceDuo 運用擴散模型生成與音樂同步的編舞,並整合人體姿態估計,讓使用者比較自己錄製的舞蹈表現與 AI 生成序列。
Key Takeaway: A user study found the interface intuitive, with the dance-comparison feature particularly well-received for practice purposes. 核心發現: 使用者研究顯示介面直覺易用,舞蹈比較功能特別受到練習者的好評。
Charting the Growth of Social-Physical HRI (spHRI): A Systematic Review Pipeline Augmented by Small Language Models
Authors: Mayumi Mohan, Ju-Hung Chen, Alexis E. Block | Submitted: 2026-06-24 | arXiv: 2606.26382
Categories: cs.CL, cs.AI, cs.DL, cs.HC, cs.RO
Research Background: Social-physical HRI research has grown quickly but is fragmented across terminology and methodology, making systematic literature synthesis slow and difficult to scale. 研究背景: 社會物理人機互動(spHRI)研究迅速成長,但術語與方法論分散,使系統性文獻整合既緩慢又難以擴展。
Technical Approach: The authors evaluate small language models (under 1.5B parameters) for title/abstract screening in a large spHRI systematic review, running them locally as an ensemble alongside human reviewers. 技術方法: 作者評估小型語言模型(參數低於 15 億)用於大型 spHRI 系統性綜述的標題與摘要篩選,將其作為本地執行的集成方法與人類審閱者並行使用。
Key Takeaway: While no SLM matched human reviewer accuracy, the SLM ensemble caught 39 relevant papers (10.29% of the final dataset) that human reviewers missed, suggesting a useful augmentation role. 核心發現: 雖然單一 SLM 準確度不及人類審閱者,但 SLM 集成方法找出了人類審閱者遺漏的 39 篇相關論文(佔最終資料集 10.29%),顯示其作為輔助工具的價值。
Having Dog Ears “for Real”: Effects of Active and Passive Haptics on Embodying Non-Human Body Parts in VR
Authors: Omar A. Khan, Bao Han Trinh, Lee Lisle et al. | Submitted: 2026-06-24 | arXiv: 2606.26364
Categories: cs.HC
Research Background: Embodying non-human body parts (e.g., animal ears) in VR is popular but morphological mismatch between real and virtual bodies reduces Sense of Embodiment, and how different haptic modalities affect this was unclear. 研究背景: 在 VR 中具身化非人類身體部位(如動物耳朵)很受歡迎,但真實與虛擬身體間的形態差異會降低具身感,而不同觸覺模態的影響尚不明確。
Technical Approach: Following a survey establishing dog ears as ecologically valid, the authors ran a 2x2 within-subjects study (n=28) manipulating active (vibrotactile glove) and passive (physical headband) haptics while participants reached to touch virtual dog ears. 技術方法: 在透過調查確立狗耳朵具生態效度後,作者進行 2x2 受試者內研究(n=28),操弄主動觸覺(震動觸覺手套)與被動觸覺(實體頭帶),觀察參與者伸手觸碰虛擬狗耳朵的反應。
Key Takeaway: Passive haptics alone produced the strongest embodiment, combining modalities reduced its benefit, and embodiment of the body part correlated with whole-avatar embodiment. 核心發現: 單獨使用被動觸覺產生最強具身感,混合多種模態反而降低效果,且身體部位的具身感與整體化身具身感呈正相關。
Reasonable Motion: A General ASP Foundation for Environment Constrained Movement Trajectory Computation
Authors: Julius Monsen, Jakob Suchan, Mehul Bhatt et al. | Submitted: 2026-06-24 | arXiv: 2606.25626
Categories: cs.AI, cs.HC, cs.RO
Research Background: Purely learned trajectory-prediction approaches for moving objects (e.g., in autonomous driving) lack traceable, verifiable interpretability, motivating a symbolic alternative grounded in environment constraints. 研究背景: 純粹基於學習的移動物體軌跡預測方法(如自動駕駛)缺乏可追溯、可驗證的可解釋性,因此需要以環境約束為基礎的符號式替代方案。
Technical Approach: The method uses answer set programming to perform constrained traversal of an environment graph, enumerating geometrically admissible trajectory modes as stable models that combine domain-dependent and independent factors such as event sequences and map topology. 技術方法: 此方法運用回答集程式設計對環境圖進行受限遍歷,將幾何上可行的軌跡模式列舉為穩定模型,結合事件序列、地圖拓樂等領域相關與無關因素。
Key Takeaway: Evaluated on the Argoverse 2 autonomous-driving benchmark, the approach yields trajectories traceable to interpretable stable models, unlike purely learned methods. 核心發現: 在 Argoverse 2 自動駕駛基準上評估,該方法產生可追溯至可解釋穩定模型的軌跡,這是純學習方法所無法做到的。
AI Coaching for Accelerating Human Skill Development with Reinforcement Learning
Authors: Wei Wang, Enlin Gu, Antonio Loquercio et al. | Submitted: 2026-06-24 | arXiv: 2606.25337
Categories: cs.RO, cs.AI, cs.HC
Research Background: AI copilots can boost performance via shared control, but excessive assistance risks over-reliance and skill atrophy, raising the question of how an AI coach should scaffold rather than substitute for human learning. 研究背景: AI 副駕駛可透過共享控制提升表現,但過度協助有導致過度依賴與技能退化的風險,因此須探討 AI 教練應如何輔助而非取代人類學習。
Technical Approach: The authors formalize AI coaching as a non-cooperative dynamic game between learner performance and coach-targeted independent competence, and develop an RL framework combining adaptive shared control with probabilistic causal models of the coach’s influence on skill evolution. 技術方法: 作者將 AI 教練互動形式化為學習者表現與教練目標獨立能力之間的非合作動態博弈,並開發結合適應性共享控制與教練影響技能演進之機率因果模型的強化學習框架。
Key Takeaway: A 33-person drone-racing user study shows the coaching policy produces significantly better human learning outcomes than state-of-the-art AI coaching baselines. 核心發現: 一項 33 人參與的無人機競速使用者研究顯示,該教練策略相較最先進的 AI 教練基準方法,能顯著提升人類學習成效。
ARTOO-DARTU: Studying AR-HRC With AR Obstruction Mitigation During a Warehouse Task
Authors: Christian Fronk, Hanting Ye, Zhehan Qu et al. | Submitted: 2026-06-23 | arXiv: 2606.25202
Categories: cs.HC, cs.RO
Research Background: AR situated analytics can convey mobile robot intent in human-robot collaboration, but dynamically positioned AR content risks obstructing real-world elements, creating safety and usability hazards in warehouse settings. 研究背景: AR 情境分析可在人機協作中傳達移動機器人意圖,但動態定位的 AR 內容有遮擋真實世界元素的風險,在倉庫場景中造成安全與可用性隱患。
Technical Approach: ARTOO-DARTU adds an obstruction detection and mitigation (ODM) pipeline to AR situated analytics for warehouse HRC, evaluated via Pocket MonstARs, a gamified warehouse-picking abstraction in a 34-participant study. 技術方法: ARTOO-DARTU 為倉庫人機協作的 AR 情境分析加入遮擋偵測與緩解(ODM)管道,並透過 Pocket MonstARs(遊戲化倉庫揀貨抽象任務)進行 34 人參與的使用者研究評估。
Key Takeaway: AR situated analytics boosted task efficiency by 46% only when ODM was active, and ODM made real-world-visibility subtasks 61% faster. 核心發現: AR 情境分析僅在 ODM 啟用時才能提升 46% 的任務效率,且 ODM 使需要真實世界可見性的子任務快了 61%。
EveLoad: Cognitive Workload Recognition from Event-Based Eye Movements
Authors: Guorui Lu, Shaohua Guan, Zhen Xu et al. | Submitted: 2026-06-23 | arXiv: 2606.25177
Categories: cs.LG, cs.HC
Research Background: Adaptive rehabilitation and assistive interfaces need unobtrusive cognitive-workload sensing, but frame-based eye trackers have limited temporal resolution for capturing rapid ocular dynamics, and free-viewing paradigms confound gaze location with workload. 研究背景: 適應性復健與輔助介面需要不引人注意的認知負荷感測,但畫面式眼動追蹤器的時間解析度有限,難以捕捉快速眼動,且自由觀看範式會將注視位置與負荷混淆。
Technical Approach: EveLoad introduces the first event-camera-based eye-movement dataset with graded workload labels, collected under a controlled N-back fixation paradigm to avoid gaze-location confounds, paired with a spatiotemporal event-encoding learning framework. 技術方法: EveLoad 推出首個基於事件相機的眼動資料集並附帶分級負荷標註,在受控的 N-back 注視範式下收集以避免注視位置混淆,並搭配時空事件編碼學習框架。
Key Takeaway: The approach achieves over 96% subject-specific accuracy across six workload levels, suggesting event-based sensing as a promising pathway for workload-aware rehabilitation. 核心發現: 該方法在六個負荷等級上達到超過 96% 的受試者專屬準確率,顯示事件式感測是負荷感知復健的可行途徑。
fARfetch: Enabling Collocated AR-HRC in Large Visually Diverse Environments with VLM-Driven AR Content Adaptation
Authors: Christian Fronk, Hanting Ye, David Hunt et al. | Submitted: 2026-06-23 | arXiv: 2606.25162
Categories: cs.RO, cs.CV, cs.HC
Research Background: AR can make robot state and intent visible for collocated human-robot collaboration, but large, visually diverse outdoor environments challenge both interaction range and AR content legibility. 研究背景: AR 可使機器人狀態與意圖在共處式人機協作中可見,但大型且視覺多樣的戶外環境對互動範圍與 AR 內容可讀性皆構成挑戰。
Technical Approach: fARfetch combines shared semantic mapping between an AR headset and robot, a world-in-miniature representation for path authoring, and VLM-driven adaptation of AR content color, size, and orientation to maintain legibility, tested with a Quest 3 headset and Unitree Go2 robot. 技術方法: fARfetch 結合 AR 頭戴裝置與機器人間的共享語意地圖、用於路徑規劃的縮微世界表示,以及 VLM 驅動的 AR 內容顏色、大小、方向調整以維持可讀性,並以 Quest 3 頭戴裝置與 Unitree Go2 機器人測試。
Key Takeaway: In a 13-participant outdoor study, fARfetch cut task completion time by 66% and significantly lowered mental demand, temporal demand, and frustration versus a non-AR baseline. 核心發現: 在 13 人參與的戶外研究中,fARfetch 相較非 AR 基準方法將任務完成時間縮短 66%,並顯著降低心智負荷、時間壓力與挫折感。
Proactive Systems in HCI and AI: Concepts, Challenges, and Opportunities
Authors: Nima Zargham, Sharon Ferguson, Jaisie Sin et al. | Submitted: 2026-06-23 | arXiv: 2606.25149
Categories: cs.HC, cs.AI
Research Background: Proactive AI systems, including assistive robots that act without explicit input, are growing in number but the term “proactivity” is loosely defined and inconsistently applied, limiting systematic design and evaluation. 研究背景: 包括無需明確輸入即可行動的輔助機器人,主動式 AI 系統數量日增,但「主動性」一詞定義鬆散、應用不一致,限制了系統性設計與評估。
Technical Approach: This workshop paper brings together HCI and AI researchers to develop a shared conceptualization of proactivity, identify gaps in current design/evaluation methodologies rooted in reactive paradigms, and co-create human-centered guidelines. 技術方法: 本工作坊論文集結人機互動與 AI 研究者,共同建立主動性的共同概念框架,辨識現有植根於反應式範式之設計評估方法的不足,並共同制定以人為本的指引。
Key Takeaway: The paper frames timing, appropriateness, user control, transparency, and trust as key unresolved challenges for designing and evaluating proactive systems. 核心發現: 本文將時機、適當性、使用者控制、透明度與信任,框定為設計與評估主動式系統的關鍵未解難題。
“Zooming In” on Agentic Web Browsers as Assistive Technologies: A Case Study with a Low-Vision Technology Expert
Authors: Laura Colazzo, Giuseppe Anzillotti | Submitted: 2026-06-23 | arXiv: 2606.24870
Categories: cs.HC
Research Background: LLM-powered agentic web browsers can autonomously navigate the web on a user’s behalf, suggesting unexplored potential as assistive technology for visually-impaired users beyond general productivity use cases. 研究背景: 由 LLM 驅動的代理式網頁瀏覽器可代表使用者自主瀏覽網頁,這意味著其作為視障使用者輔助技術的潛力尚待探索,超越一般生產力應用情境。
Technical Approach: The authors conduct a case study with a low-vision technology expert, examining how an agentic web browser supports web navigation through fluid conversational interaction. 技術方法: 作者與一位低視力技術專家進行案例研究,探討代理式網頁瀏覽器如何透過流暢的對話式互動支援網頁導覽。
Key Takeaway: Despite current limitations, the navigation experience was notably fluid and flexible, pointing to strong potential for agentic browsers to reduce web accessibility barriers. 核心發現: 儘管現有限制存在,導覽體驗仍相當流暢靈活,顯示代理式瀏覽器在降低網頁無障礙障礙方面具有強大潛力。
Virtual Simulation for Mental Health
Authors: Anna Fang | Submitted: 2026-06-23 | arXiv: 2606.24826
Categories: cs.HC
Research Background: Mental health interventions are increasingly delivered via technology, but poorly designed or unsafeguarded interventions can cause real harm, motivating safer ways to test new approaches before real-world deployment. 研究背景: 心理健康介入措施日益透過科技提供,但設計不良或缺乏保護措施的介入可能造成實際傷害,因此需要在真實部署前更安全的測試方式。
Technical Approach: This work explores virtual simulation — replicating social situations, stressors, and outcomes in controlled virtual environments — for both community-level evaluation via agent-based modeling and individual embodied training. 技術方法: 本研究探討虛擬模擬——在受控虛擬環境中重現社交情境、壓力源與結果——可用於透過代理式建模進行社群層級評估,亦可用於個人具身訓練。
Key Takeaway: A human-centered virtual simulation approach can enable safe experimentation with mental health interventions, reducing real-world risk while informing scalable system design. 核心發現: 以人為本的虛擬模擬方法能在不承擔真實世界風險的情況下安全試驗心理健康介入,並為可擴展系統設計提供依據。
Average Rankings Mask Per-Subject Optimality: A Friedman-Nemenyi Benchmark of EEG Motor-Imagery BCI Decoders
Authors: Xavier Vasques, Paul Barbaste, Olivier Oullier | Submitted: 2026-06-23 | arXiv: 2606.24394
Categories: cs.HC, cs.AI, cs.RO, q-bio.NC
Research Background: BCI motor-imagery decoding is hampered by inter- and intra-individual variability, and claims that one decoding pipeline is broadly best are rarely tested with rigorous per-subject statistics. 研究背景: 腦機介面運動想像解碼受限於個體間與個體內變異性,而「某一解碼管道普遍最佳」的說法鮮少經過嚴謹的逐受試者統計檢驗。
Technical Approach: Using the MOABB framework, the authors evaluate 1,056 decoding configurations across three public datasets and two frequency bands, applying Friedman omnibus tests, Nemenyi critical-difference analysis, and Wilcoxon signed-rank tests. 技術方法: 作者使用 MOABB 框架,在三個公開資料集與兩個頻帶上評估 1,056 種解碼配置組合,並運用 Friedman 整體檢定、Nemenyi 臨界差異分析與 Wilcoxon 符號秩檢定。
Key Takeaway: No single pipeline dominates — the best fixed pipeline is optimal for only 35% of subjects, and participant-aware model selection adds roughly seven accuracy points over a universal decoder. 核心發現: 沒有單一管道能全面稱霸——最佳固定管道僅對 35% 受試者最優,而採用受試者感知的模型選擇相較通用解碼器可提升約七個百分點的準確率。
Embodied Explainability and Ontological Obstacles: Why We Struggle to Explain the Answers of Large Language Models (LLMs)
Authors: Marvin Pafla, Jesse Hoey, Kate Larson et al. | Submitted: 2026-06-22 | arXiv: 2606.23840
Categories: cs.HC
Research Background: Explainability is typically treated as a property extracted from a model’s internals, but this framing may misrepresent how human understanding actually arises through situated action and shared practice. 研究背景: 可解釋性通常被視為從模型內部提取出的屬性,但此框架可能誤解了人類理解實際上是透過情境化行動與共同實踐而產生的方式。
Technical Approach: Drawing on Dourish and enactivist cognition, the authors give an embodied account of explainability, using demonstrations and conceptual analysis to show how internal-reasoning surrogates import external abstractions that can be mistaken for the model’s own. 技術方法: 作者借鑑 Dourish 與行動主義認知理論,提出可解釋性的具身化論述,透過示範與概念分析說明內部推理替代物如何引入外部抽象概念,並可能被誤認為模型本身的推理。
Key Takeaway: Many current LLM “explanations” are misnamed and risk increasing overreliance; genuine explainability should instead provide affordances to probe, coordinate, and repair behavior in situated practice. 核心發現: 許多現有 LLM「解釋」名不副實,可能加劇過度依賴;真正的可解釋性應提供能在情境實踐中探查、協調與修復行為的可操作性。