Summary

This post explains why locomotion and manipulation are fundamentally different control problems, not merely variations of the same challenge. The core distinction is temporal scale: a falling body gives ~450ms of reaction time at 1 kHz, while a small object in contact gives only milliseconds, requiring 100x faster sensing and computation. Cameras, which dominate locomotion sensing, are nearly blind to the sub-millisecond force dynamics at the heart of fine manipulation.

機器人行走與操作物體是兩個本質不同的控制問題。行走給控制器約 450ms 反應時間(從 1m 高度落下),而精細操作中接觸事件僅持續數毫秒,意味著感測器需快 100 倍。視覺感測在操作任務中更難捕捉接觸力與微變形,這是當前機器人操作面臨的根本瓶頸。

Key Points

  • Free-fall thought experiment: 1m drop ≈ 450ms (locomotion), 1mm drop ≈ tens of ms (manipulation)
  • To match locomotion’s 450-cycle budget for manipulation, sensors and processors must run ~100x faster
  • Cameras capture pre- and post-contact states but miss the contact dynamics in between
  • Detecting acceleration requires at least three successive frames, adding latency
  • Internal motor efforts are invisible to cameras

Insights

The framing of manipulation as an “inverted” locomotion problem (robot controls object vs. robot is the object) is elegant. The practical implication is that the entire sensor and compute stack built for locomotion is systematically mismatched for dexterous manipulation — not by degree but by kind. This explains why tactile and force sensing are so critical for in-hand manipulation, and why the community cannot simply scale up vision-based locomotion stacks.

Connections

Raw Excerpt

To give a manipulation robot the same 450 control cycles of reaction time that a locomotion robot enjoys, you’d need to scale up every part of the system by roughly 100×: sensors would need to sample 100× faster, processors would need to compute 100× faster, the control loop would need 100× higher bandwidth.