DS-Dual Arm
Dual-Arm Robot Teleoperation-Based Action Data Collection Solution
Our solution captures an operator’s bimanual movements and maps them onto a dual-arm robot and robotic hands in real time, enabling the reproduction of complex manipulation tasks and the collection of human-robot action data for AI training.
It is applicable to a wide range of tasks, including irregular object manipulation, bimanual assembly, tool use, and contact-rich operations. The solution can be leveraged for task verification, demonstration, dataset construction, and the training and refinement of AI manipulation models.
System Architecture
The operator’s bimanual movements are captured using data gloves and trackers, while a PC-based control system converts and maps this input into real-time control commands for the dual-arm robot and robotic hands.
This architecture enables the reproduction of bimanual manipulation tasks on the robot platform, allowing for the integrated collection of both human manipulation strategies and robot response data.
Additionally, a 2.5D vision system can be mounted on the robot arm’s wrist or above the worktable, enabling expansion into multimodal dataset construction and VLA (Vision-Language-Action) model validation.
Applications
Control System
1. Operator Interface
Input devices that capture the operator’s hand and arm movements
2. Control System
Control units that interpret input data and relay commands to the robot system
3. Robot System
Robotic hardware that performs the actual manipulation tasks
