DS-Dual Arm
Dual-Arm Robot Teleoperation Solution
This solution captures an operator’s bimanual motions in real time and reflects them on a dual-arm robot and robotic hands, enabling the reproduction of complex manipulation tasks and the collection of human-robot behavioral data for AI training.
Our solution captures an operator’s bimanual movements and maps them onto a dual-arm robot and robotic hands in real time, enabling the reproduction of complex manipulation tasks and the collection of human-robot action data for AI training. It is applicable to a wide range of tasks, including irregular object manipulation, bimanual assembly, tool use, and contact-rich operations. The solution can be leveraged for task verification, demonstration, dataset construction, and the training and refinement of AI manipulation models.
System Architecture
The operator’s bimanual movements are captured using data gloves and trackers, while a PC-based control system converts and maps this input into real-time control commands for the dual-arm robot and robotic hands. This architecture enables the reproduction of bimanual manipulation tasks on the robot platform, allowing for the integrated collection of both human manipulation strategies and robot response data. Additionally, a 2.5D vision system can be mounted on the robot arm’s wrist or above the worktable, enabling expansion into multimodal dataset construction and VLA (Vision-Language-Action) model validation.
Operator Interface
Input devices that capture the operator’s hand and arm movements.
- Data Gloves (Left / Right): Finger and hand motion recognition
- Trackers (2 Sets): Position and orientation tracking of hands and arms
- Base Stations (2 Sets): Tracking environment setup
- Foot Switches (3 ea): Coordinate calibration and system start/stop control
Control System
Control units that interpret input data and relay commands to the robot system.
- Main Control PC: Input data processing, motion mapping, and execution of overall control logic
- Robot Arm Controller: Dual-arm robot control
- Gripper Controller: Left and right robotic hand control
Robot System
Robotic hardware that performs the actual manipulation tasks.
- Robot Arms (2 Sets): Dual-arm robot actuation
- Delto Gripper 5F (Left / Right): Bimanual manipulation execution
