An agile large-workspace teleoperation interface based on human arm motion and force estimation

Jianhang Jia, Hao Zhou, Xin Zhang*

*Corresponding author for this work

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

Teleoperation can transfer human perception and cognition to a slave robot to cope with some complex tasks, in which the agility and flexibility of the interface play an important role in mapping human intention to the robot. In this paper, we developed an agile large-workspace teleoperation interface by estimating human arm behavior. Using the wearable sensor, namely the inertial measurement unit and surface electromyography armband, we can capture the human arm motion and force information, thereby intuitively controlling the manipulation of the robot. The control principle of our wearable interface includes two parts: (1) the arm incremental kinematics and (2) the grasping recognition. Moreover, we developed a teleoperation framework with a time synchronization mechanism for the real-time application. We conducted experimental comparisons with a versatile haptic device (Omega 7) to verify the effectiveness of our interface and framework. Seven subjects are invited to complete three different tasks: free motion, handover, and pick-and-place action (each task ten times), and the total number of tests is 420. Objectively, we used the task completion time and success rate to compare the performance of the two interfaces quantitatively. In addition, to quantify the operator experience, we used the NASA Task Load Index to assess their subjective feelings. The results showed that the proposed interface achieved a competitive performance with a better operating experience.

Original languageEnglish
Title of host publication2024 IEEE International Conference on Robotics and Biomimetics, ROBIO 2024
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages117-122
Number of pages6
ISBN (Electronic)9798331509644
ISBN (Print)9798331509651
DOIs
Publication statusPublished - 7 Mar 2025
Event2024 IEEE International Conference on Robotics and Biomimetics, ROBIO 2024 - Bangkok, Thailand
Duration: 10 Dec 202414 Dec 2024

Publication series

NameROBIO Proceedings
PublisherIEEE
ISSN (Print)2994-3566
ISSN (Electronic)2994-3574

Conference

Conference2024 IEEE International Conference on Robotics and Biomimetics, ROBIO 2024
Country/TerritoryThailand
CityBangkok
Period10/12/2414/12/24

Fingerprint

Dive into the research topics of 'An agile large-workspace teleoperation interface based on human arm motion and force estimation'. Together they form a unique fingerprint.

Cite this