虚拟现实
计算机科学
触觉技术
人机交互
任务(项目管理)
模块化设计
管道(软件)
可穿戴计算机
人工智能
机械臂
机器人学
控制(管理)
外骨骼
机器人
模拟
工程类
嵌入式系统
系统工程
操作系统
程序设计语言
作者
Giulia Dominijanni,Daniel J. L. L. Pinheiro,Leonardo Pollina,Bastien Orset,Maria Gini,Eugenio Anselmino,Camilla Pierella,Jérémy Olivier,Solaiman Shokur,Silvestro Micera
出处
期刊:Science robotics
[American Association for the Advancement of Science (AAAS)]
日期:2023-12-13
卷期号:8 (85)
被引量:2
标识
DOI:10.1126/scirobotics.adh1438
摘要
Extra robotic arms (XRAs) are gaining interest in neuroscience and robotics, offering potential tools for daily activities. However, this compelling opportunity poses new challenges for sensorimotor control strategies and human-machine interfaces (HMIs). A key unsolved challenge is allowing users to proficiently control XRAs without hindering their existing functions. To address this, we propose a pipeline to identify suitable HMIs given a defined task to accomplish with the XRA. Following such a scheme, we assessed a multimodal motor HMI based on gaze detection and diaphragmatic respiration in a purposely designed modular neurorobotic platform integrating virtual reality and a bilateral upper limb exoskeleton. Our results show that the proposed HMI does not interfere with speaking or visual exploration and that it can be used to control an extra virtual arm independently from the biological ones or in coordination with them. Participants showed significant improvements in performance with daily training and retention of learning, with no further improvements when artificial haptic feedback was provided. As a final proof of concept, naïve and experienced participants used a simplified version of the HMI to control a wearable XRA. Our analysis indicates how the presented HMI can be effectively used to control XRAs. The observation that experienced users achieved a success rate 22.2% higher than that of naïve users, combined with the result that naïve users showed average success rates of 74% when they first engaged with the system, endorses the viability of both the virtual reality–based testing and training and the proposed pipeline.
科研通智能强力驱动
Strongly Powered by AbleSci AI