Parallel collaboration and closed-loop control of a cursor using multimodal physiological signals

计算机科学 游标(数据库) 眼动 运动表象 眼球运动 异步通信 人工智能 错误检测和纠正 计算机视觉 模拟 脑电图 脑-机接口 算法 心理学 计算机网络 精神科
作者
Zeqi Ye,Yang Yu,Yiyun Zhang,Yingxin Liu,Jianxiang Sun,Zongtan Zhou,Ling‐Li Zeng
出处
期刊:Biocybernetics and Biomedical Engineering [Elsevier]
卷期号:44 (3): 470-480
标识
DOI:10.1016/j.bbe.2024.07.004
摘要

This paper explores the parallel collaboration of multimodal physiological signals, combining eye tracker output signals, motor imagery, and error-related potentials to control a computer mouse. Specifically, a parallel working mechanism is implemented in the decision layer, where the eye tracker manages cursor movements, and motor imagery manages click functions. Meanwhile, the eye tracker output signals are integrated with electroencephalography data to detect the idle state for asynchronous control. Additionally, error-related potentials evoked by visual feedback, are detected to reduce the cost of error corrections. To efficiently collect data and provide continuous evaluations, we performed offline training and online testing in the designed paradigm. To further validate the practicability, we conducted online experiments on the real-world computer, focusing on a scenario of opening and closing files. The experiments involved seventeen subjects. The results showed that the stability of the eye tracker was optimized from 67.6% to 95.2% by the designed filter, providing the support for parallel control. The accuracy of motor imagery conducted simultaneously with fixations reached 93.41 ± 2.91%, proving the feasibility of parallel control. Furthermore, the real-world experiments took 45.86 ± 14.94 s to complete three movements and clicks, and showed a significant improvement compared to the baseline experiment without automatic error correction, validating the practicability of the system and the efficacy of error-related potentials detection. Moreover, this system freed users from the stimulus paradigm, enabling a more natural interaction. To sum up, the parallel collaboration of multimodal physiological signals is novel and feasible, the designed mouse is practical and promising.
最长约 10秒,即可获得该文献文件

科研通智能强力驱动
Strongly Powered by AbleSci AI
科研通是完全免费的文献互助平台,具备全网最快的应助速度,最高的求助完成率。 对每一个文献求助,科研通都将尽心尽力,给求助人一个满意的交代。
实时播报
偶然发现的西柚完成签到 ,获得积分10
刚刚
无心的无施完成签到,获得积分20
刚刚
JamesPei应助科研通管家采纳,获得10
2秒前
乐观板凳发布了新的文献求助30
2秒前
科研通AI5应助科研通管家采纳,获得20
2秒前
烟花应助科研通管家采纳,获得10
2秒前
三千世界完成签到,获得积分10
2秒前
烟花应助科研通管家采纳,获得10
2秒前
科研通AI5应助科研通管家采纳,获得10
2秒前
Ava应助科研通管家采纳,获得10
2秒前
共享精神应助科研通管家采纳,获得10
2秒前
Akim应助薛妖怪采纳,获得10
2秒前
英姑应助科研通管家采纳,获得10
2秒前
3秒前
orixero应助科研通管家采纳,获得10
3秒前
扣子发布了新的文献求助10
3秒前
3秒前
小二郎应助科研通管家采纳,获得10
3秒前
3秒前
个性的振家完成签到,获得积分10
3秒前
4秒前
5秒前
szs完成签到,获得积分10
7秒前
501小队完成签到,获得积分10
8秒前
8秒前
SciGPT应助欣新采纳,获得10
8秒前
薛微有点甜完成签到 ,获得积分10
9秒前
小小小乐发布了新的文献求助10
9秒前
9秒前
段大开完成签到,获得积分20
10秒前
橡皮泥发布了新的文献求助10
12秒前
SONG完成签到 ,获得积分20
13秒前
sims发布了新的文献求助10
13秒前
贺同学完成签到,获得积分10
15秒前
所所应助开心千青采纳,获得10
15秒前
15秒前
orixero应助trace采纳,获得10
16秒前
终于花开日完成签到 ,获得积分10
16秒前
完美世界应助wukuner2采纳,获得10
17秒前
17秒前
高分求助中
Comparative Anatomy of the Vertebrates 9th 3000
Continuum Thermodynamics and Material Modelling 3000
Production Logging: Theoretical and Interpretive Elements 2700
Les Mantodea de Guyane Insecta, Polyneoptera 1000
Structural Load Modelling and Combination for Performance and Safety Evaluation 1000
Conference Record, IAS Annual Meeting 1977 820
England and the Discovery of America, 1481-1620 600
热门求助领域 (近24小时)
化学 材料科学 生物 医学 工程类 有机化学 生物化学 物理 纳米技术 计算机科学 内科学 化学工程 复合材料 基因 遗传学 物理化学 催化作用 量子力学 光电子学 冶金
热门帖子
关注 科研通微信公众号,转发送积分 3572102
求助须知:如何正确求助?哪些是违规求助? 3142380
关于积分的说明 9447398
捐赠科研通 2843806
什么是DOI,文献DOI怎么找? 1563098
邀请新用户注册赠送积分活动 731575
科研通“疑难数据库(出版商)”最低求助积分说明 718603