Parallel collaboration and closed-loop control of a cursor using multimodal physiological signals

计算机科学 游标(数据库) 眼动 运动表象 眼球运动 异步通信 人工智能 错误检测和纠正 计算机视觉 模拟 脑电图 脑-机接口 算法 心理学 计算机网络 精神科
作者
Zeqi Ye,Yang Yu,Yiyun Zhang,Yingxin Liu,Jianxiang Sun,Zongtan Zhou,Ling‐Li Zeng
出处
期刊:Biocybernetics and Biomedical Engineering [Elsevier]
卷期号:44 (3): 470-480
标识
DOI:10.1016/j.bbe.2024.07.004
摘要

This paper explores the parallel collaboration of multimodal physiological signals, combining eye tracker output signals, motor imagery, and error-related potentials to control a computer mouse. Specifically, a parallel working mechanism is implemented in the decision layer, where the eye tracker manages cursor movements, and motor imagery manages click functions. Meanwhile, the eye tracker output signals are integrated with electroencephalography data to detect the idle state for asynchronous control. Additionally, error-related potentials evoked by visual feedback, are detected to reduce the cost of error corrections. To efficiently collect data and provide continuous evaluations, we performed offline training and online testing in the designed paradigm. To further validate the practicability, we conducted online experiments on the real-world computer, focusing on a scenario of opening and closing files. The experiments involved seventeen subjects. The results showed that the stability of the eye tracker was optimized from 67.6% to 95.2% by the designed filter, providing the support for parallel control. The accuracy of motor imagery conducted simultaneously with fixations reached 93.41 ± 2.91%, proving the feasibility of parallel control. Furthermore, the real-world experiments took 45.86 ± 14.94 s to complete three movements and clicks, and showed a significant improvement compared to the baseline experiment without automatic error correction, validating the practicability of the system and the efficacy of error-related potentials detection. Moreover, this system freed users from the stimulus paradigm, enabling a more natural interaction. To sum up, the parallel collaboration of multimodal physiological signals is novel and feasible, the designed mouse is practical and promising.
最长约 10秒,即可获得该文献文件

科研通智能强力驱动
Strongly Powered by AbleSci AI
科研通是完全免费的文献互助平台,具备全网最快的应助速度,最高的求助完成率。 对每一个文献求助,科研通都将尽心尽力,给求助人一个满意的交代。
实时播报
哈哈哈哈完成签到,获得积分10
1秒前
佳小佳发布了新的文献求助30
2秒前
2秒前
彭于晏应助半分青蓝采纳,获得10
2秒前
橘子石榴完成签到 ,获得积分10
2秒前
今后应助echo采纳,获得10
4秒前
chriswtr发布了新的文献求助50
6秒前
斑点发布了新的文献求助10
7秒前
木樨完成签到,获得积分10
11秒前
务实的乌冬面完成签到,获得积分20
13秒前
dbq完成签到 ,获得积分10
13秒前
15秒前
Junlei完成签到,获得积分10
15秒前
16秒前
CodeCraft应助parpate采纳,获得10
16秒前
chriswtr完成签到,获得积分10
17秒前
18秒前
18秒前
粥小周发布了新的文献求助10
19秒前
20秒前
领导范儿应助羊青丝采纳,获得10
21秒前
无聊完成签到,获得积分10
21秒前
碧蓝帅哥发布了新的文献求助10
21秒前
一木发布了新的文献求助20
22秒前
今后应助无Wen3采纳,获得10
24秒前
钰钰发布了新的文献求助10
24秒前
25秒前
单薄树叶完成签到,获得积分10
25秒前
25秒前
25秒前
26秒前
parpate发布了新的文献求助10
27秒前
FATYE发布了新的文献求助10
29秒前
echo发布了新的文献求助10
30秒前
Lucky发布了新的文献求助10
31秒前
echo完成签到,获得积分10
34秒前
36秒前
zz发布了新的文献求助30
38秒前
戈惜完成签到 ,获得积分10
39秒前
学术大白完成签到 ,获得积分10
40秒前
高分求助中
Continuum Thermodynamics and Material Modelling 3000
Production Logging: Theoretical and Interpretive Elements 2700
Les Mantodea de Guyane Insecta, Polyneoptera 1000
Structural Load Modelling and Combination for Performance and Safety Evaluation 1000
Conference Record, IAS Annual Meeting 1977 820
England and the Discovery of America, 1481-1620 600
電気学会論文誌D(産業応用部門誌), 141 巻, 11 号 510
热门求助领域 (近24小时)
化学 材料科学 生物 医学 工程类 有机化学 生物化学 物理 纳米技术 计算机科学 内科学 化学工程 复合材料 基因 遗传学 物理化学 催化作用 量子力学 光电子学 冶金
热门帖子
关注 科研通微信公众号,转发送积分 3572296
求助须知:如何正确求助?哪些是违规求助? 3142501
关于积分的说明 9448015
捐赠科研通 2843973
什么是DOI,文献DOI怎么找? 1563103
邀请新用户注册赠送积分活动 731630
科研通“疑难数据库(出版商)”最低求助积分说明 718640