Real-time and accurate meal detection for meal-assisting robots

餐食 机器人 食品科学 计算机科学 人工智能 化学
作者
Yuhe Fan,Lixun Zhang,Canxing Zheng,Yunqin Zu,Xingyuan Wang,Jinghui Zhu
出处
期刊:Journal of Food Engineering [Elsevier]
卷期号:: 111996-111996 被引量:4
标识
DOI:10.1016/j.jfoodeng.2024.111996
摘要

Meal detection is an important technology to ensure success rate of meal-assisting robotics. However, due to the strong interclass similarity and intraclass variability presented by appearance, gesture, and complex traits of meals in different scenarios, it is more challenging to real-time and accurate detect meals. To address the above problems, a novel method based on deformable convolution and CloFormer (CF) transformer to optimize the YOLOv8s was proposed to achieve efficient and accurate detection for meal. The YOLOv8s model architecture was enhanced by introducing deformable convolution to capture finer-grained spatial information, and the CloFormer module was introduced to capture high-frequency local and low-frequency global information through shared weights and context-aware weights, we notated it as DCF-YOLOv8s. The proposed method was evaluated on meal datasets, which were evaluated separately with baseline model and several state-of-the-art (SOTA) detection models, and results show that the proposed method achieves better performance. Specifically, the proposed method can achieve 88.5% mean average accuracy (mAP) at 43.6 frames per second (FPS), validating its efficiency and accuracy in meal detection for meal-assisting robotics. The effectiveness of introducing deformable convolution and CloFormer modules was verified by ablation experiments, and validating the importance of adopting data augmentation methods. The method proposed in this paper can improve success rate of meal fetching by intelligent meal-assisting robots and also contribute to the development of the field of food engineering to monitor the quality of meals and food management.

科研通智能强力驱动
Strongly Powered by AbleSci AI
科研通是完全免费的文献互助平台,具备全网最快的应助速度,最高的求助完成率。 对每一个文献求助,科研通都将尽心尽力,给求助人一个满意的交代。
实时播报
然来溪完成签到 ,获得积分10
2秒前
仇敌克星完成签到,获得积分10
3秒前
龄仔仔完成签到 ,获得积分10
6秒前
过时的广山完成签到 ,获得积分10
7秒前
秋风之墩完成签到,获得积分10
8秒前
风里等你完成签到,获得积分10
8秒前
和谐诗双完成签到 ,获得积分10
11秒前
Astra完成签到,获得积分10
11秒前
邓大瓜完成签到,获得积分10
11秒前
健忘的晓小完成签到 ,获得积分10
12秒前
13秒前
芬芬完成签到 ,获得积分10
13秒前
13秒前
Loey完成签到,获得积分10
15秒前
AskNature完成签到,获得积分10
15秒前
DrPika完成签到,获得积分10
16秒前
倪小呆完成签到 ,获得积分10
17秒前
科研路上互帮互助,共同进步完成签到 ,获得积分10
17秒前
量子星尘发布了新的文献求助10
18秒前
spicyfish完成签到,获得积分10
20秒前
HopeLee完成签到,获得积分10
20秒前
llllliu发布了新的文献求助10
22秒前
认真的珠完成签到 ,获得积分10
22秒前
宝玉完成签到 ,获得积分10
22秒前
顺利的慕儿完成签到 ,获得积分10
24秒前
留猪完成签到,获得积分10
25秒前
含糊的无声完成签到 ,获得积分10
25秒前
量子星尘发布了新的文献求助10
27秒前
萨尔莫斯完成签到,获得积分10
27秒前
29秒前
29秒前
阿连发布了新的文献求助10
29秒前
zm完成签到 ,获得积分10
36秒前
英勇雅琴完成签到 ,获得积分10
40秒前
王kk完成签到 ,获得积分10
41秒前
Jerry完成签到,获得积分10
41秒前
sora完成签到,获得积分10
43秒前
pucca完成签到 ,获得积分10
45秒前
lenne完成签到,获得积分10
45秒前
ww完成签到 ,获得积分10
45秒前
高分求助中
(应助此贴封号)【重要!!请各用户(尤其是新用户)详细阅读】【科研通的精品贴汇总】 10000
Encyclopedia of Quaternary Science Reference Third edition 6000
Encyclopedia of Forensic and Legal Medicine Third Edition 5000
Introduction to strong mixing conditions volume 1-3 5000
Aerospace Engineering Education During the First Century of Flight 3000
Electron Energy Loss Spectroscopy 1500
Tip-in balloon grenadoplasty for uncrossable chronic total occlusions 1000
热门求助领域 (近24小时)
化学 材料科学 生物 医学 工程类 计算机科学 有机化学 物理 生物化学 纳米技术 复合材料 内科学 化学工程 人工智能 催化作用 遗传学 数学 基因 量子力学 物理化学
热门帖子
关注 科研通微信公众号,转发送积分 5789382
求助须知:如何正确求助?哪些是违规求助? 5718918
关于积分的说明 15474506
捐赠科研通 4917200
什么是DOI,文献DOI怎么找? 2646840
邀请新用户注册赠送积分活动 1594493
关于科研通互助平台的介绍 1548982