亲爱的研友该休息了!由于当前在线用户较少,发布求助请尽量完整的填写文献信息,科研通机器人24小时在线,伴您度过漫漫科研夜!身体可是革命的本钱,早点休息,好梦!

Agent AI: Surveying the Horizons of Multimodal Interaction

具身认知 内含代理 计算机科学 人机交互 杠杆(统计) 自主代理人 过程(计算) 背景(考古学) 观点 人工智能 生物 操作系统 艺术 古生物学 视觉艺术
作者
Zane Durante,Qiuyuan Huang,Naoki Wake,Ran Gong,Jae Sung Park,Bidipta Sarkar,Rohan Taori,Yusuke Noda,Demetri Terzopoulos,Yejin Choi,Katsushi Ikeuchi,Hoi Vo,Li Fei-Fei,Jianfeng Gao
出处
期刊:Cornell University - arXiv 被引量:4
标识
DOI:10.48550/arxiv.2401.03568
摘要

Multi-modal AI systems will likely become a ubiquitous presence in our everyday lives. A promising approach to making these systems more interactive is to embody them as agents within physical and virtual environments. At present, systems leverage existing foundation models as the basic building blocks for the creation of embodied agents. Embedding agents within such environments facilitates the ability of models to process and interpret visual and contextual data, which is critical for the creation of more sophisticated and context-aware AI systems. For example, a system that can perceive user actions, human behavior, environmental objects, audio expressions, and the collective sentiment of a scene can be used to inform and direct agent responses within the given environment. To accelerate research on agent-based multimodal intelligence, we define "Agent AI" as a class of interactive systems that can perceive visual stimuli, language inputs, and other environmentally-grounded data, and can produce meaningful embodied actions. In particular, we explore systems that aim to improve agents based on next-embodied action prediction by incorporating external knowledge, multi-sensory inputs, and human feedback. We argue that by developing agentic AI systems in grounded environments, one can also mitigate the hallucinations of large foundation models and their tendency to generate environmentally incorrect outputs. The emerging field of Agent AI subsumes the broader embodied and agentic aspects of multimodal interactions. Beyond agents acting and interacting in the physical world, we envision a future where people can easily create any virtual reality or simulated scene and interact with agents embodied within the virtual environment.
最长约 10秒,即可获得该文献文件

科研通智能强力驱动
Strongly Powered by AbleSci AI
更新
大幅提高文件上传限制,最高150M (2024-4-1)

科研通是完全免费的文献互助平台,具备全网最快的应助速度,最高的求助完成率。 对每一个文献求助,科研通都将尽心尽力,给求助人一个满意的交代。
实时播报
orixero应助爱听歌笑寒采纳,获得10
8秒前
10秒前
13秒前
Aaaaaa瘾发布了新的文献求助10
15秒前
17秒前
怡然的友容完成签到 ,获得积分10
21秒前
朱朱子完成签到 ,获得积分10
23秒前
科研通AI2S应助晏紫苏采纳,获得10
29秒前
32秒前
阿尼亚发布了新的文献求助10
37秒前
s1lence完成签到,获得积分10
50秒前
哒哒哒完成签到 ,获得积分10
1分钟前
土豆泥拌土豆块完成签到 ,获得积分10
1分钟前
morena应助科研通管家采纳,获得20
1分钟前
Aaaaaa瘾发布了新的文献求助10
1分钟前
英俊的铭应助Aaaaaa瘾采纳,获得10
1分钟前
隐形曼青应助喵喵采纳,获得30
2分钟前
hm发布了新的文献求助10
2分钟前
Jennifer完成签到 ,获得积分10
2分钟前
hookie完成签到 ,获得积分10
2分钟前
绵绵完成签到 ,获得积分10
2分钟前
淡然语山发布了新的文献求助20
2分钟前
2分钟前
Aaaaaa瘾发布了新的文献求助10
2分钟前
科研通AI2S应助飘逸慕灵采纳,获得30
3分钟前
午见千山应助hm采纳,获得10
3分钟前
hm完成签到,获得积分20
3分钟前
Owen应助有热心愿意采纳,获得10
3分钟前
3分钟前
FashionBoy应助fleeper采纳,获得10
3分钟前
喵喵发布了新的文献求助30
3分钟前
喵喵完成签到,获得积分10
3分钟前
Tuesday完成签到 ,获得积分10
3分钟前
xuhanghang完成签到,获得积分10
4分钟前
香蕉觅云应助lbjcp3采纳,获得10
4分钟前
Easypass完成签到 ,获得积分10
4分钟前
4分钟前
4分钟前
fleeper发布了新的文献求助10
4分钟前
胡茶茶完成签到 ,获得积分10
4分钟前
高分求助中
The Oxford Handbook of Social Cognition (Second Edition, 2024) 1050
Kinetics of the Esterification Between 2-[(4-hydroxybutoxy)carbonyl] Benzoic Acid with 1,4-Butanediol: Tetrabutyl Orthotitanate as Catalyst 1000
The Young builders of New china : the visit of the delegation of the WFDY to the Chinese People's Republic 1000
Rechtsphilosophie 1000
Handbook of Qualitative Cross-Cultural Research Methods 600
Chen Hansheng: China’s Last Romantic Revolutionary 500
Mantiden: Faszinierende Lauerjäger Faszinierende Lauerjäger 500
热门求助领域 (近24小时)
化学 医学 生物 材料科学 工程类 有机化学 生物化学 物理 内科学 纳米技术 计算机科学 化学工程 复合材料 基因 遗传学 催化作用 物理化学 免疫学 量子力学 细胞生物学
热门帖子
关注 科研通微信公众号,转发送积分 3139548
求助须知:如何正确求助?哪些是违规求助? 2790430
关于积分的说明 7795241
捐赠科研通 2446905
什么是DOI,文献DOI怎么找? 1301468
科研通“疑难数据库(出版商)”最低求助积分说明 626238
版权声明 601146