Can I read Agent Ai:surveying The Horizons Of Multimodal Interaction on EtoBox?

Agent Ai:surveying The Horizons Of Multimodal Interaction by Zane Durante, Qiuyuan Huang, Naoki Wake, Sung Park, Bidipta Sarkar, Rohan Taori, Yusuke Noda, Yejin Choi, Katsushi Ikeuchi, Hoi Vo, Li Fei-Fei, Jianfeng Gao is a nonfiction available to read on EtoBox.

What is Agent Ai:surveying The Horizons Of Multimodal Interaction about?

ABSTRACTMulti-modal AI systems will likely become a ubiquitous presence in our everyday lives. A promisingapproach to making these systems more interactive is to embody them as agents within physicaland virtual environments. At present, systems leverage existing foundation models as the basicbuilding blocks for the creation of embodied agents. Embedding agents within such environmentsfacilitates the ability of models to process and interpret visual and contextual data, which is criticalfor the creation of more sophisticated and context-aware AI systems. For example, a system that canperceive user actions, human behavior, environmental objects, audio expressions, and the collectivesentiment of a scene can be used to inform and direct agent responses within the given environment.To accelerate research on agent-based multimodal intelligence, we define “Agent AI” as a class ofinteractive systems that can perceive visual stimuli, language inputs, and other environmentallygrounded data, and can produce meaningful embodied actions. In particular, we explore systemsthat aim to improve agents based on next-embodied action prediction by incorporating externalknowledge, multi-sensory inputs,

Who reads Agent Ai:surveying The Horizons Of Multimodal Interaction?

Author

Zane Durante, Qiuyuan Huang, Naoki Wake, Sung Park, Bidipta Sarkar, Rohan Taori, Yusuke Noda, Yejin Choi, Katsushi Ikeuchi, Hoi Vo, Li Fei-Fei, Jianfeng Gao

Published

2025

Language

EN

Category

nonfiction

Subjects

Computer Science, Artificial Intelligence (Ai), Stem