Communication Modality

Communication modality research explores how information is exchanged between agents, encompassing various channels like speech, gestures, and text, and investigates how these modalities influence interaction effectiveness and user experience. Current research focuses on optimizing communication in human-computer interaction (HCI), particularly for assistive technologies and multi-agent systems, often employing machine learning models like transformers and graph neural networks to enhance prediction and understanding. This field is crucial for improving accessibility, designing more natural and intuitive human-robot interactions, and advancing our understanding of human communication itself, with implications for fields ranging from assistive technology to collaborative robotics.