cs.ROSep 21, 2026

LLM-based Conversational AI Knowledge Assistant for MyBuddy Humanoid Robot

Authors: Hanxiao Chen

Organizations: Department of Electric Engineering and Information Systems The University of Tokyo Tokyo, Japan

Abstract

Humanoid robots are increasingly being popular and developed for human-centered applications, yet their ability to provide intelligent conversations and natural interactive knowledge assistance remains constrained by traditional rule-based dialogue systems, pre-defined responses and limited knowledge repositories. Large language models (LLMs) have emerged as a powerful foundation for enabling natural, adaptive, and context-aware Human-Robot Interaction (HRI), which provides a significant opportunity to address such limitations by enabling robots to understand natural speech language, reason over complicated queries, maintain high-quality conversational context, and generate knowledge-rich responses. In this work, we originally present and implement an LLM-based versatile Conversational AI Knowledge Assistant for the Raspberry-Pi-powered 13-Axis MyBuddy humanoid robot, which integrates LLM-driven language understanding and AI reasoning with real-time speech recognition, knowledge retrieval via extensible access of internet engines (e.g., Wikipedia, arXiv), flexible dialogue management, and natural speech synthesis to enable much more intelligent multi-turn continuous conversations and advanced emotional-support Human-Robot Interaction.

Figures & tables

Explore similar work

CardsList
  1. Assistance Without Interruption: A Benchmark and LLM-based Framework for Non-Intrusive Human-Robot Assistance

    May 2, 2026Yuedi Zhang, Shuanghao Bai, Wanqi Zhou +4Human-Robot InteractionAssistant

  2. LLM-Powered Interactive Robotic Action Synthesis from Multimodal Speech, Gestures, and Music

    Jun 30, 2026Snehasis Banerjee, Ranjan DasguptaHuman-Robot Interaction

  3. A Conversational Framework for Human-Robot Collaborative Manipulation with Distributed Generative AI models

    Jun 4, 2026Arash Ghasemzadeh Kakroudi, Roel PietersHuman-Robot CollaborationRobotic Manipulation