KMITL Expo 2026 LogoKMITL 66th Anniversary Logo

A Human-engaging Robotic Interactive Assistant

A Human-engaging Robotic Interactive Assistant

Abstract

The integration of intelligent robotic systems into human-centric environments, such as laboratories, hospitals, and educational institutions, has become increasingly important due to the growing demand for accessible and context-aware assistants. However, current solutions often lack scalability—for instance, relying on specialized personnel to repeatedly answer the same questions as administrators for specific departments—and adaptability to dynamic environments that require real-time situational responses. This study introduces a novel framework for an interactive robotic assistant (Beckerle et al. , 2017) designed to assist during laboratory tours and mitigate the challenges posed by limited human resources in providing comprehensive information to visitors. The proposed system operates through multiple modes, including standby mode and recognition mode, to ensure seamless interaction and adaptability in various contexts. In standby mode, the robot signals readiness with a smiling face animation while patrolling predefined paths or conserving energy when stationary. Advanced obstacle detection ensures safe navigation in dynamic environments. Recognition mode activates through gestures or wake words, using advanced computer vision and real-time speech recognition to identify users. Facial recognition further classifies individuals as known or unknown, providing personalized greetings or context-specific guidance to enhance user engagement. The proposed robot and its 3D design are shown in Figure 1. In interactive mode, the system integrates advanced technologies, including advanced speech recognition (ASR Whisper), natural language processing (NLP), and a large language model Ollama 3.2 (LLM Predictor, 2025), to provide a user-friendly, context-aware, and adaptable experience. Motivated by the need to engage students and promote interest in the RAI department, which receives over 1,000 visitors annually, it addresses accessibility gaps where human staff may be unavailable. With wake word detection, face and gesture recognition, and LiDAR-based obstacle detection, the robot ensures seamless communication in English, alongside safe and efficient navigation. The Retrieval-Augmented Generation (RAG) human interaction system communicates with the mobile robot, built on ROS1 Noetic, using the MQTT protocol over Ethernet. It publishes navigation goals to the move_base module in ROS, which autonomously handles navigation and obstacle avoidance. A diagram is explained in Figure 2. The framework includes a robust back-end architecture utilizing a combination of MongoDB for information storage and retrieval and a RAG mechanism (Thüs et al., 2024) to process program curriculum information in the form of PDFs. This ensures that the robot provides accurate and contextually relevant answers to user queries. Furthermore, the inclusion of smiling face animations and text-to-speech (TTS BotNoi) enhanced user engagement metrics were derived through a combination of observational studies and surveys, which highlighted significant improvements in user satisfaction and accessibility. This paper also discusses capability to operate in dynamic environments and human-centric spaces. For example, handling interruptions while navigating during a mission. The modular design allows for easy integration of additional features, such as gesture recognition and hardware upgrades, ensuring long-term scalability. However, limitations such as the need for high initial setup costs and dependency on specific hardware configurations are acknowledged. Future work will focus on enhancing the system’s adaptability to diverse languages, expanding its use cases, and exploring collaborative interactions between multiple robots. In conclusion, the proposed interactive robotic assistant represents a significant step forward in bridging the gap between human needs and technological advancements. By combining cutting-edge AI technologies with practical hardware solutions, this work offers a scalable, efficient, and user-friendly system that enhances accessibility and user engagement in human-centric spaces.

Objective

งานวิจัยนี้มีที่มาจาก ความต้องการที่เพิ่มขึ้นสำหรับผู้ช่วยอัจฉริยะ ใน สภาพแวดล้อมที่เน้นมนุษย์เป็นศูนย์กลาง เช่น ห้องปฏิบัติการและสถาบันการศึกษา ซึ่งเผชิญปัญหาเรื่อง ข้อจำกัดด้านทรัพยากรบุคคล ในการให้ข้อมูลแก่ผู้เยี่ยมชมและนักศึกษา ปัจจุบัน โซลูชันที่มีอยู่มัก ขาดความสามารถในการขยายขนาด และ ปรับตัวให้เข้ากับสภาพแวดล้อมที่เปลี่ยนแปลง ได้อย่างมีประสิทธิภาพ นอกจากนี้ ระบบผู้ช่วยแบบเดิมมักพึ่งพาบุคลากรเฉพาะทาง ทำให้เกิดภาระในการตอบคำถามซ้ำๆ และไม่สามารถรองรับจำนวนผู้ใช้ที่เพิ่มขึ้นได้ ดังนั้น งานวิจัยนี้จึงมุ่งพัฒนา ผู้ช่วยหุ่นยนต์เชิงโต้ตอบ ที่สามารถ ทำงานอัตโนมัติในสภาพแวดล้อมแบบไดนามิก โดยใช้ AI และโมเดลภาษาขนาดใหญ่ (LLM Predictor) ผสานกับ การรู้จำเสียง ท่าทาง และใบหน้า เพื่อเพิ่ม การมีส่วนร่วมของผู้ใช้ และ ความสามารถในการโต้ตอบ แบบเรียลไทม์ ระบบนี้ยังช่วยลดภาระของบุคลากรและเพิ่ม การเข้าถึงข้อมูล ได้อย่างแม่นยำและมีประสิทธิภาพ อีกทั้งยังรองรับการพัฒนาเพิ่มเติมเพื่อให้สามารถขยายขีดความสามารถและใช้งานได้หลากหลายขึ้นในอนาคต

Other Innovations

PRODUCTION OF PYROLYSIS OIL FROM LANDFILLED PLASTIC WASTES FOR UTILIZATION AS A RENEWABLE FUEL

คณะวิทยาศาสตร์

PRODUCTION OF PYROLYSIS OIL FROM LANDFILLED PLASTIC WASTES FOR UTILIZATION AS A RENEWABLE FUEL

The aim of experiment was to study the pyrolysis oil derived from sorted landfill plastic waste that had been buried for 15 years by the Nonthaburi Provincial Administrative Organization. The pyrolysis oil was produced using a Fixed-Bed Reactor at 450 °C for 1.5 hours with LPG as the feedstock, with the goal of using the pyrolysis oil as an alternative fuel. The experiment was conducted under four different conditions : (1) plastic waste buried in a landfill that has not been washed but has been reduced in size, (2) plastic waste buried in a landfill that has been washed and has been reduced in size, (3) plastic waste buried in a landfill that not has been washed and has not been reduced in size, (4) plastic waste buried in a landfill that has not been washed and has been reduced size, with activated carbon used as a catalyst. The experiment revealed that three products were produced : Oil, gas, and char in different quantity. The pyrolysis oil were compared in terms of quality based on pH, Heating value, Moisture content, Functional group, and Chemical Composition. The pyrolysis oil we obtained will be referenced according to the criteria from the Department of Energy Business. The analysis results of the pyrolysis can explain which conditions are suitable for replacing fuel oil in industrial It is therefore one of the approaches that helps manage plastic waste in landfills, reducing the quantity by converting it into usable energy.

Read more
Development of high protein Jasmin-rice coated with rice protein isolate

คณะอุตสาหกรรมอาหาร

Development of high protein Jasmin-rice coated with rice protein isolate

In the development of high protein jasmine rice products, hydrocolloids, HPMC at 0, 0.25, 0.5 and 1% w/v and MD at 10% w/v were used. This hydrocolloid contained 30% w/v dissolved protein and was coated with raw jasmine rice. It was found that different amounts of HPMC affected the adhesion of proteins in rice. Then, the hydrocolloid with the best adhesion, 0.25% w/v, was used to find the optimum amount for coating rice at ratios of 1:3 and 1:5, which affected protein content, texture, color, water retention and sensory acceptability.

Read more
Chillhouse with ChillGuys

คณะสถาปัตยกรรม ศิลปะและการออกแบบ

Chillhouse with ChillGuys

This project aims to study the load transfer in timber building structures by analyzing weight distribution across key structural components such as beams, columns, and floors, as well as the load-bearing behavior of wood under different conditions. The research incorporates structural calculations and modeling to examine load transfer patterns. Additionally, it enhances skills in design, analysis, and teamwork, providing practical knowledge applicable to real-world construction projects.

Read more