KMITL Expo 2026 LogoKMITL 66th Anniversary Logo

A Human-engaging Robotic Interactive Assistant

A Human-engaging Robotic Interactive Assistant

Abstract

The integration of intelligent robotic systems into human-centric environments, such as laboratories, hospitals, and educational institutions, has become increasingly important due to the growing demand for accessible and context-aware assistants. However, current solutions often lack scalability—for instance, relying on specialized personnel to repeatedly answer the same questions as administrators for specific departments—and adaptability to dynamic environments that require real-time situational responses. This study introduces a novel framework for an interactive robotic assistant (Beckerle et al. , 2017) designed to assist during laboratory tours and mitigate the challenges posed by limited human resources in providing comprehensive information to visitors. The proposed system operates through multiple modes, including standby mode and recognition mode, to ensure seamless interaction and adaptability in various contexts. In standby mode, the robot signals readiness with a smiling face animation while patrolling predefined paths or conserving energy when stationary. Advanced obstacle detection ensures safe navigation in dynamic environments. Recognition mode activates through gestures or wake words, using advanced computer vision and real-time speech recognition to identify users. Facial recognition further classifies individuals as known or unknown, providing personalized greetings or context-specific guidance to enhance user engagement. The proposed robot and its 3D design are shown in Figure 1. In interactive mode, the system integrates advanced technologies, including advanced speech recognition (ASR Whisper), natural language processing (NLP), and a large language model Ollama 3.2 (LLM Predictor, 2025), to provide a user-friendly, context-aware, and adaptable experience. Motivated by the need to engage students and promote interest in the RAI department, which receives over 1,000 visitors annually, it addresses accessibility gaps where human staff may be unavailable. With wake word detection, face and gesture recognition, and LiDAR-based obstacle detection, the robot ensures seamless communication in English, alongside safe and efficient navigation. The Retrieval-Augmented Generation (RAG) human interaction system communicates with the mobile robot, built on ROS1 Noetic, using the MQTT protocol over Ethernet. It publishes navigation goals to the move_base module in ROS, which autonomously handles navigation and obstacle avoidance. A diagram is explained in Figure 2. The framework includes a robust back-end architecture utilizing a combination of MongoDB for information storage and retrieval and a RAG mechanism (Thüs et al., 2024) to process program curriculum information in the form of PDFs. This ensures that the robot provides accurate and contextually relevant answers to user queries. Furthermore, the inclusion of smiling face animations and text-to-speech (TTS BotNoi) enhanced user engagement metrics were derived through a combination of observational studies and surveys, which highlighted significant improvements in user satisfaction and accessibility. This paper also discusses capability to operate in dynamic environments and human-centric spaces. For example, handling interruptions while navigating during a mission. The modular design allows for easy integration of additional features, such as gesture recognition and hardware upgrades, ensuring long-term scalability. However, limitations such as the need for high initial setup costs and dependency on specific hardware configurations are acknowledged. Future work will focus on enhancing the system’s adaptability to diverse languages, expanding its use cases, and exploring collaborative interactions between multiple robots. In conclusion, the proposed interactive robotic assistant represents a significant step forward in bridging the gap between human needs and technological advancements. By combining cutting-edge AI technologies with practical hardware solutions, this work offers a scalable, efficient, and user-friendly system that enhances accessibility and user engagement in human-centric spaces.

Objective

งานวิจัยนี้มีที่มาจาก ความต้องการที่เพิ่มขึ้นสำหรับผู้ช่วยอัจฉริยะ ใน สภาพแวดล้อมที่เน้นมนุษย์เป็นศูนย์กลาง เช่น ห้องปฏิบัติการและสถาบันการศึกษา ซึ่งเผชิญปัญหาเรื่อง ข้อจำกัดด้านทรัพยากรบุคคล ในการให้ข้อมูลแก่ผู้เยี่ยมชมและนักศึกษา ปัจจุบัน โซลูชันที่มีอยู่มัก ขาดความสามารถในการขยายขนาด และ ปรับตัวให้เข้ากับสภาพแวดล้อมที่เปลี่ยนแปลง ได้อย่างมีประสิทธิภาพ นอกจากนี้ ระบบผู้ช่วยแบบเดิมมักพึ่งพาบุคลากรเฉพาะทาง ทำให้เกิดภาระในการตอบคำถามซ้ำๆ และไม่สามารถรองรับจำนวนผู้ใช้ที่เพิ่มขึ้นได้ ดังนั้น งานวิจัยนี้จึงมุ่งพัฒนา ผู้ช่วยหุ่นยนต์เชิงโต้ตอบ ที่สามารถ ทำงานอัตโนมัติในสภาพแวดล้อมแบบไดนามิก โดยใช้ AI และโมเดลภาษาขนาดใหญ่ (LLM Predictor) ผสานกับ การรู้จำเสียง ท่าทาง และใบหน้า เพื่อเพิ่ม การมีส่วนร่วมของผู้ใช้ และ ความสามารถในการโต้ตอบ แบบเรียลไทม์ ระบบนี้ยังช่วยลดภาระของบุคลากรและเพิ่ม การเข้าถึงข้อมูล ได้อย่างแม่นยำและมีประสิทธิภาพ อีกทั้งยังรองรับการพัฒนาเพิ่มเติมเพื่อให้สามารถขยายขีดความสามารถและใช้งานได้หลากหลายขึ้นในอนาคต

Other Innovations

Effect of Packaging Thickness on Corn Silage Quality

คณะเทคโนโลยีการเกษตร

Effect of Packaging Thickness on Corn Silage Quality

Climate change and the increasing unpredictability of environmental conditions have aggravated the shortage of animal feed crops during the dry season. This study examines effect of packaging thickness on the quality of corn silage during long-term storage, to maintain its nutritional value during feed shortages. The results show that packaging with thicknesses of 80, 120, 150, and 200 microns effectively maintain good physical quality, including odor, texture, color, and pH levels, during the 0–21day storage period. The silage had a fermented like fruit flavor or vinegar flavor, a silage texture, and well-preserved leaves and stems. Its color remained yellowish-green, with pH values between 3.7 and 4.7. Additionally, lactic acid analysis found that silage in 200-micron-thick packaging for 21 days had the highest lactic acid content (5.64%). However, there were no significant differences in the nutritional value of the silage across different packaging thicknesses

Read more
Intraspecific variations of dwarf whipray Brevitrygon heterura (Chondrichthyes: Dasyatidae) in the Gulf of Thailand.

คณะเทคโนโลยีการเกษตร

Intraspecific variations of dwarf whipray Brevitrygon heterura (Chondrichthyes: Dasyatidae) in the Gulf of Thailand.

Dwarf whipray (Brevitrygon heterura) is a common species found in a local market in the Gulf of Thailand. However, like many other species of stingrays, it is threatened by overfishing and habitat destruction. Therefore, an accurate species identification is crucial because conservation efforts may vary depending on the species. This study aims to understand morphological variation of B. heterura in the Gulf of Thailand by morphometric study and genetic analysis. During October 2022 and February 2023, we obtained 49 samples from research vessels fish landing ports and local fish markets. We observed two distinct groups based on 43 morphological variables/ratios. B. heterura samples from Chanthaburi, Rayong, Chonburi, Samut Sakhon, Nakhon Si Thammarat and Songkla provinces, called “group A," typically have longer snout length than those from Prachuap Khiri Khan provinces, called “group B" according to external morphological characters for species identification. Three morphological variables/ratios were significantly different between groups A and B. Main characters to explain intraspecific variations between group A and group B are further discussed. DNA barcoding based on a fragment of the cytochrome c oxidase subunit I (COI) gene were obtain from eight samples of group A and eight samples from group B. Pairwise percent sequence divergence (p-distance) for COI between group A and group B were 0.0-2.5. This study contributes to the understanding of variations of morphology and genetics of B. heterura in the Gulf of Thailand.

Read more
Website Design For Exploring Death and Historical Turning Points

คณะสถาปัตยกรรม ศิลปะและการออกแบบ

Website Design For Exploring Death and Historical Turning Points

When it comes to the general perception of death, it is often seen as something negative or inauspicious. However, the end or death of someone can sometimes be the beginning of change, influencing thoughts, lifestyles, and attitudes in a positive way for those around them. For students aged 13-18, accessing and understanding this topic remains a challenge. Most available information is often presented in complex forms that are difficult for young people to grasp. Moreover, teaching materials in schools often lack creativity and engagement, leading to a decline in students’ interest in this subject. To address this issue, a website has been designed as an accessible and creative resource. It aims to deepen young people's understanding of the impact of actions and the death of individuals on the world they live in, while inspiring them to become part of creating positive change for the future.

Read more