International Conference on Computer and Knowledge Engineering

Home / 14th International Conference on Computer and Knowledge Engineering

Automating Theory of Mind Assessment with a LLaMA-3-Powered Chatbot: Enhancing Faux Pas Detection in Autism

Authors :

Avisa Fallah¹ Ali Keramati² Mohammad Ali Nazari³ Fatemeh Sadat Mirfazeli⁴

1- School of Mathematics, Statistics and Computer Science, University of Tehran,Tehran, Iran 2- School of Electrical and Computer Engineering University of Tehran,Tehran, Iran 3- Department of Neuroscience, Advanced Technologies in Medicine, Iran University of Medical Sciences, Tehran, Iran 4- National Brain Centre, Iran University of Medical Sciences, Tehran, Iran

Keywords :

Large Language Models،Interactive Chatbot،Faux Pas Recognition Test،Chain-of-thought،Theory of Mind

Abstract :

The Theory of Mind (ToM) is critical for social interactions, enabling individuals to understand and predict others’ mental states. Deficits in ToM, particularly in detecting faux pas, are common among individuals with Autism Spectrum Disorder (ASD). Traditional methods for assessing ToM, such as the Faux Pas Recognition Test (FPRT), require significant human involvement, which can limit accessibility and scalability. This study aims to explore how large language model (LLM)-powered chatbots, specifically utilizing the LLaMA-3 model, can enhance the assessment of ToM by automating and improving the administration of the FPRT. The methodology involved creating a dual-phase process where the chatbot first assesses user responses and then provides rehabilitative guidance to correct misunderstandings. Additionally, the system employs a scoring mechanism combining automated evaluation with human oversight to ensure accuracy and consistency, with system prompts crafted based on chain-of-thought prompting to enhance the depth and reliability of the assessments. Our findings demonstrate the effectiveness of LLM-powered chatbots in delivering dynamic and supportive ToM assessments, suggesting its potential for broader application for both artificial intelligence and psychological practices.

Papers List

List of archived papers

Introducing E4MT and LMBNC: Persian pre-processing utilities

Zakieh Shakeri - Mehran Ziabary - Behrooz Vedadian - Fatemeh Azadi - Saeed Torabzadeh - Arian Atefi

Facial Emotion Recognition Under Mask Coverage Using a Data Augmentation Technique

Aref Farhadipour - Pouya Taghipour

Mitochondrial Segmentation in Microscopy Images Using UNet-VGG19

Zerek Sediq Hossein - Rojiar Pir Mohammadiani - Saadat Izadi

XAI for Transparent Autonomous Vehicles: A New Approach to Understanding Decision-Making in Self-driving Cars

Maryam Sadat Hosseini Azad - Amir Abbas Hamidi Imani - Shahriar Baradaran Shokouhi

Automated software design using Machine Learning With Natural Language Processing

Fahimeh Khedmatkon - Seyed Mohammad Hossein Hasheminejad - Jaleh Shoshtarian Malak

Enhancing Vehicle Make and Model Recognition with 3D Attention Modules

Narges Semiromizadeh - Omid Nejati Manzari - Shahriar B. Shokouhi - Sattar Mirzakuchaki

Weakly Supervised Learning in a Group of Learners with Communication

Ali Ganjbakhsh - Ahad Harati

AvashoG2P: A multi-module G2P Converter for Persian

Ali Moghadaszadeh - Fatemeh Pasban - Mohsen Mahmoudzadeh - Maryam Vatanparast - Amirmohammad Salehoof

A New Application of Machine Learning Based Methods for Disk Space Variation Fault Diagnosis in Transformer Windings

Reza Behkam - Amir Lotfi - Gevork B. Gharehpetian

Farsi Optical Character Recognition Using a Transformer-based Model

Fatemeh Asadi Zeydabadi - Elham Shabaninia - Hossein Nezamabadi-pour - Melika Shojaee

Samin Hamayesh - Version 41.7.6