International Conference on Computer and Knowledge Engineering

Home / 14th International Conference on Computer and Knowledge Engineering

Automating Theory of Mind Assessment with a LLaMA-3-Powered Chatbot: Enhancing Faux Pas Detection in Autism

Authors :

Avisa Fallah¹ Ali Keramati² Mohammad Ali Nazari³ Fatemeh Sadat Mirfazeli⁴

1- School of Mathematics, Statistics and Computer Science, University of Tehran,Tehran, Iran 2- School of Electrical and Computer Engineering University of Tehran,Tehran, Iran 3- Department of Neuroscience, Advanced Technologies in Medicine, Iran University of Medical Sciences, Tehran, Iran 4- National Brain Centre, Iran University of Medical Sciences, Tehran, Iran

Keywords :

Large Language Models،Interactive Chatbot،Faux Pas Recognition Test،Chain-of-thought،Theory of Mind

Abstract :

The Theory of Mind (ToM) is critical for social interactions, enabling individuals to understand and predict others’ mental states. Deficits in ToM, particularly in detecting faux pas, are common among individuals with Autism Spectrum Disorder (ASD). Traditional methods for assessing ToM, such as the Faux Pas Recognition Test (FPRT), require significant human involvement, which can limit accessibility and scalability. This study aims to explore how large language model (LLM)-powered chatbots, specifically utilizing the LLaMA-3 model, can enhance the assessment of ToM by automating and improving the administration of the FPRT. The methodology involved creating a dual-phase process where the chatbot first assesses user responses and then provides rehabilitative guidance to correct misunderstandings. Additionally, the system employs a scoring mechanism combining automated evaluation with human oversight to ensure accuracy and consistency, with system prompts crafted based on chain-of-thought prompting to enhance the depth and reliability of the assessments. Our findings demonstrate the effectiveness of LLM-powered chatbots in delivering dynamic and supportive ToM assessments, suggesting its potential for broader application for both artificial intelligence and psychological practices.

Papers List

List of archived papers

Cardiology Disease Diagnosis by Analyzing Histological Microscopic Images Using Deep Learning

Maria Salehpanah - Jafar Tanha - Zahra Jafari - SeyedEhsan Roshan - Sajad Rezaei

Android Malware Detection using Supervised Deep Graph Representation Learning

Fatemeh Deldar - Mahdi Abadi - Mohammad Ebrahimifard

Plant Disease Detection Using Dynamic Knowledge Distillation and Attention Mechanism

Mohammad Ghasemi Arian - Mohammad Hossein Yaghmaee Moghaddam

Advancing Brain Tumor Detection via ViRCNN: A Fusion of Vision Transformers and Faster R-CNN

Mehrshad Momen-Tayefeh - S. AmirAli GH. Ghahramani - Ali Mohammad Afshin Hemmatyar

Mitochondrial Segmentation in Microscopy Images Using UNet-VGG19

Zerek Sediq Hossein - Rojiar Pir Mohammadiani - Saadat Izadi

Enhanced Hate Speech Detection Using Focal Loss and Multi-Head Attention for Imbalanced Social Media Text

Ali Rezazadeh - Hadi Shahriar Shahhoseini

FAST: FPGA Acceleration of Neural Networks Training

Alireza Borhani - Mohammad Hossein Goharinejad - Hamid Reza Zarandi

A Framework for Automated Cardiovascular Magnetic Resonance Image Quality Scoring based on EuroCMR Registry Criteria

Shahabedin Nabavi - Mohsen Ebrahimi Moghaddam - Ahmad Ali Abin - Alejandro Frangi

An Effective Connectomics Approach for Diagnosing ADHD using Eyes-open Resting-state MEG

Nastaran Hamedi - Ali Khadem - Sajjad Vardast - Mehdi Delrobaei - Abbas Babajani-Feremi

A parallel CNN-BiGRU network for short-term load forecasting in demand-side management

Arghavan Irankhah - Sahar Rezazadeh Saatlou - Mohammad Hossein Yaghmaee - Sara Ershadi-Nasab - Mohammad Alishahi