Automated Autism Assessment With Multimodal Data and Ensemble Learning: A Scalable and Consistent Robot-Enhanced Therapy Framework

Navigating the complexities of Autism Spectrum Disorder (ASD) diagnosis and intervention requires a nuanced approach that addresses both the inherent variability in therapeutic practices and the imperative for scalable solutions. This paper presents a transformative Robot-Enhanced Therapy (RET) framework, leveraging an intricate amalgamation of an Adaptive Boosted 3D biomarker approach and Saliency Maps generated through Kernel Density Estimation. By seamlessly integrating these methodologies through majority voting, the framework pioneers a new frontier in automating the assessment of ASD levels and Autism Diagnostic Observation Schedule (ADOS) scores, offering unprecedented precision and efficiency. Drawing upon the rich tapestry of the DREAM Dataset, encompassing data from 61 children, this study meticulously crafts novel features derived from diverse modalities including body skeleton, head movement, and eye gaze data. Our 3D bio-marker approach achieves a remarkable predictive prowess, boasting a staggering 95.59% accuracy and an F1 score of 92.75% for ASD level prediction, alongside an RMSE of 1.78 and an R-squared value of 0.74 for ADOS score prediction. Furthermore, the introduction of a pioneering saliency map generation method, harnessing gaze data, further enhances predictive models, elevating ASD level prediction accuracy to an impressive 97.36%, with a corresponding F1 score of 95.56%. Beyond technical achievements, this study underscores RET’s transformative potential in reshaping ASD intervention paradigms, offering a promising alternative to Standard Human Therapy (SHT) by mitigating therapist variability and providing scalable therapeutic approaches. While acknowledging limitations in the research, such as sample constraints and model generalizability, our findings underscore RET’s capacity to revolutionize ASD management.