Detecting Cognitive Decline Using a Novel Doodle-Based Neural Network

Research output: Chapter in Book/Report/Conference proceedingConference contribution

3 Downloads (Pure)

Abstract

A key part in the diagnosis of cognitive decline are visuospatial based tests. These visuospatial tests often involve a form of drawing task. In this paper, we build an automated multiclass classifier to assign hand-drawn doodles from Google’s online game Quick, Draw! into 24 unique categories that are simple to draw doodles. Our goal is to create a prototype of an automated online diagnosis tool that resembles the visuospatial portion of established pen and paper cognitive examinations. We built a CNN using the Tensor Flow Keras API, and tested multiple iterations of each model neuron structure. We created a web interface able to capture user inputs from a browser window as they draw the requested doodle for each test stage. The images are relayed back to a server and processed through the same model trained on the Google QuickDraw! dataset to determine a patient’s score. Herein we use these model predictions as a measurement of the users drawing skills. Using a CNN based neural network we achieved a 90.46% model accuracy and around 70% implementation accuracy which is not dissimilar to human pen and paper ratings.
Original languageEnglish
Title of host publication2022 IEEE International Workshop on Metrology for Extended Reality, Artificial Intelligence and Neural Engineering, MetroXRAINE 2022 - Proceedings
PublisherThe Institute of Electrical and Electronics Engineers (IEEE)
Pages99-103
Number of pages5
ISBN (Electronic)9781665485746
DOIs
Publication statusPublished - 5 Dec 2022
Event2022 IEEE International Workshop on Metrology for eXtended Reality, Artificial Intelligence and Neural Engineering - Rome, Italy
Duration: 26 Oct 202228 Oct 2022

Publication series

Name2022 IEEE International Workshop on Metrology for Extended Reality, Artificial Intelligence and Neural Engineering, MetroXRAINE 2022 - Proceedings

Conference

Conference2022 IEEE International Workshop on Metrology for eXtended Reality, Artificial Intelligence and Neural Engineering
Abbreviated titleIEEE MetroXRAINE 2022
Country/TerritoryItaly
CityRome
Period26/10/2228/10/22

Cite this