Skip to main content

Automated Video-based Epilepsy Seizure Classification and Sudden Unexpected Death in Epilepsy (SUDEP) Detection

Primary supervisor

David Dowe

Co-supervisors

  • Deval Mehta
  • Zongyuan Ge
  • Patrick Kwan
  • Shobi Sivathamboo

Develop, implement, and test deep learning techniques for automatic classification of epileptic seizures using video data of seizures

Student cohort

Double Semester

Aim/outline

People with epilepsy need assistance and are at risk of sudden death (SUDEP) when having convulsive seizures. Automated real-time seizure detection systems can help alert caregivers, but current automated methods for detection of seizures rely on Electroencephalography (EEG) and wearable sensors, which are not always tolerated by patients. Visual motion clues such as facial expression, hand joint stiffness, and body convolutions (pose) are natural semiology features which an epileptologist observes to detect epileptic seizures. Our goal is to breach this gap by developing a robust deep learning framework for detecting and classifying seizures based on the video data.

In collaboration with the Alfred Hospital, we will collect some pilot video dataset of patients experiencing different epileptic seizures. This project comprises two parts. The first milestone is to extract privacy-preserving relevant features from the videos such as body pose, face landmark joints, hand joints, and optical flow information using a local hardware device - e.g., Nvidia Jetson Xavier. This part will involve setting up some open-source available networks e.g. Openpose, RetinaFace, etc. on the Jetson board. The second and next goal is to develop deep learning methods for detecting and classifying seizures based on the privacy-preserved extracted data from the first step and also detecting SUDEP. This part will involve experimenting with CNNs, LSTMs, Transformers, etc.  A way of enhancing LSTMs while also improving explainability is given in Fang, Dowe, Peiris and Rosadi (2021).

URLs/references

Zheng Fang, David L. Dowe, Shelton Peiris and Dedi Rosadi (2021), "Minimum Message Length in Hybrid ARMA and LSTM Model Forecasting", Entropy 2021, 23(12), 1601; https://doi.org/10.3390/e23121601 (29 Nov 2021).

Required knowledge

Preferred skills:

Experience with Python, Pytorch;

Good knowledge about ubuntu operating system;

Knowledge about machine learning and deep learning

Preferred qualifications:

            Good programming skills;

            Good writing skills;

            WAM at least over 75+.