Authors :
Rameshwari Khamkar; Dr. Manisha Bharati
Volume/Issue :
Volume 11 - 2026, Issue 4 - April
Google Scholar :
https://tinyurl.com/6bjn7f5d
Scribd :
https://tinyurl.com/2nc9wa4n
DOI :
https://doi.org/10.38124/ijisrt/26apr1697
Note : A published paper may take 4-5 working days from the publication date to appear in PlumX Metrics, Semantic Scholar, and ResearchGate.
Abstract :
Sleep stage classification is pivotal in understanding sleep disorders and improving overall sleep quality.
Traditional approaches relying on single-modal data and conventional machine learning techniques fail to fully capture
intricate patterns across different sleep stages. This paper proposes a novel multi-modal sleep stage classification
framework utilizing Multi-Scale Masked Autoencoders (MSMAE) and Convolutional Neural Networks (CNNs) to enhance
accuracy and robustness. The system integrates EEG, EOG, and EMG signals to leverage complementary physiological
information. A two-stream encoder-decoder architecture processes and fuses these diverse data modalities: the MSMAE
encoder captures hierarchical and multi-scale features via masked auto-encoding, while the CNN-based decoder classifies
sleep stages including NREM and REM sleep. A Random Forest classifier further provides ensemble-based predictions.
The framework is evaluated against standard baselines using accuracy, sensitivity, specificity, and execution time.
Keywords :
Sleep Stage Classification; Multi-Modal Learning; MSMAE; Convolutional Neural Network; Polysomnography; EEG; EOG; EMG; Encoder-Decoder Architecture; Random Forest.
References :
- Karmakar, C. & Saha, S. (2021). "A Deep Learning Approach for Sleep Stage Classification Using EEG Signals: A Review." IEEE Reviews in Biomedical Engineering, 14, 342-354.
- Phan, T. & Kim, H. (2020). "Sleep Stage Classification Using Convolutional Neural Networks with EEG and EOG Signals." IEEE Access, 8, 150582-150592.
- Li, Y., Liu, Y. & Wu, J. (2019). "Multi-Modal Sleep Stage Classification Using Deep Learning Approaches: A Comprehensive Review." IEEE Trans. Neural Syst. Rehabil. Eng., 27(7), 1438-1450.
- Zhang, Z., Zhang, J. & Zhang, Y. (2021). "Comparative Study of Machine Learning Algorithms for Sleep Stage Classification Based on EEG Data." J. Biomedical Informatics, 115, 103688.
- Li, S., Yang, Y. & Chen, Z. (2021). "Hybrid Model for Sleep Stage Classification Using EEG and EOG Signals." [Conference Proceedings].
- Liu, Y., Zhang, Q. & Zhao, X. (2020). "Real-Time Sleep Stage Classification Using Hybrid Deep Learning Models." IEEE Trans. Biomed. Eng., 67(6), 1698-1708.
- Nguyen, T., Kim, S. & Park, J. (2019). "Sleep Stage Classification Using CNNs and RNNs." IEEE Trans. Biomed. Eng., 66(9), 2432-2441.
- Smith, J., Brown, R. & Lee, K. (2022). "A Comparative Study of Machine Learning Techniques for Sleep Stage Classification." Computers in Biology and Medicine, 142, 105124.
- Patel, R. & Mehta, A. (2023). "Multi-Modal Sleep Stage Classification Using Autoencoders and CNNs." IEEE Access, 11, 141278-141289.
- Johnson, M., Thompson, L. & Williams, T. (2021). "Transfer Learning for Sleep Stage Classification Using Pretrained Deep Learning Models." Neurocomputing, 456, 191-199.
- Wang, X. & Huang, C. (2020). "Feature Extraction and Classification of Sleep Stages Using Wavelet Transform and Deep Learning." IEEE Trans. Biomed. Eng., 67(12), 3370-3380.
- Gao, W. & Li, L. (2021). "Sleep Stage Classification with Hybrid Deep Learning Models." J. Healthcare Eng., 2021, 6697245.
- Zhou, Q. & Zhao, L. (2022). "A Survey on Sleep Stage Classification Using Machine Learning." Biomed. Signal Process. Control, 72, 103479.
- Chen, L. & Hu, J. (2022). "Deep Learning Models for Sleep Stage Classification: A Review." Neuroinformatics, 20(1), 45-63.
- Song, H. & Li, H. (2020). "Deep Learning Techniques for Sleep Stage Classification: A Review." Neurocomputing, 387, 1-14.
- Sharma, N. & Singh, R. (2022). "Improving Sleep Stage Classification Using Deep Learning Models with Hybrid Feature Extraction." Expert Syst. Appl., 192, 116160.
- Yu, S. & Zhang, T. (2021). "Exploring Autoencoder-Based Feature Learning for Sleep Stage Classification." IEEE Trans. Neural Networks Learn. Syst., 32(3), 1026-1036.
- Jiang, Z. & Zhang, J. (2019). "Deep Feature Learning for Sleep Stage Classification Based on Multimodal Data." IEEE Access, 7, 21727-21736.
- Li, X. & Wu, W. (2020). "Combination of CNNs and LSTMs for Sleep Stage Classification." IEEE Trans. Biomed. Eng., 67(2), 359-367.
- Kim, D. & Park, Y. (2021). "Automated Sleep Stage Scoring Using Deep Learning with PSG Data." J. Biomedical Informatics, 116, 103746.
- Supratak, A., Dong, H., Wu, C. & Guo, Y. (2017). "DeepSleepNet: A Model for Automatic Sleep Stage Scoring Based on Raw Single-Channel EEG." Deep Learning IEEE Transactions on Neural Systems and Rehabilitation Engineering, 25(11), 1998-2008.
- Chambon, S., Galtier, M., Arnal, P., Wainrib, G. & Gramfort, A. (2018). "A Deep Learning Architecture for Temporal Sleep Stage Classification Using Multivariate and Multimodal Time Series." IEEE Transactions on Neural Systems and Rehabilitation Engineering, 26(4), 758-769.
- Tsinalis, O., Matthews, P. & Guo, Y. (2016). "Automatic Sleep Stage Scoring Using Time-Frequency Analysis and Stacked Sparse Autoencoders." Annals of Biomedical Engineering, 44(5), 1587-1597.
- Biswal, S., Sun, H., Goparaju, B., Westover, M., Sun, J. & Bianchi, M. (2018). "SleepNet: Automated Sleep Staging System via Deep Learning." arXiv preprint arXiv:1707.08262.
- Mousavi, S., Afghah, F. & Acharya, U. (2019). "SleepEEGNet: Automated Sleep Stage Scoring with Sequence-to-Sequence Deep Learning Approach." PLoS ONE, 14(5), e0216456.
- Hassan, A. & Bhuiyan, M. (2016). "Automatic Sleep Scoring Using Statistical Features in the EMD Domain and Ensemble Methods." Biocybernetics and Biomedical Engineering, 36(1), 248-255.
- Sors, A., Bonnet, S., Mirek, S., Vercueil, L. & Payen, J. (2018). "A Convolutional Neural Network for Sleep Stage Scoring from Raw Single-Channel EEG." Biomedical Signal Processing and Control, 42, 107-114.
- Seo, H., Back, S., Lee, S. & Park, K. (2021). "Attention-Based Deep Neural Networks for Automatic Sleep Stage Classification." Sensors, 21(4), 1280.
- Perslev, M., Darkner, S., Kempfner, L., Nikolic, M., Jennum, P. & Igel, C. (2021). "U-Time: A Fully Convolutional Network for Time Series Segmentation Applied to Sleep Staging." Advances in Neural Information Processing Systems (NeurIPS), 34, 4417-4428.
- Eldele, E., Chen, Z., Liu, C., Wu, M., Kwoh, C., Li, X. & Guan, C. (2021). "An Attention-Based Deep Learning Approach for Sleep Stage Classification with Single-Channel EEG." IEEE Transactions on Neural Systems and Rehabilitation Engineering, 29, 809-818.
Sleep stage classification is pivotal in understanding sleep disorders and improving overall sleep quality.
Traditional approaches relying on single-modal data and conventional machine learning techniques fail to fully capture
intricate patterns across different sleep stages. This paper proposes a novel multi-modal sleep stage classification
framework utilizing Multi-Scale Masked Autoencoders (MSMAE) and Convolutional Neural Networks (CNNs) to enhance
accuracy and robustness. The system integrates EEG, EOG, and EMG signals to leverage complementary physiological
information. A two-stream encoder-decoder architecture processes and fuses these diverse data modalities: the MSMAE
encoder captures hierarchical and multi-scale features via masked auto-encoding, while the CNN-based decoder classifies
sleep stages including NREM and REM sleep. A Random Forest classifier further provides ensemble-based predictions.
The framework is evaluated against standard baselines using accuracy, sensitivity, specificity, and execution time.
Keywords :
Sleep Stage Classification; Multi-Modal Learning; MSMAE; Convolutional Neural Network; Polysomnography; EEG; EOG; EMG; Encoder-Decoder Architecture; Random Forest.