⚠ Official Notice: www.ijisrt.com is the official website of the International Journal of Innovative Science and Research Technology (IJISRT) Journal for research paper submission and publication. Please beware of fake or duplicate websites using the IJISRT name.



Learning Sleep Stages from Multi-Modal Signals Using a Dual-Stream Encoder–Decoder Design


Authors : Rameshwari Khamkar; Dr. Manisha Bharati

Volume/Issue : Volume 11 - 2026, Issue 4 - April


Google Scholar : https://tinyurl.com/6bjn7f5d

Scribd : https://tinyurl.com/2nc9wa4n

DOI : https://doi.org/10.38124/ijisrt/26apr1697

Note : A published paper may take 4-5 working days from the publication date to appear in PlumX Metrics, Semantic Scholar, and ResearchGate.


Abstract : Sleep stage classification is pivotal in understanding sleep disorders and improving overall sleep quality. Traditional approaches relying on single-modal data and conventional machine learning techniques fail to fully capture intricate patterns across different sleep stages. This paper proposes a novel multi-modal sleep stage classification framework utilizing Multi-Scale Masked Autoencoders (MSMAE) and Convolutional Neural Networks (CNNs) to enhance accuracy and robustness. The system integrates EEG, EOG, and EMG signals to leverage complementary physiological information. A two-stream encoder-decoder architecture processes and fuses these diverse data modalities: the MSMAE encoder captures hierarchical and multi-scale features via masked auto-encoding, while the CNN-based decoder classifies sleep stages including NREM and REM sleep. A Random Forest classifier further provides ensemble-based predictions. The framework is evaluated against standard baselines using accuracy, sensitivity, specificity, and execution time.

Keywords : Sleep Stage Classification; Multi-Modal Learning; MSMAE; Convolutional Neural Network; Polysomnography; EEG; EOG; EMG; Encoder-Decoder Architecture; Random Forest.

References :

  1. Karmakar, C. & Saha, S. (2021). "A Deep Learning Approach for Sleep Stage Classification Using EEG Signals: A Review." IEEE Reviews in Biomedical Engineering, 14, 342-354.
  2. Phan, T. & Kim, H. (2020). "Sleep Stage Classification Using Convolutional Neural Networks with EEG and EOG Signals." IEEE Access, 8, 150582-150592.
  3. Li, Y., Liu, Y. & Wu, J. (2019). "Multi-Modal Sleep Stage Classification Using Deep Learning Approaches: A Comprehensive Review." IEEE Trans. Neural Syst. Rehabil. Eng., 27(7), 1438-1450.
  4. Zhang, Z., Zhang, J. & Zhang, Y. (2021). "Comparative Study of Machine Learning Algorithms for Sleep Stage Classification Based on EEG Data." J. Biomedical Informatics, 115, 103688.
  5. Li, S., Yang, Y. & Chen, Z. (2021). "Hybrid Model for Sleep Stage Classification Using EEG and EOG Signals." [Conference Proceedings].
  6. Liu, Y., Zhang, Q. & Zhao, X. (2020). "Real-Time Sleep Stage Classification Using Hybrid Deep Learning Models." IEEE Trans. Biomed. Eng., 67(6), 1698-1708.
  7. Nguyen, T., Kim, S. & Park, J. (2019). "Sleep Stage Classification Using CNNs and RNNs." IEEE Trans. Biomed. Eng., 66(9), 2432-2441.
  8. Smith, J., Brown, R. & Lee, K. (2022). "A Comparative Study of Machine Learning Techniques for Sleep Stage Classification." Computers in Biology and Medicine, 142, 105124.
  9. Patel, R. & Mehta, A. (2023). "Multi-Modal Sleep Stage Classification Using Autoencoders and CNNs." IEEE Access, 11, 141278-141289.
  10. Johnson, M., Thompson, L. & Williams, T. (2021). "Transfer Learning for Sleep Stage Classification Using Pretrained Deep Learning Models." Neurocomputing, 456, 191-199.
  11. Wang, X. & Huang, C. (2020). "Feature Extraction and Classification of Sleep Stages Using Wavelet Transform and Deep Learning." IEEE Trans. Biomed. Eng., 67(12), 3370-3380.
  12. Gao, W. & Li, L. (2021). "Sleep Stage Classification with Hybrid Deep Learning Models." J. Healthcare Eng., 2021, 6697245.
  13. Zhou, Q. & Zhao, L. (2022). "A Survey on Sleep Stage Classification Using Machine Learning." Biomed. Signal Process. Control, 72, 103479.
  14. Chen, L. & Hu, J. (2022). "Deep Learning Models for Sleep Stage Classification: A Review." Neuroinformatics, 20(1), 45-63.
  15. Song, H. & Li, H. (2020). "Deep Learning Techniques for Sleep Stage Classification: A Review." Neurocomputing, 387, 1-14.
  16. Sharma, N. & Singh, R. (2022). "Improving Sleep Stage Classification Using Deep Learning Models with Hybrid Feature Extraction." Expert Syst. Appl., 192, 116160.
  17. Yu, S. & Zhang, T. (2021). "Exploring Autoencoder-Based Feature Learning for Sleep Stage Classification." IEEE Trans. Neural Networks Learn. Syst., 32(3), 1026-1036.
  18. Jiang, Z. & Zhang, J. (2019). "Deep Feature Learning for Sleep Stage Classification Based on Multimodal Data." IEEE Access, 7, 21727-21736.
  19. Li, X. & Wu, W. (2020). "Combination of CNNs and LSTMs for Sleep Stage Classification." IEEE Trans. Biomed. Eng., 67(2), 359-367.
  20. Kim, D. & Park, Y. (2021). "Automated Sleep Stage Scoring Using Deep Learning with PSG Data." J. Biomedical Informatics, 116, 103746.
  21. Supratak, A., Dong, H., Wu, C. & Guo, Y. (2017). "DeepSleepNet: A Model for Automatic Sleep Stage Scoring Based on Raw Single-Channel EEG." Deep Learning IEEE Transactions on Neural Systems and Rehabilitation Engineering, 25(11), 1998-2008.
  22. Chambon, S., Galtier, M., Arnal, P., Wainrib, G. & Gramfort, A. (2018). "A Deep Learning Architecture for Temporal Sleep Stage Classification Using Multivariate and Multimodal Time Series." IEEE Transactions on Neural Systems and Rehabilitation Engineering, 26(4), 758-769.
  23. Tsinalis, O., Matthews, P. & Guo, Y. (2016). "Automatic Sleep Stage Scoring Using Time-Frequency Analysis and Stacked Sparse Autoencoders." Annals of Biomedical Engineering, 44(5), 1587-1597.
  24. Biswal, S., Sun, H., Goparaju, B., Westover, M., Sun, J. & Bianchi, M. (2018). "SleepNet: Automated Sleep Staging System via Deep Learning." arXiv preprint arXiv:1707.08262.
  25. Mousavi, S., Afghah, F. & Acharya, U. (2019). "SleepEEGNet: Automated Sleep Stage Scoring with Sequence-to-Sequence Deep Learning Approach." PLoS ONE, 14(5), e0216456.
  26. Hassan, A. & Bhuiyan, M. (2016). "Automatic Sleep Scoring Using Statistical Features in the EMD Domain and Ensemble Methods." Biocybernetics and Biomedical Engineering, 36(1), 248-255.
  27. Sors, A., Bonnet, S., Mirek, S., Vercueil, L. & Payen, J. (2018). "A Convolutional Neural Network for Sleep Stage Scoring from Raw Single-Channel EEG." Biomedical Signal Processing and Control, 42, 107-114.
  28. Seo, H., Back, S., Lee, S. & Park, K. (2021). "Attention-Based Deep Neural Networks for Automatic Sleep Stage Classification." Sensors, 21(4), 1280.
  29. Perslev, M., Darkner, S., Kempfner, L., Nikolic, M., Jennum, P. & Igel, C. (2021). "U-Time: A Fully Convolutional Network for Time Series Segmentation Applied to Sleep Staging." Advances in Neural Information Processing Systems (NeurIPS), 34, 4417-4428.
  30. Eldele, E., Chen, Z., Liu, C., Wu, M., Kwoh, C., Li, X. & Guan, C. (2021). "An Attention-Based Deep Learning Approach for Sleep Stage Classification with Single-Channel EEG." IEEE Transactions on Neural Systems and Rehabilitation Engineering, 29, 809-818.

Sleep stage classification is pivotal in understanding sleep disorders and improving overall sleep quality. Traditional approaches relying on single-modal data and conventional machine learning techniques fail to fully capture intricate patterns across different sleep stages. This paper proposes a novel multi-modal sleep stage classification framework utilizing Multi-Scale Masked Autoencoders (MSMAE) and Convolutional Neural Networks (CNNs) to enhance accuracy and robustness. The system integrates EEG, EOG, and EMG signals to leverage complementary physiological information. A two-stream encoder-decoder architecture processes and fuses these diverse data modalities: the MSMAE encoder captures hierarchical and multi-scale features via masked auto-encoding, while the CNN-based decoder classifies sleep stages including NREM and REM sleep. A Random Forest classifier further provides ensemble-based predictions. The framework is evaluated against standard baselines using accuracy, sensitivity, specificity, and execution time.

Keywords : Sleep Stage Classification; Multi-Modal Learning; MSMAE; Convolutional Neural Network; Polysomnography; EEG; EOG; EMG; Encoder-Decoder Architecture; Random Forest.

Paper Submission Last Date
31 - May - 2026

SUBMIT YOUR PAPER CALL FOR PAPERS
Video Explanation for Published paper

Never miss an update from Papermashup

Get notified about the latest tutorials and downloads.

Subscribe by Email

Get alerts directly into your inbox after each post and stay updated.
Subscribe
OR

Subscribe by RSS

Add our RSS to your feedreader to get regular updates from us.
Subscribe