Lower Limb Analysis Based on Surface Electromyography (sEMG) Using Different Time-frequency Representation Techniques

Mai Ramadan Ibraheem


Using time-frequency representation techniques, projecting 1D sEMG signals onto a 2D image space can help diagnose several muscle activities. The acquired sEMG signal can provide valuable representative information about the muscle activity firing rates during muscle contraction. Different phases of muscle activity can be discernible via the sEMG signals by extracting discriminating features. The behavior of muscle activity was acquired in measurements of five muscles, i.e., RF, BF, VM, ST, and FX. Previous attempts to visualize lower limb analysis to extract sEMG features adopted One-dimensional (1D) sEMG segments. This work proposes a comparative experiment between three time-frequency representation techniques. The three time-frequency representation techniques, scalogram, spectrogram, and persistence spectrum, were used to map muscles' (1D) sEMG signal straightening the knee. The two-dimensional (2D) projected images are then fed into a convolutional neural network (CNN) model for detecting knee abnormality. The experiments are performed via 10-fold cross-validation. The number of kernels is incremented along with model layers. The fully connected layers were adjusted according to the loss value. Besides, tuning the hyper-parameters of the dropout parameters and the ReLU activation function to verify optimal performance. This research shows that the scalogram image representation gives significantly better performance than the spectrogram and persistence spectrum in recognizing knee abnormality. In addition, this study may help in guiding the diagnosis of several human muscle activities via the sEMG signal. A more diverse of muscles can be further investigated and can be useful for future work to enhance the diagnosis accuracy.


sEMG; CWT; STFT; Scalogram; Spectrogram; Persistence spectrum; Lower Limb Analysis; muscle abnormality; time-frequency representations.

Full Text:



I. R. Mendo, et al. "Machine Learning in Medical Emergencies: a Systematic Review and Analysis,†Journal of medical systems, vol. 45., Aug. 2021, doi:10.1007/s10916-021-01762-3.

G. Ramos, et al. "Fatigue evaluation through machine learning and a global fatigue descriptor,†Journal of healthcare engineering, 2020.

E. Maleki, et al. "On the efficiency of machine learning for fatigue assessment of post-processed additively manufactured AlSi10Mg, " International Journal of Fatigue, vol. 160. 2022.

O.W. Samuel, et al. "Intelligent EMG pattern recognition control method for upper-limb multifunctional prostheses: advances, current challenges and future prospects," Ieee Access, pp. 10150-10165, July 2019.

S. Bhagwat and P. Mukherji, "Electromyogram (EMG) based fingers movement recognition using sparse filtering of wavelet packet coefficients,†SÄdhanÄ 45.1, pp. 1-11, 2020.

S. A. ElGhany, M. R. Ibraheem, M. Alruwaili and M. Elmogy, "Diagnosis of Various Skin Cancer Lesions Based on Fine-Tuned ResNet50 Deep Network," Computers, Materials & Continua, vol. 68, no. 1, pp. 117–135, 2021, doi:10.32604/cmc.2021.016102.

X. Zhang, Y. Wang and R. P. S. Han, "Wavelet transform theory and its application in EMG signal processing," Seventh International Conference on Fuzzy Systems and Knowledge Discovery, Aug. 2010, DOI: 10.1109/FSKD.2010.5569532.

N.Sairamya, L. Susmitha, S. George and M.Subathra, "Hybrid Approach for Classification of Electroencephalographic Signals Using Time–Frequency Images With Wavelets and Texture Features," Intelligent Data Analysis for Biomedical Applications, Academic Press, pp. 253-273, 2019.

S. Salcedo-Sanz, et al. "Persistence in complex systems," Physics Reports, vol. 957, pp. 1-73, 2022.

S. Jayalakshmy and G. F. Sudha, "Scalogram based prediction model for respiratory disorders using optimized convolutional neural networks," Artificial Intelligence in Medicine, vol. 103, pp. 101809, Mar. 2020, doi.org/10.1016/j.artmed.2020.101809.

F. Jing, C. Zhang, W. Si, Y. Wang and S. Jiao, "QFM Signals Parameters Estimation Based on Double Scale Two Dimensional Frequency Distribution," in IEEE Access, vol. 7, pp. 4496-4505, 2019, doi: 10.1109/ACCESS.2018.2888540.

C.Y. Lee and T. A. Le, "Identifying Faults of Rolling Element Based on Persistence Spectrum and Convolutional Neural Network With ResNet Structure," IEEE Access, vol. 9, pp. 78241–78252, 2021, DOI: 10.1109/ACCESS.2021.3083646.

B. Liu, Z. Zhangand R. Cui, "Efficient Time Series Augmentation Methods," 13th International Congress on Image and Signal Processing, BioMedical Engineering and Informatics (CISP-BMEI), Oct. 2020, DOI:10.1109/CISP-MEI51763.2020.9263602.

M. V. Balas and B. Agarwal, "Deep Learning Techniques for Biomedical and Health Informatics," 2020, doi.org/10.1016/C2018-0-04781-7.

N. Arizumi and T. Aksenova, "Fast Continuous Wavelet Transform for Brain Computer Interface using piecewise polynomials," 2019 IEEE International Symposium on Signal Processing and Information Technology (ISSPIT), 2019, pp. 1-6, doi: 10.1109/ISSPIT47144.2019.9001739.

M. S. Diab and S. A. Mahmoud, "Continuous Wavelet Transform OTA-C Band Pass Filter on Field Programmable Analog Arrays," 2020 Advances in Science and Engineering Technology International Conferences (ASET), 2020, pp. 1-5, doi: 10.1109/ASET48392.2020.9118234.

S. Jayalakshmy, L. Priya and G.Sudha, "Synthesis of respiratory signals using conditional generative adversarial networks from scalogram representation," Generative Adversarial Networks for Image-to-Image Translation, Academic Press, 2021,

F. Demir, et al. "Surface EMG signals and deep transfer learning-based physical action classification,†Neural Computing and Applications 31.12, pp. 8455-8462, 2019.

G. Sannino and G. D. Pietro, "A deep learning approach for ECG-based heartbeat classification for arrhythmia detection," Future Generation Computer Systems, vol. 86, pp. 446–455, Sep. 2018, doi.org/10.1016/j.future.2018.03.057.

G. Ruffini, D. Ibañez and M. Castellano, et al., "Deep Learning With EEG Spectrograms in Rapid Eye Movement Behavior Disorder," Frontiers in Neurology, vol. 10, Jul. 2019, doi.org/10.3389/fneur.2019.00806.

S. A. Singh and S. Majumder, " Short and noisy electrocardiogram classification based on deep learning," Deep Learning for Data Analytics, Academic Press, pp. 1-19, 2020.

Y.H. Byeon, S.B. Pan and K.C. Kwak, "Intelligent Deep Models Based on Scalograms of Electrocardiogram Signals for Biometrics," Sensors, vol. 19, no. 4, pp. 935, Feb. 2019, doi.org/10.3390/s19040935.

D. Jiang, et al. "Force estimation based on sEMG using wavelet analysis and neural network,†2019 9th International Conference on Information Science and Technology (ICIST). IEEE, 2019.

M. R. Ibraheem, J. adel, A. E. Balbaa, S. El-Sappagh, T. Abuhmed and M. Elmogy, "Timing and Classification of Patellofemoral Osteoarthritis Patients Using Fast Large Margin Classifier," Computers, Materials & Continua, vol. 67, no. 1, pp. 393–409, 2021, doi:10.32604/cmc.2021.014446.

B. Xu et al., "Wavelet Transform Time-Frequency Image and Convolutional Network-Based Motor Imagery EEG Classification," in IEEE Access, vol. 7, pp. 6084-6093, 2019, doi: 10.1109/ACCESS.2018.2889093.

R. S.Salles et al., "Visualization of Quality PerformanceParameters Using Wavelet Scalograms Images for Power Systems,†Congresso Brasileiro de Automática-CBA. Vol. 2. No. 1. 2020.

M.G. Kim, H. Ko and S. B. Pan, "A study on user recognition using 2D ECG based on ensemble of deep convolutional neural networks," Journal of Ambient Intelligence and Humanized Computing, vol. 11, no. 5, pp. 1859–1867, Jan. 2019, doi.org/10.1007/s12652-019-01195-4.

L. Nanni, A. Rigo, A. Lumini and S. Brahnam, "Spectrogram Classification Using Dissimilarity Space," Applied Sciences, vol. 10, no. 12, pp. 4176, Jun. 2020, doi.org/10.3390/app10124176.

N. Yahya, H. Musa, Z. Y. Ong and I. Elamvazuthi, "Classification of Motor Functions from Electroencephalogram (EEG) Signals Based on an Integrated Method Comprised of Common Spatial Pattern and Wavelet Transform Framework," Sensors, vol. 19, no. 22, pp. 4878, Nov. 2019, doi: 10.3390/s19224878.

C. N. Savithri and E. Priya. "Statistical analysis of EMG-based features for different hand movements,†Smart Intelligent Computing and Applications. Springer, Singapore, pp.71-79, 2019.

DOI: http://dx.doi.org/10.18517/ijaseit.13.1.16685


  • There are currently no refbacks.

Published by INSIGHT - Indonesian Society for Knowledge and Human Development