Time-Distributed Attention Network for EEG-Based Motor Imagery Decoding From the Same Limb

• Main Authors: Xuelin Ma (Author), Shuang Qiu (Author), Huiguang He (Author)
• Format: Book
• Published: IEEE, 2022-01-01T00:00:00Z.
• Subjects: article
• Online Access: Connect to this object online.
• Notes: 1558-0210; 10.1109/TNSRE.2022.3154369
• Keywords: Attention mechanism; electroencephalography (EEG); fine motor imagery; same limb; Medical technology; R855-855.5; Therapeutics. Pharmacology; RM1-950
• Source: IEEE Transactions on Neural Systems and Rehabilitation Engineering, Vol 30, Pp 496-508 (2022)

A brain-computer interface (BCI) based on motor imagery (MI) from the same limb can provide an intuitive control pathway but has received limited attention. It is still a challenge to classify multiple MI tasks from the same limb. The goal of this study is to propose a novel decoding method to classify the MI tasks of four joints of the same upper limb and the resting state. EEG signals were collected from 20 participants. A time-distributed attention network (TD-Atten) was proposed to adaptively assign different weights to different classes and frequency bands of the input multiband Common Spatial Pattern (CSP) features. The long short-term memory (LSTM) and dense layers were then used to learn sequential information from the reweight features and perform the classification. Our proposed method outperformed other baseline and deep learning-based methods and obtained the accuracies of 46.8% in the 5-class scenario and 53.4% in the 4-class scenario. The visualization results of attention weights indicated that the proposed framework can adaptively pay attention to alpha-band related features in MI tasks, which was consistent with the analysis of brain activation patterns. These results demonstrated the feasibility and interpretability of the attention mechanism in MI decoding and the potential of this fine MI paradigm to be applied for the control of a robotic arm or a neural prosthesis.