TY - JOUR
T1 - SSVEP-assisted RSVP brain-computer interface paradigm for multi-target classification
AU - Ko, Li-Wei
AU - Sandeep Vara Sankar, D.
AU - Huang, Yufei
AU - Lu, Yun Chen
AU - Shaw, Siddharth
AU - Jung, Tzyy Ping
N1 - Publisher Copyright:
© 2021 IOP Publishing Ltd.
PY - 2021/2
Y1 - 2021/2
N2 - Brain-computer Interface (BCI) is actively involved in optimizing the communication medium between the human brain and external devices.Objective. Rapid serial visual presentation (RSVP) is a robust and highly efficient BCI technique in recognizing target objects but suffers from limited target selections. Hybrid BCI systems that combine steady-state visual evoked potential (SSVEP) and RSVP can mitigate this limitation and allow users to operate on multiple targets. Approach. This study proposes a novel hybrid SSVEP-RSVP BCI to improve the performance of classifying the target/non-target objects in a multi-target scenario. In this paradigm, SSVEP stimulation helps in identifying the user's focus location and RSVP stimuli that elicit event-related potentials differentiate target and non-target objects. Main results. The proposed model achieved an offline accuracy of 81.59% by using 12 electroencephalography (EEG) channels and an online (real-time) accuracy of 78.10% when only four EEG channels are considered. Further, the biomarkers of physiological states are analyzed to assess the cognitive states (mental fatigue and user attention) of the participants based on resting theta and alpha band powers. The results indicate an inverse relationship between the BCI performance and the resting EEG power, validating that the subjects' performance is affected by physiological states for long-term use of the BCI. Significance. Our findings demonstrate that the combination of SSVEP and RSVP stimuli improves the BCI performance and further enhances the possibility of performing multiple user command tasks, which are inevitable in real-world applications. Additionally, the cognitive state biomarkers discussed imply the need for an efficient and attractive experimental paradigm that reduces the physiological state disparities and provide enhanced BCI performance.
AB - Brain-computer Interface (BCI) is actively involved in optimizing the communication medium between the human brain and external devices.Objective. Rapid serial visual presentation (RSVP) is a robust and highly efficient BCI technique in recognizing target objects but suffers from limited target selections. Hybrid BCI systems that combine steady-state visual evoked potential (SSVEP) and RSVP can mitigate this limitation and allow users to operate on multiple targets. Approach. This study proposes a novel hybrid SSVEP-RSVP BCI to improve the performance of classifying the target/non-target objects in a multi-target scenario. In this paradigm, SSVEP stimulation helps in identifying the user's focus location and RSVP stimuli that elicit event-related potentials differentiate target and non-target objects. Main results. The proposed model achieved an offline accuracy of 81.59% by using 12 electroencephalography (EEG) channels and an online (real-time) accuracy of 78.10% when only four EEG channels are considered. Further, the biomarkers of physiological states are analyzed to assess the cognitive states (mental fatigue and user attention) of the participants based on resting theta and alpha band powers. The results indicate an inverse relationship between the BCI performance and the resting EEG power, validating that the subjects' performance is affected by physiological states for long-term use of the BCI. Significance. Our findings demonstrate that the combination of SSVEP and RSVP stimuli improves the BCI performance and further enhances the possibility of performing multiple user command tasks, which are inevitable in real-world applications. Additionally, the cognitive state biomarkers discussed imply the need for an efficient and attractive experimental paradigm that reduces the physiological state disparities and provide enhanced BCI performance.
KW - electroencephalography
KW - brain-computer interface
KW - visual evoked potential
KW - event-related potential
KW - physiological biomarkers
KW - multiple targets
UR - http://www.scopus.com/inward/record.url?scp=85102931473&partnerID=8YFLogxK
U2 - 10.1088/1741-2552/abd1c0
DO - 10.1088/1741-2552/abd1c0
M3 - Article
C2 - 33291083
SN - 1741-2560
VL - 18
SP - 1
EP - 12
JO - Journal of Neural Engineering
JF - Journal of Neural Engineering
IS - 1
M1 - 016021
ER -