Automatic co-registration of MEG-MRI data using multiple RGB-D cameras

Shih Yen Lin*, Chin Han Cheng, Li Fen Chen, Yong-Sheng Chen

*Corresponding author for this work

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review


Integration of functional and structural modalities is essential to functional brain mapping. This paper presents an automatic co-registration system for aligning the coordinate systems between magnetoencephalography/electroencephalo-graphy (MEG/EEG) and magnetic resonance image (MRI) using multiple off-the-shelf RGBD cameras. The system was constructed by using multiple Kinects for Windows V2, which were calibrated for the integration of the captured data of subjects’ heads from multiple views. The integrated point clouds of the head surface captured by Kinects played an intermediate role between MEG/EEG and MRI. MEG/EEG-to-Kinect co-registration was conducted by using 3D locations of three anatomical landmarks, whereas Kinect-to-MRI co-registration was performed by using Gaussian mixture model to align facial part of points automatically segmented from both Kinect data and MRI. Combination of these two co-registration results yields the MEG/EEG-to-MRI transformation. Our evaluation results showed that the proposed system can achieve coordinate system alignment with high accuracy.

Original languageEnglish
Title of host publicationInternational Conference on Biomedical and Health Informatics - ICBHI 2015
EditorsYuan-Ting Zhang, Paulo Carvalho, Ratko Magjarevic
PublisherSpringer Verlag
Number of pages6
ISBN (Print)9789811045042
StatePublished - 1 Jan 2019
EventInternational Conference on Biomedical and Health Informatics, ICBHI 2015 - Haikou, China
Duration: 8 Oct 201510 Oct 2015

Publication series

NameIFMBE Proceedings
ISSN (Print)1680-0737


ConferenceInternational Conference on Biomedical and Health Informatics, ICBHI 2015


Dive into the research topics of 'Automatic co-registration of MEG-MRI data using multiple RGB-D cameras'. Together they form a unique fingerprint.

Cite this