AR-fNIRS: Integrating a Functional Near-Infrared Sensing Module with Augmented Reality Glasses for Brain-State-Aware Interfaces
Disciplines
Bioimaging and Biomedical Optics | Biomedical | Hardware Systems | Other Computer Engineering | Signal Processing | Systems and Integrative Engineering
Abstract (300 words maximum)
Functional near-infrared spectroscopy (fNIRS) has gained increasing attention in biomedical research as a non-invasive tool for monitoring changes in blood oxygenation, particularly in the brain. Applications range from assessing stroke risk to identifying regions that may benefit from targeted cognitive training. More recently, fNIRS has also been explored in combination with augmented reality (AR) and brain-computer interfaces (BCIs), enabling systems that adapt to the user’s cognitive or attentional state.
In prior studies, researchers have primarily used electroencephalography (EEG), which measures the electrical changes in the brain, to predict user intention. Unfortunately, EEG signals are often prone to high fluctuation in frequency, reducing their reliability when used as a measuring device for a BCI. To address this limitation, our study proposes the use of an fNIRS attachment for AR glasses designed to detect user intention more accurately through changes in cerebral blood oxygenation. The system will employ a single-channel, as opposed to the multi-channel systems that have traditionally been used, to reduce size and increase accuracy. Our goal is to use this setup to create a fully functional BCI capable of transmitting the fNIRS data to an AR interface for controlling virtual environments.
By demonstrating that fNIRS can reliably detect user intention in real time, this project lays the groundwork for next-generation brain-aware AR systems. Such systems could enhance training, education, and accessibility by allowing interfaces to respond directly to the user’s cognitive goals.
Use of AI Disclaimer
no
Academic department under which the project should be listed
SPCEET – Electrical and Computer Engineering
Primary Investigator (PI) Name
Dr. Paul Lee
AR-fNIRS: Integrating a Functional Near-Infrared Sensing Module with Augmented Reality Glasses for Brain-State-Aware Interfaces
Functional near-infrared spectroscopy (fNIRS) has gained increasing attention in biomedical research as a non-invasive tool for monitoring changes in blood oxygenation, particularly in the brain. Applications range from assessing stroke risk to identifying regions that may benefit from targeted cognitive training. More recently, fNIRS has also been explored in combination with augmented reality (AR) and brain-computer interfaces (BCIs), enabling systems that adapt to the user’s cognitive or attentional state.
In prior studies, researchers have primarily used electroencephalography (EEG), which measures the electrical changes in the brain, to predict user intention. Unfortunately, EEG signals are often prone to high fluctuation in frequency, reducing their reliability when used as a measuring device for a BCI. To address this limitation, our study proposes the use of an fNIRS attachment for AR glasses designed to detect user intention more accurately through changes in cerebral blood oxygenation. The system will employ a single-channel, as opposed to the multi-channel systems that have traditionally been used, to reduce size and increase accuracy. Our goal is to use this setup to create a fully functional BCI capable of transmitting the fNIRS data to an AR interface for controlling virtual environments.
By demonstrating that fNIRS can reliably detect user intention in real time, this project lays the groundwork for next-generation brain-aware AR systems. Such systems could enhance training, education, and accessibility by allowing interfaces to respond directly to the user’s cognitive goals.