BCI Meeting 2005--workshop on clinical issues and applications.

This paper describes the outcome of discussions held during the Third International BCI Meeting at a workshop charged with reviewing and evaluating the current state of and issues relevant to brain-computer interface (BCI) clinical applications. These include potential BCI users, applications, validation, getting BCIs to users, role of government and industry, plasticity, and ethics.     

BCI Meeting 2005--workshop on BCI signal processing: feature extraction and translation.

This paper describes the outcome of discussions held during the Third International BCI Meeting at a workshop charged with reviewing and evaluating the current state of and issues relevant to brain-computer interface (BCI) feature extraction and translation. The issues discussed include a taxonomy of methods and applications, time-frequency spatial analysis, optimization schemes, the role of insight in analysis, adaptation, and methods for quantifying BCI feedback.     

BCI meeting 2005--workshop on technology: hardware and software.

This paper describes the outcome of discussions held during the Third International BCI Meeting at a workshop to review and evaluate the current state of BCI-related hardware and software. Technical requirements and current technologies, standardization procedures and future trends are covered. The main conclusion was recognition of the need to focus technical requirements on the users' needs and the need for consistent standards in BCI research.     

基于视听交互刺激的认知机理与脑机接口范式研究进展

与人类视听觉感知密切相关的图像、语音和文本(语言)信息在社会经济发展与国家安全保障等领域中扮演着重要角色,脑机接口(BCI)是无需外围神经肌肉便可操控外部设备、使"思想"直接变成"行动"的创新技术,基于视、听觉刺激的BCI系统具有极其广阔应用前景。目前认知心理学研究普遍认为视听交互刺激模式可产生比视或听单模态刺激更强的事件相关电位信号,因而可使识别大脑思维模式的正确率更高和响应速度更快,然而BCI研究至今尚难有充分验证其优势的成果。分别从认知心理机制和BCI实验范式两方面综述了视听交互刺激的信息整合机制、视听刺激之间的协同与竞争关系、匹配度对刺激效果的影响及相关BCI实验范式的研究现状;深入分析了视听交互刺激范式未在现有BCI系统中体现其优越性的原因;最后从BCI实验范式选择、系统硬件性能改进、脑电信号处理等方面提出了改进思路并展望了基于视听交互刺激BCI范式研究未来动向。     

Multi‐command SSAEP‐based BCI system with training sessions for SSVEP during an eye fatigue state

This paper proposes a steady‐state auditory stimulus modality and a detection algorithm to replace steady‐state visual evoked potential (SSVEP )‐based brain–computer interface (BCI ) systems during visual fatigue periods. The optimal speaker position for the steady‐state auditory evoked potential (SSAEP )‐based BCI system and possible electrode positions are investigated. Using the proposed system, an accuracy of 85% for two commands was achieved based on the T3–T5 and T4–T6 electrode positions using only one speaker. SSAEP is a promising BCI modality for mitigating the problem of eye fatigue that often occurs during the use of SSVEP ‐based BCI systems. However, SSAEP ‐based BCI systems suffer from low accuracy. To increase accuracy, we propose a new enhanced SSAEP training method. The training process was enhanced by instructing users to control their attention levels while simultaneously detecting an auditory stimulus frequency. Furthermore, we propose a corresponding single‐frequency, multi‐command BCI paradigm for the proposed training method. With the proposed paradigm, four commands can be detected using only one auditory stimulus frequency. The proposed training system yielded an accuracy of ∼81% compared to 66% for sessions performed without the proposed training method. © 2017 Institute of Electrical Engineers of Japan. Published by John Wiley & Sons, Inc.     

Steady-state somatosensory evoked potentials: suitable brain signals for brain-computer interfaces?

One of the main issues in designing a brain-computer interface (BCI) is to find brain patterns, which could easily be detected. One of these pattern is the steady-state evoked potential (SSEP). SSEPs induced through the visual sense have already been used for brain-computer communication. In this work, a BCI system is introduced based on steady-state somatosensory evoked potentials (SSSEPs). Transducers have been used for the stimulation of both index fingers using tactile stimulation in the "resonance"-like frequency range of the somatosensory system. Four subjects participated in the experiments and were trained to modulate induced SSSEPs. Two of them learned to modify the patterns in order to set up a BCI with an accuracy of between 70% and 80%. Results presented in this work give evidence that it is possible to set up a BCI which is based on SSSEPs.     

结合表面肌电与稳态视觉诱发电位的混合脑机接口关键技术研究

脑-机接口技术旨在大脑与外部环境之间建立一种全新的不依赖于外周神经和肌肉的交流与控制通道。基于稳态视觉诱发电位的脑-机接口是目前信息传输率最高的无创脑 机接口范式，但是仍低于传统的交互方式。提出一种结合表面肌电与稳态视觉诱发电位的混合脑 机接口，以进一步提高系统的信息传输率。通过不同频率的高频稳态视觉诱发电位结合sEMG编码，实现二者混合脑 机接口系统。利用典型相关分析方法对SSVEP信号进行频率识别，sEMG的检测则采用频域分析方法。来自8名健康受试者的离线结果表明该系统能够获得8428% 的平均准确率，平均信息传输率为7263 bits/min。这些结果为结合表面肌电与稳态视觉诱发电位的混合脑 机接口研究奠定了基础。     

The Berlin Brain-Computer Interface: EEG-based communication without subject training.

The Berlin Brain-Computer Interface (BBCI) project develops a noninvasive BCI system whose key features are 1) the use of well-established motor competences as control paradigms, 2) high-dimensional features from 128-channel electroencephalogram (EEG), and 3) advanced machine learning techniques. As reported earlier, our experiments demonstrate that very high information transfer rates can be achieved using the readiness potential (RP) when predicting the laterality of upcoming left- versus right-hand movements in healthy subjects. A more recent study showed that the RP similarily accompanies phantom movements in arm amputees, but the signal strength decreases with longer loss of the limb. In a complementary approach, oscillatory features are used to discriminate imagined movements (left hand versus right hand versus foot). In a recent feedback study with six healthy subjects with no or very little experience with BCI control, three subjects achieved an information transfer rate above 35 bits per minute (bpm), and further two subjects above 24 and 15 bpm, while one subject could not achieve any BCI control. These results are encouraging for an EEG-based BCI system in untrained subjects that is independent of peripheral nervous system activity and does not rely on evoked potentials even when compared to results with very well-trained subjects operating other BCI systems.     

Enhancement of steady‐state visual evoked potential‐based brain–computer interface systems via a steady‐state motion visual stimulus modality

Steady‐state visual evoked potential (SSVEP)‐based brain–computer interface (BCI) systems are among the most accurate assistive devices for patients with severe disabilities. However, existing visual stimulation patterns lead to eye fatigue, which affects the system performance. Therefore, in this study, we propose two improvements to SSVEP‐based BCI systems. First, we propose a novel visual stimulator that incorporates a visual motion stimulus for the steady‐state visual stimulus to reduce eye fatigue while maintaining the advantages associated with SSVEPs. We also propose two corresponding feature extraction algorithms, i.e. SSVEP detection and visual attention detection, to capture the phenomena of steady‐state motion visual stimulus responses. The accuracy of the test was ∼83.6%. Second, we propose a novel hybrid BCI‐SSVEP system and a motion visual stimulus hybrid BCI system to enhance the SSVEP‐based BCI system during a state of eye fatigue. Participants used the SSVEP system until reaching a fatigued state and then began using a hybrid motion visual stimulus. The accuracy of the proposed system was ∼85.6%. The proposed improvements can be incorporated into practical BCI systems for wheelchair control. © 2017 Institute of Electrical Engineers of Japan. Published by John Wiley & Sons, Inc.     

The Wadsworth BCI Research and Development Program: at home with BCI.

The ultimate goal of brain-computer interface (BCI) technology is to provide communication and control capacities to people with severe motor disabilities. BCI research at the Wadsworth Center focuses primarily on noninvasive, electroencephalography (EEG)-based BCI methods. We have shown that people, including those with severe motor disabilities, can learn to use sensorimotor rhythms (SMRs) to move a cursor rapidly and accurately in one or two dimensions. We have also improved P300-based BCI operation. We are now translating this laboratory-proven BCI technology into a system that can be used by severely disabled people in their homes with minimal ongoing technical oversight. To accomplish this, we have: improved our general-purpose BCI software (BCI2000); improved online adaptation and feature translation for SMR-based BCI operation; improved the accuracy and bandwidth of P300-based BCI operation; reduced the complexity of system hardware and software and begun to evaluate home system use in appropriate users. These developments have resulted in prototype systems for every day use in people's homes.     

A BCI-based environmental controller for the motion-disabled

With the development of brain-computer interface (BCI) technology, researchers are now attempting to put current BCI techniques into practical application. This paper presents an environmental controller using a BCI technique based on steady-state visual evoked potential. The system is composed of a stimulator, a digital signal processor, and a trainable infrared remote-controller. The attractive features of this system include noninvasive signal recording, little training requirement, and a high information transfer rate. Our test results have shown that this system can distinguish at least 48 targets and provide a transfer rate up to 68 b/min. The system has been applied to the control of an electric apparatus successfully.     

基于 P300 与 ErrP 决策融合的脑-机接口目标检测方法

针对脑-机接口(BCI)技术在目标检测中的应用仍然存在检测准确率受限的问题,提出基于事件相关电位(ERP)中的 P300 与错误相关电位(ErrP)决策融合的新型编解码方法。 BCI 系统编码方面通过目标图像和视觉反馈分别诱发 P300 与 ErrP 特征,解码方面采用单独 P300 特征、单独 ErrP 特征、P300 与 ErrP 特征层融合、P300 与 ErrP 决策层融合这 4 种方案进行目标检 测。 10 名健康受试者 4 种方案进行目标检测的平均结果显示,使用 P300 与 ErrP 决策层融合的平衡正确率最高,达到 80. 03%± 5. 20%,相比单独使用 P300 特征的方法提升了 4. 38%,相比单独使用 ErrP 特征的方法提升了 11. 29%,验证了混合 BCI 技术在 目标检测任务中的可行性。     

Dry and noncontact EEG sensors for mobile brain-computer interfaces

Dry and noncontact electroencephalographic (EEG) electrodes, which do not require gel or even direct scalp coupling, have been considered as an enabler of practical, real-world, brain-computer interface (BCI) platforms. This study compares wet electrodes to dry and through hair, noncontact electrodes within a steady state visual evoked potential (SSVEP) BCI paradigm. The construction of a dry contact electrode, featuring fingered contact posts and active buffering circuitry is presented. Additionally, the development of a new, noncontact, capacitive electrode that utilizes a custom integrated, high-impedance analog front-end is introduced. Offline tests on 10 subjects characterize the signal quality from the different electrodes and demonstrate that acquisition of small amplitude, SSVEP signals is possible, even through hair using the new integrated noncontact sensor. Online BCI experiments demonstrate that the information transfer rate (ITR) with the dry electrodes is comparable to that of wet electrodes, completely without the need for gel or other conductive media. In addition, data from the noncontact electrode, operating on the top of hair, show a maximum ITR in excess of 19 bits/min at 100% accuracy (versus 29.2 bits/min for wet electrodes and 34.4 bits/min for dry electrodes), a level that has never been demonstrated before. The results of these experiments show that both dry and noncontact electrodes, with further development, may become a viable tool for both future mobile BCI and general EEG applications.     

用于脑机接口的感觉刺激事件相关电位研究进展

脑机接口研究的目的就是在人脑和计算机或其他电子设备之间建立一种直接联系,使人们可以通过思维来直接控制计算机或外部设备。感觉刺激诱发的事件相关电位是基于脑电的脑机接口系统研究中备受关注的一种信号模式,按其刺激模式的不同又可分为视觉、听觉、体感等单一感觉通道刺激诱发的和跨感觉通道刺激诱发的事件相关电位。事件相关电位研究的发展表明：相对于单一感觉通道,跨感觉通道刺激诱发的事件相关电位具有波幅高、潜伏期短且含有高维度空间分布信息的特点,可弥补单一感觉诱发事件相关电位信息过少、不利识别的缺陷,从而提高信息转化速度和分类准确率,在脑机接口中具有更高的实用价值。     

Towards human BCI applications based on cognitive brain systems: an investigation of neural signals recorded from the dorsolateral prefrontal cortex.

One of the critical issues in brain-computer interface (BCI) research is how to translate a person's intention into brain signals for controlling computer programs. The motor system is currently the primary focus, where signals are obtained during imagined motor responses. However, cognitive brain systems are also attractive candidates, in that they may be more amenable to conscious control, yielding better regulation of magnitude and duration of localized brain activity. We report on a proof of principle study for the potential use of a higher cognitive system for BCI, namely the working memory (WM) system. We show that mental calculation reliably activates the WM network as measured with functional magnetic resonance imaging (fMRI). Moreover, activity in the dorsolateral prefrontal cortex (DLPFC) indicates that this region is active for the duration of mental processing. This supports the notion that DLPFC can be activated, and remains active, at will. Further confirmation is obtained from a patient with an implanted electrode grid for diagnostic purposes, in that gamma power within DLPFC increases during mental calculation and remains elevated for the duration thereof. These results indicate that cortical regions involved in higher cognitive functions may serve as a readily self-controllable input for BCI applications. It also shows that fMRI is an effective tool for identifying function-specific foci in individual subjects for subsequent placement of cortical electrodes. The fact that electrocorticographic (ECoG) signal confirmed the functional localization of fMRI provides a strong argument for incorporating fMRI in BCI research.     

A general framework for brain-computer interface design

The Brain-Computer Interface (BCI) research community has acknowledged that researchers are experiencing difficulties when they try to compare the BCI techniques described in the literature. In response to this situation, the community has stressed the need for objective methods to compare BCI technologies. Suggested improvements have included the development and use of benchmark applications and standard data sets. However, as a young, multidisciplinary research field, the BCI community lacks a common vocabulary. As a result, this deficiency leads to poor intergroup communication, which hinders the development of the desired methods of comparison. One of the principle reasons for the lack of common vocabulary is the absence of a common functional model of a BCI System. This paper proposes a new functional model for BCI System design. The model supports many features that facilitate the comparison of BCI technologies with other BCI and non-BCI user interface technologies. From this model, taxonomy for BCI System design is developed. Together the model and taxonomy are considered a general framework for BCI System design. The representational power of the proposed framework was evaluated by applying it to a set of existing BCI technologies. The framework could effectively describe all of the BCI System designs tested.     

The impact of loss of control on movement BCIs

Brain-computer interfaces (BCIs) are known to suffer from spontaneous changes in the brain activity. If changes in the mental state of the user are reflected in the brain signals used for control, the behavior of a BCI is directly influenced by these states. We investigate the influence of a state of loss of control in a variant of Pacman on the performance of BCIs based on motor control. To study the effect a temporal loss of control has on the BCI performance, BCI classifiers were trained on electroencephalography (EEG) recorded during the normal control condition, and the classification performance on segments of EEG from the normal and loss of control condition was compared. Classifiers based on event-related desynchronization unexpectedly performed significantly better during the loss of control condition; for the event-related potential classifiers there was no significant difference in performance.     

Peripheral electrical stimulation triggered by self-paced detection of motor intention enhances motor evoked potentials

This paper proposes the development and experimental tests of a self-paced asynchronous brain-computer interfacing (BCI) system that detects movement related cortical potentials (MRCPs) produced during motor imagination of ankle dorsiflexion and triggers peripheral electrical stimulations timed with the occurrence of MRCPs to induce corticospinal plasticity. MRCPs were detected online from EEG signals in eight healthy subjects with a true positive rate (TPR) of 67.15 ± 7.87% and false positive rate (FPR) of 22.05 ±9.07%. The excitability of the cortical projection to the target muscle (tibialis anterior) was assessed before and after the intervention through motor evoked potentials (MEP) using transcranial magnetic stimulation (TMS). The peak of the evoked potential significantly (P=0.02) increased after the BCI intervention by 53 ± 43% (relative to preintervention measure), although the spinal excitability (tested by stretch reflexes) did not change. These results demonstrate for the first time that it is possible to alter the corticospinal projections to the tibialis anterior muscle by using an asynchronous BCI system based on online motor imagination that triggered peripheral stimulation. This type of repetitive proprioceptive feedback training based on self-generated brain signal decoding may be a requirement for purposeful skill acquisition in intact humans and in the rehabilitation of persons with brain damage.     

Brain-computer interface technology: a review of the first international meeting.

Over the past decade, many laboratories have begun to explore brain-computer interface (BCI) technology as a radically new communication option for those with neuromuscular impairments that prevent them from using conventional augmentative communication methods. BCI's provide these users with communication channels that do not depend on peripheral nerves and muscles. This article summarizes the first international meeting devoted to BCI research and development. Current BCI's use electroencephalographic (EEG) activity recorded at the scalp or single-unit activity recorded from within cortex to control cursor movement, select letters or icons, or operate a neuroprosthesis. The central element in each BCI is a translation algorithm that converts electrophysiological input from the user into output that controls external devices. BCI operation depends on effective interaction between two adaptive controllers, the user who encodes his or her commands in the electrophysiological input provided to the BCI, and the BCI which recognizes the commands contained in the input and expresses them in device control. Current BCI's have maximum information transfer rates of 5-25 b/min. Achievement of greater speed and accuracy depends on improvements in signal processing, translation algorithms, and user training. These improvements depend on increased interdisciplinary cooperation between neuroscientists, engineers, computer programmers, psychologists, and rehabilitation specialists, and on adoption and widespread application of objective methods for evaluating alternative methods. The practical use of BCI technology depends on the development of appropriate applications, identification of appropriate user groups, and careful attention to the needs and desires of individual users. BCI research and development will also benefit from greater emphasis on peer-reviewed publications, and from adoption of standard venues for presentations and discussion.     

ECoG factors underlying multimodal control of a brain-computer interface.

Most current brain-computer interface (BCI) systems for humans use electroencephalographic activity recorded from the scalp, and may be limited in many ways. Electrocorticography (ECoG) is believed to be a minimally-invasive alternative to electroencephalogram (EEG) for BCI systems, yielding superior signal characteristics that could allow rapid user training and faster communication rates. In addition, our preliminary results suggest that brain regions other than the sensorimotor cortex, such as auditory cortex, may be trained to control a BCI system using similar methods as those used to train motor regions of the brain. This could prove to be vital for users who have neurological disease, head trauma, or other conditions precluding the use of sensorimotor cortex for BCI control.