BRAIN COMPUTER INTERFACE

SEMINAR PRESENTATION

By
DHANUSHA SP
MSc Computer Science
1847140

MISSION VISION CORE VALUES

CHRIST is a nurturing ground for an individual’s Excellence and Service Faith in God | Moral Uprightness
holistic development to make effective contribution to Love of Fellow Beings
the society in a dynamic environment Social Responsibility | Pursuit of Excellence
 CHRIST
Deemed to be University

DO YOU REMEMBER THEM????

Excellence and Service

 CHRIST
Deemed to be University

INTRODUCTION

● Brain-computer interface (BCI) is a fast-growing emergent

technology, in which researchers aim to build a direct channel
between the human brain and the computer.

● Is a collaboration in which a brain accepts and controls a mechanical

device as a natural part of its representation of the body.

● Designed to
○ restore sensory function,
○ transmit sensory information to the brain, or
○ stimulate the brain through artificially generated electrical signals.

Excellence and Service

 CHRIST
Deemed to be University

INTRODUCTION

● Brain-computer interface (BCI) is a collaboration between a brain and

a device that enables signals from the brain to direct some external
activity, such as control of a cursor or a prosthetic limb.

● The interface enables a direct communications pathway between the

brain and the object to be controlled.

● EXAMPLE: cursor control

Excellence and Service

 CHRIST
Deemed to be University

BUT HOW???

● By reading signals from an array of neurons

● Using computer chips and programs to translate the signals into

action.

● BCI can enable a person suffering from paralysis to write a book

● Control a motorized wheelchair or prosthetic limb through thought

alone.

● Current brain-interface devices require deliberate conscious thought;

some future applications, such as prosthetic control, are likely to work
effortlessly.

Excellence and Service

 CHRIST
Deemed to be University

● These signals include slow cortical potentials, P300 potentials or beta

rhythms recorded from the scalp.

● They are translated in real time into commands that operate a

computer display or any other device.

● In one-way brain computer interface, computer either accepts

commands from brain or sends signals to it.

● In two-way brain computer interface, brains and external devices

exchange information in both directions.

Excellence and Service

 CHRIST
Deemed to be University

BCI MODEL

Excellence and Service

 CHRIST
Deemed to be University

MODEL

Excellence and Service

 CHRIST
Deemed to be University

EARLY WORKS

● Algorithms to reconstruct movements from motor cortex neurons,

which control movement, were developed in 1970s.

● The first Intra-Cortical Brain-Computer Interface was built by

implanting electrodes into monkeys.
○ decoded brain activity in monkeys
○ used the devices to reproduce movements in monkeys and
○ used the devices to reproduce monkey movements in robotic arms.

Excellence and Service

 CHRIST
Deemed to be University

HOW IT WORKS

Excellence and Service

 CHRIST
Deemed to be University

Excellence and Service

 CHRIST
Deemed to be University

Excellence and Service

 CHRIST
Deemed to be University
BCI APPROACHES

Excellence and Service

 CHRIST
Deemed to be University

In INVASIVE
● Invasive BCIs are implanted directly into the grey matter of the brain
during neurosurgery.
● Using chips implanted against the brain that have hundreds of pins
less than the width of a human hair protruding from them and
penetrating the cerebral cortex.
● The language of the neural firings is then sent to a computer translator
that uses special algorithms to decode the neural language into
computer language.
● This is then sent to another computer that receives the translated
information and tells the machine what to do.
● produce the highest quality signals of BCI devices
● but are prone to scar-tissue build-up, causing the signal to become
weaker or even lost as the body reacts to a foreign object in the brain.

Excellence and Service

 CHRIST
Deemed to be University

PARTIAL OR SEMI INVASIVE

● implanted inside the skull but rest outside the brain rather than within
the grey matter.

● They produce better resolution signals than non-invasive BCIs

● Electrocorticography (ECoG) measures the electrical activity of the

brain taken from beneath the skull

● higher spatial resolution, better signal-to-noise ratio, wider frequency

range, and lesser training requirements

Excellence and Service

 CHRIST
Deemed to be University

NON-INVASIVE
● The easiest and least invasive method is a set of electrodes, this
device known as an electroencephalograph (EEG) -- attached to
the scalp.

● The electrodes measure minute differences in the voltage between

neurons. The signal is then amplified and filtered.

● In current BCI systems, it is then interpreted by a computer program,

which displayed the signals via pens that automatically wrote out the
patterns on a continuous sheet of paper.

● Even though the skull blocks a lot of the electrical signal, and it
distorts what does get through it is more accepted than the other
types because of their respective disadvantages.
Excellence and Service
 CHRIST
Deemed to be University

Excellence and Service

 CHRIST
Deemed to be University

APPLICATION

● Provide disabled people with communication, environment control,

and movement restoration.

● Enhanced control of devices such as wheelchairs, vehicles, or

assistance robots for people with disabilities.

● Additional channel of control in computer games.

● Monitor attention in long-distance drivers or aircraft pilots, send out

alert and warning for aircraft pilots.

● Develop intelligent relaxation devices.

Excellence and Service

 CHRIST
Deemed to be University

● Control robots that function in dangerous or inhospitable

● Create a feedback loop to enhance the benefits of certain therapeutic

methods.

● Develop passive devices for monitoring function, such as monitoring

long-term drug effects, evaluating psychological state, etc.

● Monitor stages of sleep

Excellence and Service

 CHRIST
Deemed to be University

DO YOU KNOW THESE?

● Bionics/Cybernetics

● Memory Upload/Download

● Dream Capture

● Brain as a Computer

● “Google Search” through

brain

Excellence and Service

 CHRIST
Deemed to be University

PROJECTS

● BrainGate

● BCI2000

● Australian Bionic Eye

● Honda Asimo Control

● Kevin Warwick – The First Human Cyborg

● Gaming Control

Excellence and Service

 CHRIST
Deemed to be University

EEG BASED BCI

● Electroencephalography (EEG) is the recording of electrical activity

along the scalp produced by the firing of neurons within the brain.

● Among the possible choices the scalp recorded electroencephalogram

(EEG) appears to be an adequate alternative because of its good time
resolution and relative simplicity.

● The BCI system is subdivided into three subsystems, namely

○ EEG acquisition,
○ EEG signal processing
○ output generation.

Excellence and Service

 CHRIST
Deemed to be University

Excellence and Service

 CHRIST
Deemed to be University

LINK BETWEEN COMPASSIONATE AI AND BCI

● Mobile bio monitoring devices, Nero prosthetic wireless wearable

intelligent sensors it is becoming possible to monitor the activities of
the neuron in human brain.

● The small moyion sensors will notice the brain activities and make
sync with the mobile devices.

● The role of compassionate AI is to help the sick, and physically and

mentally challenged people who are suffering a lot.

● With BCI the intelligent sensors will capture the brain signals and
compassionate AI will interpret that and take suitable kind action to
eliminate the pain.

Excellence and Service

 CHRIST
Deemed to be University

BRAIN SIGNAL ACQUIRING INSTRUMENTS

● Functional magnetic resonance imaging (fMRI)

● positron emission tomography (PET)

● magneto-encephalography (MEG)

● scalp electroencephalography (EEG)

● Near Infrared Spectroscopy (NIRS)

● functional NIRS (fNIRS )

Excellence and Service

 CHRIST
Deemed to be University

BRAIN SIGNALS

● electric signals that moves from neuron to neuron as fast as 250 mph

● These signals are divided into two classes: spikes and field potentials.

● Although the paths of the signals take are insulated by something

called myelin, some of the electric signal escapes.

● Scientists can detect those signals, interpret what they mean and use
them to direct a device of some kind.

Excellence and Service

 CHRIST
Deemed to be University

Excellence and Service

 CHRIST
Deemed to be University

CONVOLUTION NEURAL NETWORK AND BCI

● Convolution Neural Networks (CNN) is a type of artificial neural

network inspired based on visual cortex.

● learns the appropriate features from the input data automatically by

optimizing the weight parameters of each filter through the forward
and backward propagation in order to minimize the classification
error.

● visual cortex – hierarchical system

● Earlier regions, known as the primary visual cortex, respond to simple

features such as colour or orientation.

● Later stages enable more complex tasks such as object recognition.

Excellence and Service
 CHRIST
Deemed to be University

● One advantage of using deep learning technique is that it requires

minimal pre-processing because optimal settings are learned
automatically.

● feature extraction and classification are integrated into a single

structure and optimized automatically.

● fNIRS time series data of human subjects were input to the CNN.

● As the convolution is performed in the sliding window manner, the

feature extraction process of CNN retains the temporal information of
the time series data obtained by fNIRS.

Excellence and Service

 CHRIST
Deemed to be University

Excellence and Service

 CHRIST
Deemed to be University

REINFORCEMENT LEARNING AND BCI

● framework to learn directly from the interaction of agent and
environment

● Agent is defined as an entity that has cognitive skills, the ability to

solve the problem, and the ability to communicate with the outside
environment.

● table-based algorithms (Q-learning, SARSA, SARSA-λ) or neural

network-based algorithms (Q-NN, NFQ, DQN, )

● Actor-Critic (AC) method-based learning algorithms are among the

most popular methods in reinforcement learning.

Excellence and Service

 CHRIST
Deemed to be University

● AC framework has many links with neuroscience and learning

Excellence and Service

 CHRIST
Deemed to be University

EEG-BASED BCI CONTROL SCHEMES FOR

LOWER-LIMB ASSISTIVE-ROBOTS:

Excellence and Service

 CHRIST
Deemed to be University

● framework was extended from Tucker et al.

● Integral parts of the framework include

○ a user of the assistive robot-device,

○ the assistive-robot device itself,
○ a BCI operator structure with sub-level controls,
○ shared control, communication protocol and
○ the interaction with environment.

● The BCI operator structure constitutes of three sub-layers which are

the
○ feature extraction,
○ translation and
○ execution layer

Excellence and Service

 CHRIST
Deemed to be University

• BCI control is driven from the recognition of user's motion intentions

• The first step :how to perceive and interpret the user's physiological
state (i.e., MI/ME or ERP) acquired via EEG.

• The status of physical interaction between the user and the

environment the robotic device and the environment are checked.

• The assistive-robot's state is determined via electromechanical

sensors.

• The user and assistive-robot status inputs to the BCI operator and
shared controller, respectively.

Excellence and Service

 CHRIST
Deemed to be University

Generalized framework in BCI controlled wearable LL

Excellence and Service

 CHRIST
Deemed to be University

COMMUNICATION PROTOCOL

● In EEG-BCI controlled humanoids, the data were transmitted using

wireless TCP/IP communication between the humanoid and other
systems.
● transmission control/internet protocol (TCP/IP)

● An alternate approach is the lab streaming layer (LSL), which allows

synchronization of the streaming data across devices

● Recent assistive applications such as wheelchairs, and mobile robots,

use controller area network (CAN) bus which is a robust vehicle bus
standard.

● allow microcontrollers and devices to communicate in applications

without a host computer and follows a message-based protocol.
Excellence and Service
 CHRIST
Deemed to be University

FEATURE EXTRACTION

● Neural decoding of walking pattern, included power spectral density

(PSD) analysis of the kinematic data and adaptive Thompson's
multitaper for each channel of EEG recorded, during rest and walking
tasks.

● Parameters of the model were calculated with Gaussian distribution

method.

● Method used:
○ Band power feature
○ Time domain parameters

● EEG-BCI wheelchairs have successfully used linear SVM for

dynamic feature classification.
Excellence and Service
 CHRIST
Deemed to be University

TRANSLATION LAYER

● Identify user intent brain signals, and manipulate the robotic device
via machine understandable commands for interfacing.

● Classification method used is are LDA, SVM, GMM, and ANN.

● estimates the weighted class, represented by the feature vector for

mapping to the desired state

Excellence and Service

 CHRIST
Deemed to be University

ARTIFICIAL NEURAL NETWORK

● The ANNs are non-linear classifiers

● Inspired by human's nervous system ability to adaptively react to

changes in surroundings

● pattern recognition problems

● allow the drawing of non-linear decision boundaries.

● algorithms including multilayer perception, Gaussian classifier,

learning vector quantization, RBF neural networks,

● adopting processing method as dynamic recurrent neural network

(DRNN)

Excellence and Service

 CHRIST
Deemed to be University

LIMITATIONS
● self-calibration,

● self-analysis (with backward-forward failure attribution analysis) and

● error-correction

● standardized safety and tolerability assessment

Excellence and Service

 CHRIST
Deemed to be University

CONCLUSION

● A potential therapeutic tool.

● Promising paradigm shift in areas like Machine Control, Human

Enhancement, Virtual reality a

● So, it’s potentially high impact technology.

● promise for rehabilitation and improving performance, such as

○ treating emotional disorders ,
○ easing chronic pain, and
○ overcoming movement disabilities due to stroke.

● Will enable us to achieve singularity very soon.

Excellence and Service

 CHRIST
Deemed to be University

THANKING YOU
ANY QUESTIONS ??

Excellence and Service