NON-MEDICAL USES OF BCI TECHNOLOGY bci.pdfSTATES FOR BETTER BCI PERFORMANCE1. Improvements in BCI...
Transcript of NON-MEDICAL USES OF BCI TECHNOLOGY bci.pdfSTATES FOR BETTER BCI PERFORMANCE1. Improvements in BCI...
-
NON-MEDICAL USES OF BCI TECHNOLOGY
-
NON-MEDICAL USES OF BCI TECHNOLOGY
-
BRAIN-COMPUTER INTERFACE
http://www.epe.tuiasi.ro/2010/pdf/EPE2010_BCI_EN.html
-
OUTLINE
1. Improvements in BCI technology
2. Real-time decoding of mental states
3. BCI for entertainment
-
DRY ELECTRODES
1. Improvements in BCI technology
http://neurogadget.com/2011/03/21/neurofocus-reveals-mynd-the-first-wireless-full-brain-eeg-headset/1416
-
MINIMAL USER TRAINING
1. Improvements in BCI technology
● from training the user to machine learning● with stimuli from outside, less training● machine learning helps a lot, faster calibration
STUDY (2008):● which proportion of users can use it in the first session● 14 subjects, never used BCI● SMR-based BCI● offline calibration + online feedback
-
MINIMAL USER TRAINING
1. Improvements in BCI technology
-
MINIMAL USER TRAINING
1. Improvements in BCI technology
-
MINIMAL CALIBRATION:
SUBJECT INDEPENDENT CLASSIFIERS
1. Improvements in BCI technology
1. No calibration:Data from previous sessions -> classifier
2. Zero-training classifier:2009SMR-basedmany subject-dependent experiments togetherset of voting classifiers
-
BCI DEFICIENCY
1. Improvements in BCI technology
● for some it just doesn’t work● deficiency rate about 15-30% (SMR-based BCI)● correlations with gamma-waves found
STUDY (2010):● Cat I - successful training + successful feedback (6)● Cat II - successful training + unsuccessful feedback (2)● Cat III - unsuccessful everything (3)● online feedback calibration tried with them
-
BCI DEFICIENCY
1. Improvements in BCI technology
-
BCI DEFICIENCY
1. Improvements in BCI technology
-
GUIDED PRACTICE FOR A FAST-DECISION BCI
1. Improvements in BCI technology
20098 subjects
3 runs (slow->fast)
-
GUIDED PRACTICE FOR A FAST-DECISION BCI
1. Improvements in BCI technology
-
EXPLOITING PRESTIMULUS MENTAL STATES FOR BETTER BCI PERFORMANCE
1. Improvements in BCI technology
● mental states affect how we perform with BCI● some states are better for some tasks
STUDY (2010):● 30 subjects● SMR-based BCI● left-right motor imagery● split in two by prestimulus band-power (high/low)
-
EXPLOITING PRESTIMULUS MENTAL STATES FOR BETTER BCI PERFORMANCE
1. Improvements in BCI technology
-
EXPLOITING PRESTIMULUS MENTAL STATES FOR BETTER BCI PERFORMANCE
1. Improvements in BCI technology
-
OUTLINE
1. Improvements in BCI technology
2. Real-time decoding of mental states
3. BCI for entertainment
-
MENTAL STATE MONITORING2. Real-time decoding of mental states
● to optimize human performance● usually done with other measures● fatigue, emotion, workload● applications:
○ medical○ user interface evaluation○ help the user
● offline vs online
-
ATTENTION2. Real-time decoding of mental states
● safety-critical applications● blink and heart rate monitoring● alpha-waves - no visual information processed● detect microsleep before it
-
ATTENTION2. Real-time decoding of mental states
STUDY (2008):● 11 male drivers● 3 tasks:
○ K0 - fixate at a cross○ K1 - cross replaced by a video○ K2 - active driving
● sound played at the same time (high-low), had to react
RESULTS:● K2 larger reaction● alpha and gamma wave power decreased from K0-K2
-
MONITORING PERFORMANCE CAPABILITY2. Real-time decoding of mental states
-
MONITORING PERFORMANCE CAPABILITY2. Real-time decoding of mental states
-
WORKLOAD2. Real-time decoding of mental states
● Improve design of products.● Usability studies.
STUDY (2007):● 12 male, 5 female● driving on a highway 100 km/h (primary task)● auditory reaction every 7.5 s (left/right) (secondary task)● workload task (tertiary task)
○ mental calculation○ auditory task
-
WORKLOAD2. Real-time decoding of mental states
-
WORKLOAD2. Real-time decoding of mental states
-
COGNITION OF MUSIC2. Real-time decoding of mental states
STUDY (2010):● 13 subjects● major triads in root position● repeated 7-11 times before changing the chord (randomly)● subject rated the fit of the new chord on scale 1-7● neuronal patterns also analyzed
-
COGNITION OF MUSIC2. Real-time decoding of mental states
-
OUTLINE
1. Improvements in BCI technology
2. Real-time decoding of mental states
3. BCI for entertainment
-
MEDIA APPLICATIONS3. BCI for entertainment
-
MEDIA APPLICATIONS3. BCI for entertainment
-
GAMES CONTROLLED BY BCI ONLY3. BCI for entertainment
-
GAMES CONTROLLED BY BCI ONLY3. BCI for entertainment
-
GAMES CONTROLLED BY BCI ONLY3. BCI for entertainment
-
GAMES WITH ADDITIONAL INPUT FROM BCI
3. BCI for entertainment
● BCI as additional input device● needs to be working well● tailor the game to the gamer
-
CONCLUSION
● Have to improve BCI so that it works for all● Support human performance● Usability tests● Entertainment● What has happened in 2010 - 2014?
-
Thanksfor
listening!