1. Cognitive and Emotional NeuroProstheses&Research Organizations and current TrendsPresented by : Omer Ali {omerali@gmail.com}Department of Information and Communication Engineering, DGIST , S.Korea1

2. Contents Introduction Neuro-Prosthesis Volitional Prostheses Memory Prostheses NeurofeedBack BCI Research Organizations and Fundings Neurobotics Conclusion2 3. IntroductionOver the course of last few weeks we studied:1. Major Types of BCI sensors1. Major Challenges for BCI sensor Production2. BCI Abiotic-biotic Interface3. Improved Electrode Performance Criteria4. BMI/BCI Modeling1. Multimicro-electrode Array2. EEG / ECoG recordings5. FES Applications of BCI6. Non-invasive communication system3 4. Neuro-Prostheses Neural-Prostheses are a series of devices that can substitute a motor sensory orcognitive modality of brain. Neural implants are small scale devices to minimize invasive structures and help tocluster a certain portion of brains functioning. The most widespread of Neuroprosthetic currently appears as cochlear implants.4 5. NEURAL-PROSTHESESVOLITIONAL PROSTHESESMEMORY PROSTHESESNEUROFEEDBACK5 6. VOLITIONAL PROSTHESES Volition is the will to plan or execute an action. Some of the states involved involition neurons are: attention, intention, motivation , expectation. Volitional prosthesis retrieves the respective neuron from brain regions andcombines them with somatomotor-prostheses to refine controls for robots orprostheses.Action planning activities of Brain6 7. Volitional Prostheses Reach Trials Reach Trials are normally conducted on Parietal Reach Regions (PRR) of monkeys brainto record spikes of neuron magnitudes in order to reach the target. Motor Cortex recordings (as discussed previously) records the whole trajectory (the path andintended motion to the target)Reach Trials Intended for Targets (Spike Decoding)Brain motor cortex recordings (for overall intended action)7 8. Volitional Prostheses Recording expected actions The Brain Control task is accomplished by Reach Trials while observing thehigher magnitude of spikes for intended actions. Neuron firings was found to increase spatial tuning during tasks when theoutcome was preferred by the brain (in terms of magnitude or probability). Decoding and classifying these expected values are then formulated to note thepreferences of patients with BCI.A B CPreferred ObjectsNon-preferred rewards8 9. Cognitive States & Emotions BCI users have different needs based on their cognitive states (awake, alert,frustrated, planning a movement or moving). If these cognitive states are not decoded properly, the BCI-controlled device mayresult in un-intended action causing patients disbelief or discomfort in BCIsystem. Previously, we saw the decoding of same information from Local FieldPotentials (LFPs) used in monkeys eye saccade movement LFPs tend to act better than spike information because they hold the complete trajectoryinformation rather than just the object tracking spikes recorded. As it was noticed previously, that LFPs information is based in different frequency bands,thus the decoding of specific information is possible. The EU project IDIAP is considering EEG signal deciphering to reduce deciosion makingstates thus making BCI devices more cognitively efficient.9 10. MEMORY PROSTHESESEMOTIONAL ROBOTSHIPPOCAMPAL NEURAL PROSTHESIS10 11. Memory Prostheses Memory prostheses addresses to the central brain damage causing long-term orshort-term memory losses. The Alzheimer disease is still the biggest challengefor neuro-scientists. The central brain region damage (caused due to disease, stroke or epilepsy)affects the hippocampal cells, leaving the patient highly dependent on familysupport. The collaboration efforts of University of Southern California, University ofKentucky and Wake Forest University is focusing towards replacement ofdamaged hippocampal cells with micro-chip based systems.Hippocampus Consolidates (Short-term,long term, spatial memory)11 12. Emotional Robots Emotions are high-level cognitive states that carry large amount of information. An emotionally aware BCI would realize the erroneous cognitive states andadapts its output accordingly. The Human-Machine Interaction Network on Emotion (HUMAINE) is a Europeanconsortium developing systems capable of registering, modeling and influencehuman emotional states.Cortical prosthesis utilizing a VLSIbiomedical implant to recordneurons from damagedhippocampusBut, where did the idea come from ?12 13. WASEDA Robot, Takanishi Lab - JAPAN13 14. A Hippocampal Neural Prosthesis for AnimalCornu ammonis (CA) are pyramidalcells that are responsible to feed inputto DentateDentate Gyrus(DG) is the region ofHippocampus which forms newmemoriesA feedback VLSI system that generatesweak pulses from damaged Dentate ,amplifies and process them and feedsthem back to CA1; making thememory formation more abrupt14 15. A Hippocampal Neural Prosthesis for Animal Data showing the amplitudes of population EPSPs (excitatory postsynaptic potentials) recordedfrom the molecular layer of CA1 in response to electrical stimulation of inputs to the dentate gyrus. After formulating a nonlinear input-output model for CA3, CA3 was removed surgically and replacedwith an FPGA-based input-output. The FPGA hardware and the slice communicated bi-directionallyvia the multisite electrode arrays15 16. NEURO-FEEDBACKNEUROFEEDBACK FOR EPILEPSYNEUROFEEDBACK FOR ADHDNEUROFEEDBACK FOR CONTROL OF EMOTIONS16 17. Neuro-feedback It is an operand based brain activity conditioning with feedback to guide control ;varying as compared to reward-based training Subjects are trained with visual, auditory feedback of their EEG. Recent Neuro-feedback is based on Blood-Oxygen-level-Dependent (fMRI BOLD)signal to control brain to a desired state. Neuro-feedback devices act as non-invasive neural prostheses that helps patientscontrol their brain activity to stable neural states. There are two main types of signal generation: Sensorimotor Rhythm (SMR): generating a controllable rhythm with spectral peak between 12Hz and14Hz that is mapped to sensorimotor cortex of the brain Slow Cortical Potentials (SCP): SCPs < 2Hz can be modulated through neurofeedback training conditionsmarked by epilepsy and attention deficit syndromes.17 18. Neurofeedback for Epilepsy Epilepsy is normally characterized by Seizures; resulting from abnormal orexcessive hypersynchronous neural activity in the brain. The excitation threshold of neurons is decreased to the point where they fire in synchronousand more often in oscillatory bursts leading to seizures. Epilepsy reduction by SMR training is attributed to an increased threshold ofexcitation in somatosensory pathways causing less epileptic occurrences. Currently, combined EEG and fMRI study explains a reduction in BOLD signalwhich was spatially correlated with SCP. These SCPs are then used as training tools and it was found that patients havingSCP training showed a decrease in frequency of epileptic occurrences.18 19. Neurofeedback for ADHD Attention Deficit Hyperactivity Disorder ADHD is the problem with inattentiveness, over-activityor impulsive behavior. Earlier investigations on EEG biofeedback training on a hyperkinetic child reported anincrease in motor inhibition when the child succeeded in producing 12 14 Hz without 4 7 Hz activity. The Spectral Power of EEG activity in ADHD children is characterized by: Theta: 4 7 Hz Alpha: 8 12 Hz Beta: 12- 22 Hz Theta-band supressions and SMR and beta rhythms enhancements throughneurofeedbacks training were found to have ameliorative effects on children. On the commercial side, neurofeedback games for improved intelligence are beingmarketed under the trade name of S.M.A.R.T that is also capable of ADHD treatment byrigorous training exercises.19 20. S.M.A.R.T Learning GameNeurofeedback task screen display The upper panels show a task where the objective is the highlighted upperrectangle, and the subject must create negative SCP potentials to move the ballupward while it traverses the screen from left to the right. A successful trial isrewarded with a smiley and a reinforcing tone. The lower panel shows a transfer session,where the user must create a similarnegative potential, without the visual feedback20 21. BCI RESEARCH ORGANIZATIONSRESEARCH TRENDSNEUROBOTICS21 22. BCI Research Organizations & Projects (1) HUMAINE: The Human-Machine Interaction Network on Emotion (HUMAINE), funded by the EUInformation Society Technology program, aims toward the development of systems that can register,model, and/or influence human emotional and emotion-related states and processes. BrainNet: It consists of 19 established brain banks across Europe and is coordinated by the Centrefor Neuropathology and Prion Research at Ludwig-Maximilians-University, Munich, Germany. Itsmain goal is the collection and distribution of well-characterized, high-quality, post mortem braintissue for basic research in neuroscience. EURON: The EUropean RObotics research Network (EURON) consists of European robotics groupsand resources in research, industry, and education joined by a common interest in working to makebetter robots. BACS: Bayesian Approach to Cognitive Systems (BACS) is an integrated project under the EC SixthFramework Program that has been allocated 7.5-million in funding. It brings together researchersand commercial companies working on artificial perception systems to model neuronal functionsand cognitive processes.22 23. BCI Research Organizations & Projects (2) BBCI: The Berlin Brain Computer Interface (BBCI) project is a collaboration between theFraunhofer-Institut frRechnerarchitektur und Softwaretechnik (FIRST) Institute, Charit Universityof Medicine, Technical Institute of Berlin, and the Bernstein Institute for ComputationalNeuroscience to develop BCI technology for commercial and medical uses. NEUROBOTICS: NEUROBOTICS is a 20042008 6.7 million project under the European SixthFramework Programme focused on basic research fusing neuroscience and robotics to design,develop, and test tele-operated robotic systems to help restore personal autonomy to sensory-motor-disabled persons. CYBERKINETICS:focuses on BCI device manufacturing23 24. NeuroProstheses - Conclusion Cognitive prostheses holds high-level dense cognitive process information thatcan reduce the computational load to control and adapt to BCI devices. Memory prostheses is a very strong point towards mitigating the diseased ordamaged hippocampal cells thus reducing the agitation towards a BCI system Deep-Brain Stimulation DBS treats for cognitive disorders by fixed stimulationsto activate or deactivate certain pathways in specific regions of brain BCI with Neural-prostheses records specific neural activity and enhances thecontrol of intended cognitive state by adapting its feedback Neuroprostheses enables patients to regain control over their brain activity andcan also improve BCI implementation.24