VR Course PresentationThe Future of VR Input Technologies

By Huang Ting-HaoBy Huang Ting-Hao

2005.6.12005.6.1

OutlineOutline

Unencumbered InputUnencumbered Input New Input DevicesNew Input Devices Direct ConnectionDirect Connection BMI: Brain Machine InterfaceBMI: Brain Machine Interface

A monkey can control a robot !?A monkey can control a robot !?

Subvocal Speech Subvocal Speech

UnencumberedUnencumbered InputInput

To reduce wires used to collect input from To reduce wires used to collect input from participant.participant.

1.Elecromagnetic or Ultrasonic Devices1.Elecromagnetic or Ultrasonic Devices

2.Opticial Tracking Method2.Opticial Tracking Method

3.Opticial Tracking + Computer Vision Algorithms3.Opticial Tracking + Computer Vision Algorithms

New Input DeviceNew Input Device

In the future, there may be input devices In the future, there may be input devices which can change their shape and center of which can change their shape and center of mass to MIMIC their real world counter part.mass to MIMIC their real world counter part.

Direct ConnectionDirect Connection

Originally it is developed for curing Originally it is developed for curing blindness and deafness.blindness and deafness.

One day we will be able to perceive virtual One day we will be able to perceive virtual world directly in the brain.world directly in the brain.

One day it will be true. But how long will it One day it will be true. But how long will it take ?take ?

THE END ?THE END ?

BMI: Brain Machine InterfaceBMI: Brain Machine Interface

The Famous Animation: Ghost In The ShellThe Famous Animation: Ghost In The Shell

A Monkey Can Can Controll A Robot !?A Monkey Can Can Controll A Robot !?

The SensorThe Sensor

More than 100 micro More than 100 micro metal pins are used metal pins are used to record the action to record the action pontential of the pontential of the neurons.neurons.

How It Operates ?How It Operates ?

Telepresence / TeleoperationTelepresence / Teleoperation

Robot_arm.swfRobot_arm.swf

Future Application Of BMIFuture Application Of BMI

Patients can use Patients can use BMI to control BMI to control his/her arm or a his/her arm or a mechanical arm.mechanical arm.

For More InformationsFor More Informations

Auther’s Web Site :Auther’s Web Site :Miguel A. L. NicolelisMiguel A. L. Nicolelishttp://www.nicolelislab.net/NLNet/Load/index.htmhttp://www.nicolelislab.net/NLNet/Load/index.htm

Browse Scientieic American OnlineBrowse Scientieic American OnlineType Type 『隨心而動 意念』『隨心而動 意念』 in Google and you in Google and you will find the article.will find the article.

Subvocal SpeechSubvocal Speech

NASA scientists NASA scientists have begun to have begun to computerize human, computerize human, silent reading using silent reading using nerve signals in the nerve signals in the throat that control throat that control speech.speech.

Subvocal Speech (cont.)Subvocal Speech (cont.)

Scientists "trained" special software to Scientists "trained" special software to recognize six words and 10 digits that the recognize six words and 10 digits that the researchers repeated subvocally.researchers repeated subvocally.

stopstop 、、 gogo 、、 leftleft 、、 rightright 、、 alphaalpha 、、 omegaomega、、 0~90~9

Initial word recognition results were an Initial word recognition results were an average of 92 percent accurate.average of 92 percent accurate.

Subvocal Speech (cont.)Subvocal Speech (cont.)

With this technology, one can:With this technology, one can:1.Control a machine by subvocal commands1.Control a machine by subvocal commands

2.People in noisy conditions could use the 2.People in noisy conditions could use the system when privacy is needed, such as system when privacy is needed, such as during telephone conversations on buses or during telephone conversations on buses or trainstrains

3.Free your mind and create one!3.Free your mind and create one!

Subvocal Speech (cont.)Subvocal Speech (cont.)

Trend Toward Unencumbered Input DeviceTrend Toward Unencumbered Input DeviceScientists are testing new, "noncontact" sensors Scientists are testing new, "noncontact" sensors that can read muscle signals even through a layer that can read muscle signals even through a layer of clothing.of clothing.

For More InformationsFor More Informations

NASA Web Site:NASA Web Site:http://www.nasa.gov/home/hqnews/2004/mar/HQ_04093_subvocal_speech.htmlhttp://www.nasa.gov/home/hqnews/2004/mar/HQ_04093_subvocal_speech.html

http://www.nasa.gov/centers/ames/news/releases/2004/subvocal/subvocal.htmlhttp://www.nasa.gov/centers/ames/news/releases/2004/subvocal/subvocal.html

THE ENDTHE ENDThank for your participation !Thank for your participation !