Post on 23-Feb-2016
description
Senior Thesis ConferenceMarch 27, 2009
Mentors: Prof. Rama Chellappa Prof. Cha-Min Tang
Consultants: Aswin SankaranarayananPavan Turaga
Librarians:Bob KackleyDan Newsome
Discussants: Prof. David JacobsDr. Ashok VeeraraghavanProf. Larry DavisProf. Ankur SrivastavaMr. Bobby Bobo
Team Vision: Steve Caperna, Christopher Cheng, Junghee Cho, Victoria Fan, Avishkar Luthra, Brendan O’Leary, Jansen Sheng, Lee Stearns, Andrew Sun, Roni Tessler, Paul Wong, and Jimmy Yeh
Research Question
How can technology address the needs of the visually impaired?
The White Cane Other Commercial Navigation Solutions
Subjects
Subject Data
– Adaptive Technology Lab at the University of Maryland and the Columbia Lighthouse for the Blind in Riverdale, Maryland
– 24-61 years old– High level of interest in our project – Stressed the importance of having options to navigate more
independently – To be a helpful navigational aid it must be unobtrusive and highly
functional– Focus on Indoor Object Detection and Outdoor Navigation
Object Identification and Location System
Computer Vision
Algorithm
Speech Output
Push-to-TalkVoice Input
Camera
Audio Feedback
ImageDatabase
User Interface
Objects and Landmarks to Identify
An Early Test of Our Vision Algorithm
The SIFT Computer Vision Algorithm
CameraFeed SIFT BBF RANSAC 3D
TransformObject
Location
1 2 3 4 5 6
The Discrete Speech Interface
The Continuous Beacon Interface
Sign Experiment Setup 3D Object Experiment Setup
Locating a Restroom Sign
Locating a Cane
Initial Results:
Discrete Mode:
Average Location Time: 16 sec
Continuous Mode:
Average Location Time: 12 sec
With Consistent Tracking: 5 sec
Door Experiment
CameraFeed SIFT BBF RANSAC 3D
TransformObject
Location
1 2 3 4 5 6
Computer Vision
Algorithm
Speech Output
Push-to-TalkVoice Input
Camera
Audio Feedback
ImageDatabase
User Interface
System Diagram
GPSAlgorithm
Computer Vision
Algorithm
GPS ReceiverInertial Navigation Unit
Speech Output
Push-to-TalkVoice Input
Camera
Audio Feedback
Graph
ImageDatabase
User Interface
System Diagram
GPSAlgorithm
Computer Vision
Algorithm
GPS ReceiverInertial Navigation Unit
Speech Output
Push-to-TalkVoice Input
Camera
Audio Feedback
Graph
ImageDatabase
User Interface
Haptic Feedback
System Diagram
Haptic Feedback Belt
A Complete Navigation System for the Blind
GPSAlgorithm
Computer Vision
Algorithm
GPS ReceiverInertial Navigation Unit
Speech Output
Push-to-TalkVoice Input
Camera
Audio Feedback
Graph
ImageDatabase
User Interface
Haptic Feedback
System Diagram
Objects and Landmarks to Identify
GPS Navigation
SIFT Terminal Navigation
Outdoor Testing
Outdoor Testing
A Complete Navigation System for the Blind
GPSAlgorithm
Computer Vision
Algorithm
GPS ReceiverInertial Navigation Unit
Speech Output
Push-to-TalkVoice Input
Camera
Audio Feedback
Graph
ImageDatabase
User Interface
Haptic Feedback
A Demonstration of Our Object Detection Algorithm
A Demonstration of Our Speech Menu