8/9/2019 Portable Camera

1/8

8/9/2019 Portable Camera

2/8

ABSTRACTReading is obviously essential in todays society. Printed

text is everywhere in the form of reports, receipts, bankstatements, restaurant menus, classroom handouts,product packages, instructions on medicine bottles, etc.

We propose a camera-based assistive text readingframework to help blind persons read text labels andproduct packaging from hand-held obects in their dailylives.

!his method extracts moving obect region by a mixture-of-"aussians-based background subtraction method. #nthe extracted R$#, text locali%ation and recognition are

conducted to ac&uire text information.

8/9/2019 Portable Camera

3/8

!o automatically locali%e the text regions fromthe obect R$#, we propose a noveltext

locali%ation algorithm by learning gradientfeatures of stroke orientations and distributionsof edge pixels.

!ext characters in the locali%ed text regions arethen binariesed and recogni%ed by o'-the-shelfoptical character recognition software.

!he system framework consists of threefunctional components( scene capture, dataprocessing, and audio output.

8/9/2019 Portable Camera

4/8

EXISTING SYSTEM

) number of portable reading assistants have beendesigned speci*cally for the visually impaired.

KReader Mobile runs on a cell phone and allows

the user to read mail, receipts, +iers, and manyother documents.

urthermore, KReader Mobile accurately reads

black print on a white background, but hasproblems recogni%ing colored text or text on acolored background.

8/9/2019 Portable Camera

5/8

#t cannot read text with complex backgrounds, textprinted on cylinders with warped or incomplete

images.

Rule-based algorithms apply pixel-level imageprocessing to extract text information from

prede*ned text layouts such as character si%e, aspectratio, edge density, character structure, coloruniformity of text string, etc.

!o assist blind persons to read text from these kindsof hand-held obects, we have conceived of acamera-based assistive text reading framework totrack the obect of interest within the camera view

and extract print text information from the obect.

8/9/2019 Portable Camera

6/8

PROBLEM STATEMENT

!oday, there are already a few systems that havesome promise for portable use, but they cannothandle product labeling.

For example,

Portable bar code readers designed to help blindpeople identify di'erent products in an extensiveproduct database can enable users who are blind toaccess information about these products throughspeech and braille

8/9/2019 Portable Camera

7/8

PROPOSED SYSTEM

) prototype system of assistive text reading the

system framework consists of three functionalcomponents( scene capture, data processing, andaudio output.

cene capture component collects scenescontaining obects of interest in the form ofimages or video.

#n our prototype, it corresponds to a cameraattached With a P/ or 0aptop.

8/9/2019 Portable Camera

8/8

!he data processing component is used for deployingour proposed algorithms, including

12 $bect-of-interest detection to selectively extract theimage of the obect held by the blind user from thecluttered background or other neutral obects in thecamera view3 and

42 !ext locali%ation to obtain image regions containing text,and text recognition to transform image-based textinformation into readable codes.

We use a min laptop as the processing device in ourcurrent prototype system. !he audio output componentis to inform the blind user of recogni%ed text codes.