Chapter2 Eye

download Chapter2 Eye

of 38

Transcript of Chapter2 Eye

  • 8/8/2019 Chapter2 Eye

    1/38

    ImageProcessingImageProcessingDigitalImageFundamentalsDigitalImageFundamentals

    apterapterProf.Vidya Manian

    Dept.of

    Electrical

    and

    Comptuer Engineering

    INEL5327(Spring2009) Introduction 1ECE,UPRM

  • 8/8/2019 Chapter2 Eye

    2/38

    Light

    Imagingsensors

    Imagesampling

    and

    intensity

    quantization

    Pixelrelationships

    INEL5327(Spring2009) ECE,UPRM 2

  • 8/8/2019 Chapter2 Eye

    3/38

    INEL5327(Spring2009) ECE,UPRM 3

  • 8/8/2019 Chapter2 Eye

    4/38

    Retinainnermostmembraneofeye

    Lightreceptors

    are

    cones

    and

    rods

    Conessensitivetocolor(photopic orbrightlight

    Rodssensitivetolowlevelsofillumination(scotopic or

    dimllight vision)

    Foveasquaresensorarrayof1.5mmx1.5mm

    Densityis150,000elements/mm2

    ,

    comparedtocurrentelectronicimagingsensor(CCDarray)of5mmx5mm

    INEL5327(Spring2009) ECE,UPRM 4

  • 8/8/2019 Chapter2 Eye

    5/38

    INEL5327(Spring2009) ECE,UPRM 5

  • 8/8/2019 Chapter2 Eye

    6/38

    Theshapeofthelensisadjustedforfocusingonnearordistantobject

    Contrarytophotographiccamerawherelenshasa

    Focallengthofeye=17mm

    h=15

    m

    height

    of

    the

    object,

    distance

    of

    person

    from

    o ect= m

    15/100=h/17,h=2.55mm

    Perceptionexcitationoflightreceptors,signalspassedtothebrainwheretheyaredecoded(V1,ITandPFC)

    INEL5327(Spring2009) ECE,UPRM 6

  • 8/8/2019 Chapter2 Eye

    7/38

    INEL5327(Spring2009) ECE,UPRM 7

  • 8/8/2019 Chapter2 Eye

    8/38

    Sub ectivebri htness lo arithmicfunctionof

    the

    light

    intensity

    incident

    on

    the

    eye Rangeofintensities 106

    Currentsensitivitylevel brightnessadaptationlevel(Ba)

    ,

    WhenIisstrongenough,thesubjectwillres ond es

    Weberratio

    :c/I

    increment

    of

    illumination

    discriminable

    INEL5327(Spring2009) ECE,UPRM 8

  • 8/8/2019 Chapter2 Eye

    9/38

    INEL5327(Spring2009) ECE,UPRM 9

  • 8/8/2019 Chapter2 Eye

    10/38

    Highlevels

    of

    illumination

    by

    cones

    Perceive rig tnessisnotasimp e unction

    ofintensity

    HVSundershootsorovershootsaroundthe

    boundaryofregionsofdifferentintensities

    Machbands

    scalloped

    intensities

    INEL5327(Spring2009) ECE,UPRM 10

  • 8/8/2019 Chapter2 Eye

    11/38

    INEL5327(Spring2009) ECE,UPRM 11

  • 8/8/2019 Chapter2 Eye

    12/38

    Simultaneouscontrast

    INEL5327(Spring2009) ECE,UPRM 12

  • 8/8/2019 Chapter2 Eye

    13/38

    INEL5327(Spring2009) ECE,UPRM 13

  • 8/8/2019 Chapter2 Eye

    14/38

    RadiowavesWavelen thslon erthanvisible

    light Gammarayswavelengthssmallthanvisiblelight

    =c ;wavelength(m),frequency,cspeedoflight

    , Electromagneticwavesstreamofmassless

    articleswithener movin ats eedofli ht

    Higherfrequency

    (shorter

    wavelength)

    carry

    moreenergyperphoton

    INEL5327(Spring2009) ECE,UPRM 14

  • 8/8/2019 Chapter2 Eye

    15/38

    INEL5327(Spring2009) ECE,UPRM 15

  • 8/8/2019 Chapter2 Eye

    16/38

    Electroma neticWavelen th

    Li ht

  • 8/8/2019 Chapter2 Eye

    17/38

    Electromagneticspectrumsensedbythehuman

    Visible(0.43m)

    to

    red

    (0.79

    m)

    Whitecolorob ectthatreflectsli htbalancedinallvisiblewavelengths

    Greenobjects

    reflect

    wavelengths

    in

    500

    570

    ,

    Monochromatic(achromatic) lightwithoutcolor

    Intensity

    denotedby

    gray

    levels

    Gra scale ran eofmeasuredvaluesofmonochromaticlightfromblacktowhite

    INEL5327(Spring2009) ECE,UPRM 17

  • 8/8/2019 Chapter2 Eye

    18/38

    L ( ) =

    Object

  • 8/8/2019 Chapter2 Eye

    19/38

    fromthe

    light

    source

    (Watts)

    observer,lumens(lm)

    Brig tness:su jective escriptoro ig t

    perception

    Infraredband

    radiates

    heat

    useful

    in

    imaging

    applicationsthatrelyonheatsignatures

    INEL5327(Spring2009) ECE,UPRM 19

  • 8/8/2019 Chapter2 Eye

    20/38

    onthe

    size

    of

    the

    object

    ,

    10m

    Hence,sourcetostu ywaternee semitting

    infarUVorsoftXrayregion

    Imagegeneration

    INEL5327(Spring2009) ECE,UPRM 20

  • 8/8/2019 Chapter2 Eye

    21/38

    absorptionof

    energy

    by

    elements

    of

    the

    scene

    , , ,

    Objects:

    real

    world,

    molecules,

    cells,

    biological Incomingenergyistransformedtoavoltage

    bycombinationofelectricalpowerandsensor

    material

    Theout utvolta ewaveformisdi itized

    INEL5327(Spring2009) ECE,UPRM 21

  • 8/8/2019 Chapter2 Eye

    22/38

    INEL5327(Spring2009) ECE,UPRM 22

  • 8/8/2019 Chapter2 Eye

    23/38

    voltageproportional

    to

    light

    For

    2

    D

    imaging:

    lead

    screw

    rovides

    motion

    in

    perpen icu ar irection

    Microdensitometers:sensorsmovingintwo

    lineardirections

    INEL5327(Spring2009) ECE,UPRM 23

  • 8/8/2019 Chapter2 Eye

    24/38

    SingleSensorwithmotiontogenerate

    2D

    image

    INEL5327(Spring2009) ECE,UPRM 24

  • 8/8/2019 Chapter2 Eye

    25/38

    Perpendicularmotion

    provides

    imaging

    in

    4000inlinesensors:airborneimaging

    a lication 1Dimagingsensorstripsmounted

    er endicular to direction of fli ht

    Lensesareusedforfocusingareatobescanned on to sensor

    INEL5327(Spring2009) ECE,UPRM 25

  • 8/8/2019 Chapter2 Eye

    26/38

    Linearsensorstripandcircularsensor

    strip

    INEL5327(Spring2009) ECE,UPRM 26

  • 8/8/2019 Chapter2 Eye

    27/38

    Rin confi urationusedinmedicalandindustrial

    imaging:crosssection (slice

    of

    3D

    objects)

    IlluminationbyrotatingXraysource,s ensoroppositecolects Xrayenergythatpassesthrough

    the

    object. CAT:Computerizedaxialtomography

    Requireextensiveprocessingofthe3Ddigital

    vo umeo

    s ac e

    mages

    MRI,PET(PositronEmissionTomography)

    INEL5327(Spring2009) ECE,UPRM 27

  • 8/8/2019 Chapter2 Eye

    28/38

    Electroma neticandultrasonicsensin devices

    havesensors

    in

    2D

    array

    Digitalcamera: CCDarray(4000x4000elements)

    Completeimageisobtainedbyfocusingenergy

    patternon

    surface

    of

    array

    Forlightillumination,opticallensprojectstheviewedsceneonlensfocalplane

    Outputis

    integral

    of

    light

    received

    at

    each

    sensor

    Digitizedbyothersectionofimagingsystem

    INEL5327(Spring2009) ECE,UPRM 28

  • 8/8/2019 Chapter2 Eye

    29/38

    Imageacquisitionprocess

    INEL5327

    (Spring

    2009) ECE,

    UPRM 29

  • 8/8/2019 Chapter2 Eye

    30/38

    CurrentstateoftheartinHuman

    Visual

    Perception

    and

    Digital

    Perce tualModels

    Supplementmaterialforreading

    INEL5327

    (Spring

    2009) ECE,

    UPRM 30

  • 8/8/2019 Chapter2 Eye

    31/38

    HumanVisualPerception

    A

    summary

    TheHVShasahierarchicalorganization withgradualincreaseinnvar ancean comp ex yo es mu a ong ev sua s ream.

    Earlyor

    low

    level

    processing

    occurs

    in

    retina,

    Lateral

    Geniculate

    Nucleus(LGN)andprimaryvisualcortex(V1)cells. Forexample,.

    V1,fromV2toV4cellsareresponsivetocomplexfeaturesoftheobject.

    InInterotemporal (IT) cortex

    cells

    are

    selective

    to

    color,

    orientation

    texture,pose,illumination,directionofmotionandshapetuning.InAnteriorInterotemporal cortex(AIT)cellsaretunedtobodypartssuchasfacesandhands. InvariantrecognitiontakesplaceinIT.

    ,performed

    based

    on

    learning

    the

    target

    object

    from

    previous

    layers

    inthehierarchy.Thislayerperformsimmediaterecognition,identificationandcategorization(classification).

    INEL5327

    (Spring

    2009) ECE,

    UPRM 31

  • 8/8/2019 Chapter2 Eye

    32/38

    INEL5327

    (Spring

    2009) ECE,

    UPRM 32

  • 8/8/2019 Chapter2 Eye

    33/38

    INEL5327

    (Spring

    2009) ECE,

    UPRM 33

  • 8/8/2019 Chapter2 Eye

    34/38

    Recentadvancesinmodelingof

    Humanvisual

    perception

    T.Serre,Learningadictionaryofshapecomponentsinvisualcortex:comparisonwithneurons,humansand

    machines,PhD

    Thesis,

    MIT,

    2000.

    R.Raizada andS.Grossberg,ContextsensitivebindingsbythelaminarcircuitsofV1andV2:Aunifiedmodelofperceptualgrouping,attention,andorientationcontrast,

    Vis.Cognition,Vol.8,pp.431466,2001. M.Riesenhuber andT.Poggio,Neuralmechanismsof

    objectrecognition,Neurobiology,Vol.12,pp162168,2002.

    R.

    P.

    N.

    Rao,

    Brain:

    the

    next

    generation,

    MIT

    Press,

    Cambridge,Mass.,2002.

    INEL5327

    (Spring

    2009) ECE,

    UPRM 34

  • 8/8/2019 Chapter2 Eye

    35/38

    T.Serre,Learningadictionaryofshapecomponentsinvisualcortex:comparisonwithneurons,humansand

    machines,PhD

    Thesis,

    MIT,

    2000.

    R.Raizada andS.Grossberg,ContextsensitivebindingsbythelaminarcircuitsofV1andV2:Aunifiedmodelofperceptualgrouping,attention,andorientationcontrast,

    Vis.Cognition,Vol.8,pp.431466,2001. M.Riesenhuber andT.Poggio,Neuralmechanismsof

    objectrecognition,Neurobiology,Vol.12,pp162168,2002.

    R.P.

    N.

    Rao,

    Brain:

    the

    next

    generation,

    MIT

    Press,

    Cambridge,Mass.,2002.

    INEL5327

    (Spring

    2009) ECE,

    UPRM 35

  • 8/8/2019 Chapter2 Eye

    36/38

    When ouenteradarktheateronabri htda it

    takes

    an

    appreciable

    interval

    of

    time

    before

    you

    canseewellenoughtofindanemptyseat.Whichofthevisualprocessesexplainedisatplayinthissituation?

    erna ngcurren cer a n y spar o eelectromagneticspectrum.CommercialACinthe

    wavelengthin

    kilometers

    of

    this

    component

    of

    thespectrum.

    INEL5327

    (Spring

    2009) ECE,

    UPRM 36

  • 8/8/2019 Chapter2 Eye

    37/38

    perceptionand

    perceptual

    model

    for

    image

    classon23January2009.

    INEL5327

    (Spring

    2009) ECE,

    UPRM 37

  • 8/8/2019 Chapter2 Eye

    38/38