InTech-Segmenting the License Plate Region Using a Color Model
-
Upload
tariqyousaf6299 -
Category
Documents
-
view
219 -
download
0
Transcript of InTech-Segmenting the License Plate Region Using a Color Model
-
8/2/2019 InTech-Segmenting the License Plate Region Using a Color Model
1/18
5GIOGPVKPIVJG.KEGPUG2NCVG4GIKQP7UKPIC%QNQT/QFGN
:
5GIOGPVKPIVJG.KEGPUG2NCVG4GIKQP7UKPIC%QNQT/QFGN
.DXVKLN'HEDQG.DQJ+\XQ-R
8QLYHUVLW\RI8OVDQ6RXWK.RUHD
+PVTQFWEVKQP
+XPDQV FDQ SHUIRUP XVXDO WDUJHW UHFRJQLWLRQ ZLWKRXW WRR PXFK HIIRUW +RZHYHU E\FRPSXWHUWKHWDVNRIUHFRJQL]LQJVSHFLILFREMHFWLQDQLPDJHRQHRIWKHPRVWGLIILFXOWWRSLFVLQWKHILHOGRIFRPSXWHUYLVLRQRUGLJLWDOLPDJHSURFHVVLQJ9HKLFOHOLFHQVHSODWHGHWHFWLRQ9/3'WDVNLVTXLWHFKDOOHQJLQJIURPYHKLFOHLPDJHVGXHWRWKHPXOWLVW\OHSODWHIRUPDWVYLHZ SRLQW FKDQJHV DQG WKH QRQXQLIRUP RXWGRRU LOOXPLQDWLRQ FRQGLWLRQV GXULQJ LPDJHDFTXLVLWLRQ$QDJQRVWRSRXORVHWDO DQG-LDRHWDO,QDGGLWLRQ9/3'V\VWHPVKRXOG RSHUDWH IDVW HQRXJK UHDO WLPH WR VDWLVI\ WKH QHHGV RI LQWHOOLJHQW WUDQVSRUWDWLRQV\VWHPV,76VDQGQRWWRPLVVDVLQJOHLQWHUHVWREMHFWIURPWKHYHKLFOHLPDJH9/3'LVDOVRYHU\LQWHUHVWLQJLQILQGLQJOLFHQVHSODWHDUHDIURPYHKLFOHLPDJH7KH9/3'LVZLGHO\XVHG
IRUGHWHFWLQJVSHHGLQJFDUVVHFXULW\FRQWUROLQUHVWULFWHGDUHDVLQXQDWWHQGHGSDUNLQJ]RQHVIRUWUDIILFODZHQIRUFHPHQWDQGHOHFWURQLFWROOFROOHFWLRQHWF:LWKWKHUDSLGGHYHORSPHQWRIKLJKZD\DQGWKHZLGHXVHRIYHKLFOHVSHRSOHKDYHVWDUWHGWRSD\PRUHDQGPRUHDWWHQWLRQWRWKHDGYDQFHGHIILFLHQWDQGDFFXUDWH,76V5HFHQWO\WKHQHFHVVLW\RIYHKLFOHOLFHQVHSODWHUHFRJQLWLRQ9/35KDVLQFUHDVHGVLJQLILFDQWO\7KHOLFHQVHSODWHGHWHFWLRQLVDFUXFLDODQGLQGLVSHQVDEOHFRPSRQHQW RI9/35V\VWHP2QH RI WKH PDMRUSUREOHPV LQ/3 GHWHFWLRQ LVGHWHUPLQLQJ /3 V\VWHPV 7KLV V\VWHP PXVW JXDUDQWHH UREXVW GHWHFWLRQ XQGHU YDULRXVZHDWKHUDQGOLJKWLQJFRQGLWLRQVLQGHSHQGHQWRIRULHQWDWLRQDQGVFDOHRIWKHSODWH,Q WKH UHFHQW \HDUV GHYHORSPHQWV GHDOLQJ ZLWK VLPSOH LPDJHV KDYH EHHQ DFKLHYHG ZLWKDFFHSWDEOHUHVXOWV+RZHYHUUHFHQWUHVHDUFKHVKDYHEHHQDGGUHVVHGWRSURFHVVLQJFRPSOH[LPDJHVZLWKXQFRQVWUDLQHGFRQGLWLRQV 0DWDV7KH SURSRVHGOLFHQVHSODWHGHWHFWLRQ
IUDPHZRUNGHDOVZLWKVXFKYHKLFOHLPDJHV,QWKLVSURSRVHG9/3'PHWKRGFRQVLVWVRIWZRPDLQVWDJHV,QLWLDOO\+6,FRORUPRGHOLVDGRSWHGIRUGHWHFWLQJFDQGLGDWHUHJLRQV$FFRUGLQJWRGLIIHUHQWFRORUHG/3WKHVHFDQGLGDWHUHJLRQV PD\ LQFOXGH /3 UHJLRQV JHRPHWULFDO SURSHUWLHV RI /3 DUH WKHQ XVHG IRUFODVVLILFDWLRQ 7KH SURSRVHG PHWKRG LV DEOH WR GHDO ZLWK FDQGLGDWH UHJLRQV XQGHULQGHSHQGHQWRULHQWDWLRQDQGVFDOHRIWKHSODWH0RUHWKDQRQHOLFHQVHSODWHFDQEHGHWHFWHGLQWKHVDPHLPDJH)LQDOO\WKHGHFRPSRVLWLRQRIFDQGLGDWHUHJLRQVFRQWDLQSUHGHWHUPLQHG/3DOSKDQXPHULFFKDUDFWHUVE\XVLQJSRVLWLRQLQWKHKLVWRJUDPWRYHULI\DQGGHWHFWYHKLFOHOLFHQVHSODWHUHJLRQ
-
8/2/2019 InTech-Segmenting the License Plate Region Using a Color Model
2/18
2CVVGTP4GEQIPKVKQP
7KHIRFXVRIWKLVFKDSWHULVRQWKHFRQVROLGDWLRQRIDQHZPHWKRGWRVHOHFWDXWRPDWLFDOO\VWDWLVWLFDOWKUHVKROGYDOXHLQ+6,FRORUPRGHOIRUGHWHFWLQJFDQGLGDWHUHJLRQV*HQHUDOO\DVDFRPPRQ ZD\ RIFRORUEDVHG9/3' V\VWHP WKUHVKROG YDOXH LVGHILQHG E\SUHGHWHUPLQHG
FRHIILFLHQWV RU E\ XVHU ,W SURYLGHV VWDEOH UHVXOW EXW LQ SRRU OLJKWLQJ FRQGLWLRQ LW LV WRRVHQVLWLYH:KHUHDVLQRXUH[SHULPHQWVZHFDOFXODWHWKUHVKROGYDOXHLQDVWDWLVWLFDOZD\RIVDPSOHGDWDRQO\JUHHQ\HOORZDQGZKLWH/3DUHDVDUHUDQGRPO\VHOHFWHGIRUWUDLQLQJ$IWHUWUDLQLQJIURPWKRVHVDPSOHGDWDWKHPHDQDQGVWDQGDUGGHYLDWLRQYDOXHVRI KXHDUHFRPSXWHGIRUGHWHFWLRQRIJUHHQDQG\HOORZ/3SL[HOV'HWHFWLQJZKLWHOLFHQVHSODWHSL[HOVWKHPHDQDQGVWDQGDUGGHYLDWLRQYDOXHVRIVDWXUDWLRQDQGLQWHQVLW\DUHFRPSXWHGWRGHWHFWJUHHQ\HOORZDQGZKLWH/3IURPYHKLFOHLPDJHV,Q DGGLWLRQ WKH SURSRVHG PHWKRG LV DEOH WR GHDO ZLWK SODWHV FDQGLGDWH UHJLRQV XQGHULQGHSHQGHQWRULHQWDWLRQDQGVFDOHRIWKHSODWH0RUHWKDQRQHOLFHQVHSODWHFDQEHGHWHFWHGLQ WKH VDPH LPDJH )XUWKHUPRUH FDQGLGDWH UHJLRQV PD\ LQFOXGH /3UHJLRQVJHRPHWULFDOSURSHUWLHV RI /3 DUH WKHQ XVHG IRU FODVVLILFDWLRQ )LQDOO\ WKH GHFRPSRVLQJ RI FDQGLGDWH
UHJLRQZKLFKFRQWDLQVSUHGHWHUPLQHG/3 DOSKDQXPHULFFKDUDFWHUE\XVLQJSRVLWLRQ LQWKHKLVWRJUDPWRYHULI\DQGGHWHFWYHKLFOHOLFHQVHSODWHUHJLRQLVSHUIRUPHG
4GNGXCPVYQTM
7KLVVHFWLRQSURYLGHVDGHVFULSWLYHVXPPDU\RIVRPHPHWKRGVWKDWKDYHEHHQLPSOHPHQWHGDQGWHVWHGIRU9/3'$VIDUDVGHWHFWLRQRIWKHSODWHUHJLRQLVFRQFHUQHGUHVHDUFKHUVKDYHIRXQGPDQ\PHWKRGVRIORFDWLQJOLFHQVHSODWH)RUH[DPSOHVXUYH\SDSHU$QDJQRVWRSRXORVHW DO RIIHUV WR UHVHDUFKHUVD OLQN WRD SXEOLF LPDJH GDWDEDVH WRGHILQH D FRPPRQUHIHUHQFHSRLQWIRU9/35DOJRULWKPLFDVVHVVPHQW,QDGGLWLRQWKLVVXUYH\SDSHUGLVFXVVHVDERXWFXUUHQWWUHQGVDQGDQWLFLSDWHGUHVHDUFKLQ9/35V\VWHP,Q$QDJQRVWRSRXORVHWDO
DPHWKRGEDVHGRQLPDJHVHJPHQWDWLRQWHFKQLTXHQDPHGDVVOLGLQJZLQGRZV6:KDV DOVR EHHQ SURSRVHG IRU GHWHFWLQJ FDQGLGDWH UHJLRQ /3 UHJLRQ 7KH PDLQ WKRXJKW RILPDJHVHJPHQWDWLRQ WHFKQLTXH LQ/3 FDQ EHYLHZHG DVLUUHJXODULWLHV LQWKH WH[WXUH RI WKHLPDJH DQG WKHUHIRUH DEUXSW FKDQJHV LQ WKH ORFDO FKDUDFWHULVWLFV RI WKH LPDJH PDQLIHVWSUREDEO\WKHSUHVHQFHRIDQ/3$FRQYHQWLRQDOVWDWLVWLFDOFODVVLILHUEDVHGRQWKHNQHDUHVWQHLJKERUUXOH LVXVHGWRFODVVLI\HYHU\ SL[HORI D WHVW LPDJHWRREWDLQ DSL[HOPDSZKHUHJURXSRISRVLWLYHVDPSOHVSUREDEO\LQGLFDWHVWKHORFDWLRQRIDOLFHQVHSODWH,QWKLVV\VWHPWLPHFRQVXPLQJ WH[WXUH DQDO\VLV LV SUHVHQWHG LQ &DQR 3HUH]&RUWHV ZKHUH DFRPELQDWLRQ RI D NGWUHH GDWD VWUXFWXUH DQG DQ DSSUR[LPDWH QHDUHVW QHLJKERU ZDVHVSRXVHG7KHFRPSXWDWLRQDOUHVRXUFHGHPDQGRIWKLVVHJPHQWDWLRQWHFKQLTXHLVWKHPDLQGUDZEDFN WDNLQJ DQ DYHUDJH RI VHFRQGV WR SURFHVV RI VLQJOH LPDJH ,Q &KDFRQ
=LPPHUPDQ WKH SXOVHFRXSOHG QHXUDO QHWZRUN 3&11 LV SURSRVHG WR JHQHUDWHFDQGLGDWHUHJLRQVWKDWPD\FRQWDLQDOLFHQVHSODWH,IWKHOLFHQVHSODWHLVQRWORFDWHGLQWKHVHWRIFDQGLGDWHUHJLRQV WKH3&11QHWZRUNSDUDPHWHUVDUHDGMXVWHGWRJHQHUDWHQHZUHJLRQVIRU/3LGHQWLILFDWLRQ)X]]\ORJLFKDVEHHQDSSOLHGLQGHWHFWLQJOLFHQVHSODWHV$XWKRUVPDGHVRPHLQWXLWLYHUXOHVWR GHVFULEH WKH OLFHQVH SODWHV DQG JDYH VRPH PHPEHUVKLS IXQFWLRQV IRU IX]]\ VHWV HJEULJKWGDUNEULJKWDQGGDUNVHTXHQFHWH[WXUH\HOORZQHVVWRJHWWKHKRUL]RQWDODQGYHUWLFDOSODWH SRVLWLRQV &KDQJHWDO $ WHFKQLTXHEDVHG RQH[WUDFWVFDQGLGDWHUHJLRQVE\ILQGLQJYHUWLFDODQGKRUL]RQWDOHGJHVIURPYHKLFOHUHJLRQKDGDOVREHHQSURSRVHGDQG WKLV VHJPHQWDWLRQ PHWKRG LV QDPHG DV VOLGLQJ FRQFHQWULF ZLQGRZV )LQDOO\ YHKLFOH
-
8/2/2019 InTech-Segmenting the License Plate Region Using a Color Model
3/18
5GIOGPVKPIVJG.KEGPUG2NCVG4GIKQP7UKPIC%QNQT/QFGN
OLFHQVH SODWH LV YHULILHG DQG GHWHFWHG E\ XVLQJ +6, FRORU PRGHO DQG SRVLWLRQ KLVWRJUDPUHVSHFWLYHO\ LQ 'HE HWDO D3ULRUNQRZOHGJH RI/3DQG FRORUFROORFDWLRQKDV EHHQXVHGWR ORFDWH WKH OLFHQVHSODWH LQWKHLPDJH*DRHW DO DVSDUWRIWKHSURFHGXUH RI
ORFDWLRQ DQG VHJPHQWDWLRQ ,Q +RQJOLDQJ &KDQJSLQJ D K\EULG OLFHQVH SODWHORFDOL]DWLRQ DOJRULWKP EDVHG RQ WKH HGJH VWDWLVWLFV DQG PRUSKRORJ\ IRU PRQLWRULQJ WKHKLJKZD\ WLFNHWLQJ V\VWHP LVSURSRVHG 7KLV WHFKQLTXH FDQ EH GLYLGHG LQWR IRXU VHFWLRQVZKLFKDUHYHUWLFDOHGJHGHWHFWLRQHGJHVWDWLVWLFDODQDO\VLVKLHUDUFKLFDOEDVHGOLFHQVHSODWHORFDWLRQDQGPRUSKRORJ\EDVHGOLFHQVHSODWHH[WUDFWLRQ7KHDYHUDJHDFFXUDF\RIORFDWLQJOLFHQVHSODWHLVDQLPSUHVVLYHUDWHRI+RZHYHULQSXWLPDJHVZHUHDFTXLUHGIURPDIL[HG GLVWDQFH DQG YLHZ SRLQW DQG WKHUHIRUH FDQGLGDWH UHJLRQV LQ D VSHFLILF SRVLWLRQDUHGHYRWHSULRULW\DVDOUHDG\GHSLFWHG7KHOLFHQVHSODWHORFDWLRQVLQLPDJHVDUHLGHQWLILHGE\PHDQV RI LQWHJUDWHG KRUL]RQWDO DQG YHUWLFDO SURMHFWLRQV WKDW DUH VFDQQHG XVLQJ D VHDUFKZLQGRZ+XDQJHWDO0RUHRYHUDFKDUDFWHUUHFRYHU\PHWKRGLVH[SORLWHGWRHQKDQFHWKHVXFFHVVUDWH$UHJLRQEDVHGOLFHQVHSODWHGHWHFWLRQPHWKRGKDVEHHQSUHVHQWHGLQ-LDHW
DOZKLFKILUVWO\DSSOLHVDPHDQVKLIWSURFHGXUHLQVSDWLDOUDQJHGRPDLQWRVHJPHQWDFRORUYHKLFOHLPDJHLQRUGHUWRJHWFDQGLGDWHUHJLRQV$FFRUGLQJWRWKHVWDWLVWLFDODQDO\VLVSHUIRUPHG IRU FRPSDULVRQ WR RWKHU /3 OLNH REMHFWV /3V DGKHUH WR D XQLTXH IHDWXUHFRPELQDWLRQRIUHFWDQJXODULW\DVSHFWUDWLRDQGHGJHGHQVLW\7KHVHWKUHHIHDWXUHVZHUHWKHQHVWLPDWHGWR FDQGLGDWHUHJLRQVWR GHFLGH ZKHWKHU WKHVH UHJLRQV LQWHUSUHWDQ/3RUQRW $XVXDOIDLOXUHRIWKLVPHWKRGLVWKHIDLOXUHWRGHWHFWOLFHQVHSODWHVZKHQYHKLFOHERGLHVDQGWKHLU OLFHQVH SODWH KDYH VLPLODU FRORUV ,Q -LDR HW DO D PHWKRG IRU PXOWLVW\OH /3UHFRJQLWLRQ KDV EHHQ SUHVHQWHG 7KLV PHWKRG KDV LQWURGXFHG WKH GHQVLW\EDVHG UHJLRQJURZLQJ DOJRULWKP IRU /3 ORFDWLRQ WKH VNHZ UHILQHPHQW DOJRULWKP WKH PXOWLOLQH /3VHSDUDWLRQ DOJRULWKP WKH RSWLPL]HG FKDUDFWHU VHJPHQWDWLRQ DOJRULWKP DQG WUDLQDEOHFKDUDFWHU UHFRJQLWLRQ PHWKRG IRU FKDUDFWHU UHFRJQLWLRQ +RXJK 7UDQVIRUP +7 IRU OLQH
GHWHFWLRQ KDV EHHQ SURSRVHGRQ WKH DVVXPSWLRQ WKDW WKH VKDSHRI OLFHQVH SODWHKDV EHHQGHILQHGE\OLQHVLQ.DPDW*DQVHQ$ PRGLILHG FRORU WH[WXUHEDVHG PHWKRG IRU GHWHFWLQJ OLFHQVH SODWH LQ LPDJHV KDV EHHQSUHVHQWHGLQ.LPHWDO$VXSSRUWYHFWRUPDFKLQH690KDVEHHQXVHGWRDQDO\]HWKH FRORU DQG WH[WXUH SURSHUWLHV RI/3V DQG WR ORFDWH WKHLUERXQGLQJ ER[HVDSSOLHG E\ DFRQWLQXRXVDGDSWLYHPHDQVKLIWDOJRULWKP &$06KLIW7KHFRPELQDWLRQRI&$06KLIWDQG690V SURGXFHV HIILFLHQW /3 GHWHFWLRQ DV WLPHFRQVXPLQJ FRORU WH[WXUH DQDO\VLV IRU OHVVUHOHYDQWSL[HOVLVUHVWULFWHGOHDYLQJRQO\DVPDOOSDUWRIWKHLQSXWLPDJHWREHDQDO\]HG,QDGGLWLRQ ILQGLQJ FDQGLGDWH DUHDV E\ XVLQJ JUDGLHQW LQIRUPDWLRQ LW KDV EHHQ YHULILHGZKHWKHULWFRQWDLQVWKHSODWHDUHDDPRQJWKHFDQGLGDWHVDQGDGMXVWLQJWKHERXQGDU\RIWKHDUHD E\ LQWURGXFLQJ D WHPSODWH RI WKH /3 LQ .LP HW DO 2WKHU DSSURDFKHV XVLQJ
PDWKHPDWLFDOPRUSKRORJ\PHWKRGWRGHWHFWOLFHQVHSODWHDUHD0DUWLQHWDODQGDQDSSURDFKIRUVHJPHQWDWLRQRIYHKLFOHSODWHVVXFKDVHGJHLPDJHLPSURYHPHQWWRGHWHFWDQXPEHURIFDUSODWHVLQ0LQJHWDOKDYHDOVREHHQSURSRVHG7KHSURSRVHGPHWKRGLQ1RPXUDHWDO LV FRPPLWWHG WRWKH WDVNRIFKDUDFWHU VHJPHQWDWLRQGHVFULELQJ DPRUSKRORJ\EDVHGDGDSWLYHDSSURDFKIRUGHJUDGHGSODWHLPDJHV0RUHRYHUDVVXPLQJWKDW/3UHJLRQVDUHGHWHFWDEOHHYHQLQQRLV\ORZUHVROXWLRQSUHVHQWHGDUREXVW VXSHUUHVROXWLRQ DOJRULWKP IRU YLGHR VHTXHQFHV 6XUHVK HW DO KDV EHHQSURSRVHGWRHQKDQFHWKH/3WH[WRIPRYLQJYHKLFOHVZLWKSURPLVLQJUHVXOWV,Q:DQJHWDO D FDVFDGH IUDPHZRUN XWLOL]LQJ SODWH FKDUDFWHULVWLFV DQG GHYHORSLQJ IDVW RQH SDVVDOJRULWKPVKDVEHHQXVHGIRUDUHDOWLPHSODWHUHFRJQLWLRQV\VWHP
-
8/2/2019 InTech-Segmenting the License Plate Region Using a Color Model
4/18
2CVVGTP4GEQIPKVKQP
&XUUHQWO\ VRPH UHVHDUFKHUV SUHIHU D K\EULG GHWHFWLRQ DOJRULWKP ZKHUH OLFHQVH SODWHORFDWLRQPHWKRGEDVHGRQFRUQHUGHWHFWLRQHGJHGHWHFWLRQFKDUDFWHULVWLFVRIOLFHQVHVKDSHFKDUDFWHUVFRQQHFWLRQDQGSURMHFWLRQKDVEHHQSUHVHQWHGLQ;X=KX=KDQJHWDO
DQG
-
8/2/2019 InTech-Segmenting the License Plate Region Using a Color Model
5/18
5GIOGPVKPIVJG.KEGPUG2NCVG4GIKQP7UKPIC%QNQT/QFGN
DOSKDQXPHULFFKDUDFWHUVZULWWHQLQDVLQJOHOLQHDQGDQRWKHUW\SHRI\HOORZ/3LVIRXQGWKDWFRQWDLQ.RUHDQ/3LQWZRURZV7KHXSSHUURZFRQVLVWVRIWZRVPDOO.RUHDQFKDUDFWHUVRIUHJLRQ QDPH IROORZHGE\ RQHRUWZRQXPEHUVRIFODVV FRGH7KH ORZHUURZFRQWDLQV RQH
.RUHDQ FKDUDFWHU DQG IRXU ELJ QXPEHUV WR LQGLFDWH WKH XVDJH DQG VHULDO QXPEHUUHVSHFWLYHO\
9HKLFOHW\SH 3ODWHFRORU &KDUDFWHUFRORU
3ULYDWHDXWRPRELOH:KLWH %ODFN
*UHHQ :KLWH
7D[LWUXFNDQGEXV
-
8/2/2019 InTech-Segmenting the License Plate Region Using a Color Model
6/18
2CVVGTP4GEQIPKVKQP
DOSKDQXPHULF FKDUDFWHU E\ XVLQJ SRVLWLRQ LQ WKH KLVWRJUDP WR YHULI\ DQG GHWHFW YHKLFOHOLFHQVHSODWH9/3UHJLRQ
)LJ9HKLFOHOLFHQVHSODWHGHWHFWLRQIUDPHZRUN
5GIOGPVKPIEQNQT,QWKHSURSRVHGPHWKRGLQSXWYHKLFOHLPDJHVDUHFRQYHUWHGLQWR+6,FRORULPDJHV7KHQWKHFDQGLGDWHUHJLRQVDUHIRXQGE\XVLQJ+6,FRORUPRGHORQWKHEDVLVRIXVLQJKXHVDWXUDWLRQDQGRULQWHQVLW\0DQ\DSSOLFDWLRQVXVHWKH+6,FRORUPRGHO0DFKLQHYLVLRQXVHV+6,FRORUVSDFHLQLGHQWLI\LQJWKHFRORURIGLIIHUHQWREMHFWV7KH5*%FRORUPRGHOFRQVLVWVRIWKHWKUHHDGGLWLYHSULPDULHVUHGJUHHQDQGEOXH6SHFWUDOFRPSRQHQWVRIWKHVHFRORUVFRPELQHDGGLWLYHO\WRSURGXFHDUHVXOWDQWFRORU7\SLFDOO\+6,FRORUVDUHQRWGHVFULEHGRQWKHEDVLVRISHUFHQWDJHVRISULPDU\FRORUVEXWUDWKHUE\WKHLUKXHVDWXUDWLRQDQGLQWHQVLW\7KHVDWXUDWLRQLVWKHSXUHQHVVRIWKHFRORUWKHKXHLVWKHFRORULWVHOIDQGLQWHQVLW\GHVFULEHVWKHEULJKWQHVVRIWKHFRORU7KH+6,FRORUPRGHOVHSDUDWHVDOOWKHFRORULQIRUPDWLRQGHVFULEHGE\KXHDQGVDWXUDWLRQIURPWKHLQWHQVLW\FRPSRQHQW7KH +6, FRORUPRGHO LVEDVHGRQ FRORUGHVFULSWLRQVWKDWDUHPRUHQDWXUDO WRKXPDQVDQGKHQFHFDQ SURYLGH DQ LGHDO WRRO IRU LPDJHSURFHVVLQJ DOJRULWKPV7KH +6, FRORU VSDFH LVUHSUHVHQWHGE\ WKH GLDPRQGDV VKRZQLQ )LJXUH 7KHKXH+ LVUHSUHVHQWHG DV DQJOHYDU\LQJIURPWR$GMXVWLQJWKHKXHZLOOYDU\WKHFRORUIURPUHGDWWKURXJK\HOORZDWJUHHQDWEOXHDWDQGEDFNWRUHGDW6DWXUDWLRQ6FRUUHVSRQGVWRWKHUDGLXVYDU\LQJIURPWR:KHQ6FRORULVDJUD\YDOXHRILQWHQVLW\:KHQ6FRORULVRQWKHERXQGDU\RIWRSFRQHEDVH,QWHQVLWLHV ,YDU\DORQJ=D[LVZLWKEHLQJEODFNDQGEHLQJZKLWH
-
8/2/2019 InTech-Segmenting the License Plate Region Using a Color Model
7/18
5GIOGPVKPIVJG.KEGPUG2NCVG4GIKQP7UKPIC%QNQT/QFGN
)LJ7KH+6,FRORUVSDFH
7KHWUDQVIRUPIURP5*%WR+6,LQ8PEDXJKLV
FRV
PLQ
6 5 * %5 * %
5 * %
5 * 5 %+
5 * 5 % * %
,
3ODWHFRORULQIRUPDWLRQLVXVHGWRGHWHFWFDQGLGDWHUHJLRQVLQRXUH[SHULPHQWVDQGVKDSHSURSHUWLHVRI/3DOORZUHGXFLQJQXPEHURI/3OLNHFDQGLGDWHV2QHRIWKHFRPPRQZD\VRIFRORUEDVHGYHKLFOHOLFHQVHSODWHGHWHFWLRQFDQEHIRUPDOL]HGDVIROORZV
5 * %
5* 5%
5 [ \ * [ \ % [ \
5 [ \ * [ \ 5 [ \ % [ \
D D D
E E
! ! !! !
ZKHUH 5 * DQG% DUH UHG JUHHQ DQG EOXH FRPSRQHQWV RI [ u \ LPDJH D DQG E DUHSUHGHILQHG FRHIILFLHQWV (TXDWLRQ VHWV XS OLPLWDWLRQV IRU WKH PLQLPDO YDOXHV RI SL[HOFRPSRQHQWV (TXDWLRQ IRUPDOL]HV GHSHQGHQFLHV EHWZHHQ SL[HO FRPSRQHQWV IRU /3*HQHUDOO\FRPPRQZD\RIXVLQJFRORUEDVHGYHKLFOHOLFHQVHSODWHGHWHFWLRQLVEDVHGRQWZRW\SHVRIUHVWULFWLRQVILUVWUHVWULFWLRQLVEDVHGRQ(SVDQG,WSURYLGHVJRRGUHVXOWVLQJRRGOLJKWLQJFRQGLWLRQV+RZHYHULWLVQRWJRRGIRUORZFRQWUDVWLPDJHV3L[HOEHORQJVWRJUHHQDQG\HOORZ/3UHVSHFWLYHO\OLNHIROORZLQJ(TVDQG
-
8/2/2019 InTech-Segmenting the License Plate Region Using a Color Model
8/18
2CVVGTP4GEQIPKVKQP
^ ` ^ `
JUHHQ
5 [ \ * [ \ % [ \ * [ \E
RWKHUZLVH
- d d
^ ` ^ `
\HOORZ
% [ \ 5 [ \ % [ \ * [ \E
RWKHUZLVH
- d d
ZKHUHEJUHHQDQGE\HOORZDUHJUHHQDQG\HOORZFDQGLGDWHELQDU\PDVNV7KHVHFRQGUHVWULFWLRQLVEDVHGRQ(TVDQGDQGDWKUHVKROGYDOXHLVWDNHQKHXULVWLFDOO\,WSURYLGHVVWDEOHUHVXOWZKHUHDVLQEDGOLJKWLQJFRQGLWLRQLWLVWRRVHQVLWLYH,QWKLVSURSRVHGPHWKRG/3GHWHFWLRQLVEDVHGRQLWVFRORUSURSHUWLHVQDPHO\PHDQDQGVWDQGDUG GHYLDWLRQ YDOXHV RI KXH )RU GHWHFWLRQ RI JUHHQ DQG \HOORZ /3 SL[HOV KXHSDUDPHWHU RI+6,FRORU LVXVHGLQRXU H[SHULPHQW7R GHWHFW ZKLWH/3SL[HOVKXH YDOXHLVPHDQLQJOHVVKHQFHRQO\VDWXUDWLRQDQGLQWHQVLW\SDUDPHWHUVDUHLPSRUWDQWIRUWKLVFDVH7RHVWLPDWH WKHVH SURSHUWLHV ZH XVHG LPDJHV RI /3 WDNHQ XQGHU GLIIHUHQW OLJKWLQJ DQG
ZHDWKHUFRQGLWLRQV$IWHUWUDLQLQJIURPWKRVHVDPSOHGDWDWKHPHDQDQGVWDQGDUGGHYLDWLRQYDOXHVRIKXHDUHFRPSXWHGIRUGHWHFWLRQRIJUHHQDQG\HOORZ/3SL[HOV'HWHFWLQJZKLWHOLFHQVHSODWHSL[HOVWKHPHDQDQGVWDQGDUGGHYLDWLRQYDOXHVRIVDWXUDWLRQDQGLQWHQVLW\DUHFRPSXWHGWRGHWHFWJUHHQ\HOORZDQGZKLWH/3IURPYHKLFOHLPDJHV)RUGHWHFWLRQRIJUHHQDQG\HOORZ/3SL[HOVWKHELQDUL]DWLRQSURFHVVFDQEHIRUPXODWHGDVIROORZV
^ ` ^ `
^ `
+ + + +
JUHHQ
+ [ \ 6 [ \
E , [ \
RWKHUZLVH
P G P G - d d t
d d
^ ` ^ `
^ `
+ + + +
\HOORZ
+ [ \ 6 [ \
E , [ \
RWKHUZLVH
P G P G - d d t d d
ZKHUH+[\6[\DQG ,[\DUHKXHVDWXUDWLRQDQGLQWHQVLW\FRPSRQHQWVRI[WK\WK
SL[HOUHVSHFWLYHO\P+DQGG+DUHPHDQKXHDQGKXHVWDQGDUGGHYLDWLRQYDOXHVIRUJUHHQDQG\HOORZ/3RIVDPSOHGDWDUHVSHFWLYHO\+RZHYHU WKH DXWRPDWLF IRFXV DQG ZKLWH EDODQFLQJ RI FDPHUD RIWHQ FDXVH WKH FKDQJLQJLOOXPLQDWLRQ 2XU SURSRVHG /3 GHWHFWLRQ PHWKRG FDQ ZRUN ZHOO LQ QRUPDO LOOXPLQDWLRQFRQGLWLRQ EXW LW VHHPV QRW JRRG HQRXJK WR ZRUN LQ EDG LOOXPLQDWLRQ FRQGLWLRQV 7RRYHUFRPHWKLVSUREOHPZHXVHDQDGDSWLYH/3GHWHFWLRQPHWKRGZHXVHLWLQWKHFDVHRI
UHDOO\KLJKRUORZLOOXPLQDWLRQFRQGLWLRQ)RU QRUPDO ORZ DQG KLJKLOOXPLQDWLRQ FRQGLWLRQV RI ZKLWH OLFHQVH SODWH SL[HOV WKHELQDUL]DWLRQSURFHVVFDQEHIRUPXODWHGDVIROORZVUHVSHFWLYHO\
^ ` ^ `
6 6 , , ZKLWH Q
6 [ \ , [ \E
RWKHUZLVH
P G P G - d t
^ ` ^ `
6 6 , , ZKLWH O
6 [ \ , [ \E
RWKHUZLVH
P G P G - d t
-
8/2/2019 InTech-Segmenting the License Plate Region Using a Color Model
9/18
5GIOGPVKPIVJG.KEGPUG2NCVG4GIKQP7UKPIC%QNQT/QFGN
^ ` ^ `
6 6 , , ZKLWH K
6 [ \ , [ \E
RWKHUZLVH
P G P G - d t
ZKHUH 6[ \ DQG ,[ \ DUH VDWXUDWLRQ DQG LQWHQVLW\ FRPSRQHQWV RI [WK \WK SL[HO
UHVSHFWLYHO\ P6 DQG P, DUH PHDQ YDOXHV IRU VDWXUDWLRQ DQG LQWHQVLW\ G6 G, DUH VWDQGDUGGHYLDWLRQYDOXHVIRUVDWXUDWLRQLQWHQVLWLHVRIZKLWH/3RIVDPSOHGDWDUHVSHFWLYHO\ EZKLWHQEZKLWHODQGEZKLWHKDUHZKLWHFDQGLGDWHELQDU\PDVNV$Q/3LPDJHDQGLWVFRORUVHJPHQWDWLRQUHVXOWVDUHGHSLFWHGLQ)LJDFJUHHQ\HOORZDQGZKLWHEDFNJURXQG/3UHVSHFWLYHO\
)LJ$Q/3LPDJH OHIWDQGLWVFRORUVHJPHQWDWLRQUHVXOWVULJKWXVLQJ+6,FRORUPRGHO&RORUVHJPHQWDWLRQSDUDPHWHUVDUHYHU\VHQVLWLYHLQRUGHUWRGHWHFWDVPDQ\FDQGLGDWHVDVSRVVLEOH$OOIDOVHFDQGLGDWHVZLOOEHILOWHUHGRXWRQWKHQH[WVWDJHV$FFRUGLQJWRWKHSULRUNQRZOHGJHRIYHKLFOH/3LQVSHFWLRQDOOOLFHQVHSODWHVPXVWEHUHFWDQJXODULQVKDSHDQGKDYHWKH GLPHQVLRQV DQG KDYH DOO DOSKDQXPHULF FKDUDFWHUV ZULWWHQ LQRQH RU WZR URZV LQ/3UHJLRQ$IWHUWKHVHJPHQWDWLRQWKHUHPD\VWLOOH[LVWQRLVHVLQWKHLPDJHDQGWKDWLVQRWLGHDO7KHVHQRLVHVKDYHPDQ\W\SHVVXFKDVVPDOOKROHVRUDQGEXOJHVRIWKHWDUJHWFDQGLGDWHUHJLRQV 7KH SUREOHP PD\ EH UHVROYHG E\ XVLQJ PDWKHPDWLFDO PRUSKRORJ\ SURFHVVLQJPHWKRG 0DWKHPDWLFDO PRUSKRORJ\ LV XVHG DV D SRWHQW WRRO IRU LPDJH DQDO\VLV ZKLFK LVEDVHG RQ VKDSHV LQ WKH LPDJH QRW SL[HO LQWHQVLWLHV 7KH WZR SULQFLSDO PRUSKRORJLFDORSHUDWLRQVDUHGLODWLRQDQGHURVLRQ'LODWLRQDOORZVREMHFWVWRH[SDQGDQGHURVLRQVKULQNVREMHFWVE\HWFKLQJDZD\HURGLQJWKHLUERXQGDULHV7KHVHRSHUDWLRQVFDQEHFXVWRPL]HGE\WKHSURSHUVHOHFWLRQRIWKHVWUXFWXULQJHOHPHQWZKLFKGHWHUPLQHVH[DFWO\KRZWKHREMHFWVZLOO EH GLODWHG RU HURGHG 'LODWLRQDQG HURVLRQ DUH FRPELQHG LQWR RWKHU WZR RSHUDWLRQVRSHQLQJDQGFORVLQJ ,QWKLVSDUWRIWKHDSSOLFDWLRQZHXVHWKHFORVLQJRSHUDWLRQZKLFKLV
-
8/2/2019 InTech-Segmenting the License Plate Region Using a Color Model
10/18
2CVVGTP4GEQIPKVKQP
GLODWLRQIROORZHGE\HURVLRQWRILOOLQKROHVDQGJDSVVPDOOHUWKDQWKHVWUXFWXULQJHOHPHQWRQWKHSODWHLPDJH5HPRYDORIWKRVHKROHVSOD\VDQLPSRUWDQWUROHLQFDOFXODWLQJERXQGLQJER[UHJLRQ ,PSOHPHQWDWLRQ RIPRUSKRORJLFDOFORVLQJ RSHUDWLRQ LV GHSLFWHG LQ )LJ F F
UHVSHFWLYHO\
.CDGNKPICPFHKNVGTKPI
$IWHUWKHFDQGLGDWHUHJLRQVDUHREWDLQHGE\DSSO\LQJFRORUVHJPHQWDWLRQIHDWXUHVRIHDFKUHJLRQDUHWREHH[WUDFWHGLQRUGHUWRFRUUHFWO\GLIIHUHQWLDWHWKH/3UHJLRQVIURPRWKHUV1H[WVWHSRISURSRVHGDOJRULWKPLVODEHOLQJWKHFRQQHFWHGFRPSRQHQWV,QWKHSURSRVHGPHWKRGD UHFXUVLYH DOJRULWKP LV LPSOHPHQWHG IRU FRQQHFWHG FRPSRQHQW ODEHOLQJ RSHUDWLRQ5HFXUVLYHDOJRULWKP6KDSLURHWDOZRUNVRQRQHFRPSRQHQWDWDWLPHEXWFDQPRYHDOORYHUWKHLPDJH,QWKLVVWHSZHH[WUDFWFDQGLGDWHUHJLRQVZKLFKPD\LQFOXGH/3UHJLRQVIURP WKH ELQDU\ PDVN REWDLQHG LQ WKH SUHYLRXV VWHS 'XULQJ WKLV VWHSPDLQ JHRPHWULFDOSURSHUWLHVRI/3FDQGLGDWHVXFKDVDUHDERXQGLQJER[DQGDVSHFWUDWLRDUHFRPSXWHG)ROORZLQJWKHVXFFHVVIXOFRQQHFWHGFRPSRQHQWODEHOLQJRSHUDWLRQLQLPDJHPHDVXUHPHQWVVXFKDVWKHDUHDWKHERXQGLQJER[DQGWKHDVSHFWUDWLRIRUHYHU\ELQDU\REMHFWLQWKHLPDJHDUHSHUIRUPHG$ERXQGLQJER[LVDUHFWDQJOHZKRVHKRUL]RQWDODQGYHUWLFDOVLGHVHQFORVHWKHUHJLRQDQGWRXFKLWVWRSPRVWERWWRPPRVWOHIWPRVWDQGULJKWPRVWSRLQWV5HFWDQJXODULW\LVGHILQHGDVWKHUDWLRRIWKHDUHDRIFDQGLGDWHREMHFWV0(5PLQLPXPHQFORVLQJUHFWDQJOHDQGWKHDUHDRIWKHREMHFW+HUHWKHDUHDLVPHDVXUHGLQSL[HOVDQGLQGLFDWHVWKHUHODWLYHVL]HRIWKHREMHFW7KH DVSHFW UDWLR DOVR FDOOHG HORQJDWLRQ RU HFFHQWULFLW\ LV GHILQHG E\ WKH UDWLR RI WKHERXQGLQJER[RIDQREMHFW7KLVFDQEHIRXQGE\VFDQQLQJWKHLPDJHDQGWKHPLQLPXPDQGPD[LPXPYDOXHVRQWKHURZDQGWKHFROXPQVZKHUHWKHREMHFWOLHV7KLVUDWLRLVGHILQHGE\
PD[ PLQ
PD[ PLQ
$
F F
U UU
ZKHUHFDQGULQGLFDWHFROXPQVDQGURZUHVSHFWLYHO\2EMHFWVZKLFKVDWLVI\U$DVSHFWUDWLRERXQGV WR IRU JUHHQ WR IRU \HOORZ DQG WR IRU ZKLWH /3V DUH FRQVLGHUHG DVFDQGLGDWH UHJLRQV7KHVH SDUDPHWHUV DUH XVHG IRU ILOWHULQJ RSHUDWLRQ WR HOLPLQDWH /3OLNHREMHFWV IURP FDQGLGDWH OLVW )LOWHULQJ RSHUDWLRQ LV GRQH RQ JHRPHWULFDO SURSHUWLHV RI /3UHJLRQV)LJVLOOXVWUDWHWKHVWHSVIRUOLFHQVHSODWHVHJPHQWDWLRQDDQ/3LPDJHEFRORU VHJPHQWDWLRQ UHVXOW F LPSOHPHQWDWLRQ RI PRUSKRORJLFDO FORVLQJ RSHUDWLRQ IRUUHPRYLQJ VPDOO KROHV LQ FDQGLGDWH UHJLRQ G GHWHFWHG FDQGLGDWH DIWHU ILOWHULQJ DQG H
FDQGLGDWHUHJLRQGHWHFWLRQ7KHPRVWLPSRUWDQW/3SDUDPHWHUVDUHJURXSHGLQ7DEOH
)LOWHULQJSDUDPHWHU &5JUHHQ &5\HOORZ &5ZKLWH
%RXQGLQJER[ >@ >@ >@
$VSHFWUDWLR >@ >@ >@
3RVVLEOHVKDSHV 5HFWDQJOH
7DEOH)LOWHULQJSURSHUWLHV
-
8/2/2019 InTech-Segmenting the License Plate Region Using a Color Model
11/18
5GIOGPVKPIVJG.KEGPUG2NCVG4GIKQP7UKPIC%QNQT/QFGN
+HUH&5LQGLFDWHVFDQGLGDWHUHJLRQ
)LJ,OOXVWUDWLRQRIOLFHQVHSODWHVHJPHQWDWLRQDDQ/3LPDJHLQDQLJKWWLPHEFRORUVHJPHQWDWLRQUHVXOW F LPSOHPHQWDWLRQ RI PRUSKRORJLFDOFORVLQJRSHUDWLRQ IRU UHPRYLQJVPDOO KROHV LQ FDQGLGDWH UHJLRQ G GHWHFWHG FDQGLGDWH DIWHU ILOWHULQJ DQG H FDQGLGDWHUHJLRQGHWHFWLRQ
)LJ,OOXVWUDWLRQRIOLFHQVHSODWHVHJPHQWDWLRQDDQ/3LPDJHLQDVWURQJVXQVKLQHEFRORU VHJPHQWDWLRQ UHVXOW F LPSOHPHQWDWLRQ RI PRUSKRORJLFDO FORVLQJ RSHUDWLRQ IRUUHPRYLQJ VPDOO KROHV LQ FDQGLGDWH UHJLRQ G GHWHFWHG FDQGLGDWH DIWHU ILOWHULQJ DQG H
FDQGLGDWHUHJLRQGHWHFWLRQ
)LJ ,OOXVWUDWLRQ RI OLFHQVH SODWH VHJPHQWDWLRQ D DQ /3 LPDJH LQ D VWURQJ VXQVKLQHUHIOHFWHG E\ YHKLFOH PLUURU DQG DOVR D OLJKW SRVW ORFDWHG LQ IURQW RI YHKLFOH E FRORU
VHJPHQWDWLRQUHVXOW F LPSOHPHQWDWLRQ RI PRUSKRORJLFDOFORVLQJRSHUDWLRQ IRU UHPRYLQJVPDOO KROHV LQ FDQGLGDWH UHJLRQ G GHWHFWHG FDQGLGDWH DIWHU ILOWHULQJ DQG H FDQGLGDWHUHJLRQGHWHFWLRQ
&GVGTOKPKPIVJGCPINGQHVJGECPFKFCVGTQVCVKQPCFLWUVOGPV$VOLFHQVH SODWHV FDQ DSSHDU DW PDQ\ GLIIHUHQW DQJOHV LQ RXU H[SHULPHQW LVPRUH UREXVWZKHQ/3 LVURWDWHGIURP WRGHJUHH WRWKHFDPHUDVRSWLFDOD[LV HDFKUHFWDQJXODUFDQGLGDWHUHJLRQVLVURWDWHGXQWLOWKH\DUHDOODOLJQHGLQWKHVDPHZD\EHIRUHWKHFDQGLGDWHGHFRPSRVLWLRQ)ROORZLQJWKHVXFFHVVIXOILOWHULQJRSHUDWLRQLQLPDJHPHDVXUHPHQWVVXFKDV
-
8/2/2019 InTech-Segmenting the License Plate Region Using a Color Model
12/18
2CVVGTP4GEQIPKVKQP
FHQWHU RI DUHD DQG WKH D[LV RI OHDVW VHFRQG PRPHQW DUH HPSOR\HG WR VROYH WKH URWDWLRQDGMXVWPHQWSUREOHP7KHFHQWHURIDUHDFHQWURLGLVWKHPLGSRLQWDORQJHDFKURZDQGFROXPQD[LVFRUUHVSRQGLQJ
WRWKHPLGGOHEDVHGRQWKHVSDWLDOGLVWULEXWLRQZLWKLQFDQGLGDWHREMHFW7KLVIHDWXUHXVHGWRORFDWHDQREMHFWLQWKH'LPDJHSODQLVGHILQHGE\WKHSDLU L LU F
1 1
L LL U F
1 1
L LL U F
U U , U F$
F F , U F$
ZKHUH LU DQG LF LQGLFDWHVURZDQGFROXPQFRRUGLQDWHRIWKHFHQWHURIDUHDIRUWKH LWKREMHFW
7KHDUHD L$ LVPHDVXUHGLQSL[HOVDQGLQGLFDWHVWKHUHODWLYHVL]HRIWKHREMHFW
7KHOHDVWVHFRQGPRPHQWSURYLGHVWKHSULQFLSDOD[LVDVWKHRULHQWDWLRQZLWKWKHFDQGLGDWHREMHFW)RUJHWWLQJSULQFLSDOD[LVRIGHWHFWHGFDQGLGDWHUHJLRQZHFRPSXWHFHQWUDOPRPHQWVRIGHWHFWHGFDQGLGDWHUHJLRQ7KHFHQWUDOPRPHQWVDUHGHILQHGDV
1 1S T
ST
U F
U U F F , U FP
:HDSSO\WKLVUHVXOWWRREWDLQDGLUHFWLRQRISULQFLSDOD[LVE\FHQWURLGRIGHWHFWHGFDQGLGDWHUHJLRQ$QJOHRISULQFLSDOD[LVPRPHQWVLVREWDLQHGDV
DUFWDQ
PT
P P
ZKHUHTGHQRWHVDQDQJOHEHWZHHQEDVLVKRUL]RQWDOFRRUGLQDWHDQGSULQFLSDOD[LVRIUHJLRQ)LJXUHSRUWUD\VDVHTXHQFHRIVXFFHVVIXOOLFHQVHSODWHLGHQWLILFDWLRQ
)LJ,OOXVWUDWLRQRIOLFHQVHSODWHVHJPHQWDWLRQDDQ/3LPDJHEGHWHFWHGFDQGLGDWHDIWHUILOWHULQJFSULQFLSDOD[LVGURWDWLRQDGMXVWPHQWDQGHH[WUDFWHGFDQGLGDWH
&GEQORQUKPIECPFKFCVGU
,QIRUPDWLRQ H[WUDFWHG IURP LPDJH DQG LQWHQVLW\ KLVWRJUDPV SOD\V D EDVLF UROH LQ LPDJHSURFHVVLQJ LQ DUHDV VXFKDV HQKDQFHPHQW VHJPHQWDWLRQ DQGGHVFULSWLRQ ,Q WKLV VHFWLRQ
-
8/2/2019 InTech-Segmenting the License Plate Region Using a Color Model
13/18
5GIOGPVKPIVJG.KEGPUG2NCVG4GIKQP7UKPIC%QNQT/QFGN
YHULILFDWLRQ DQG GHWHFWLRQ RI WKH 9/3 UHJLRQ DV ZHOO DV FKDUDFWHU VHJPHQWDWLRQ DUHFRQVLGHUHGDQGGLVFXVVHGLQWKLVVWXG\7KHDOJRULWKPVFKHPHIRUFDQGLGDWHGHFRPSRVLWLRQLVVKRZQLQ)LJ
2QFH WKH FDQGLGDWH DUHD LVELQDUL]HG WKH QH[W VWHS LV WR H[WUDFW WKH LQIRUPDWLRQ $WILUVWUHJLRQV ZLWKRXW LQWHUHVW VXFK DV ERUGHU RU VRPH VPDOO QRLV\ UHJLRQV DUH HOLPLQDWHG WKHFKHFNLQJ LV PDGH E\ KHLJKW FRPSDULVRQ ZLWK RWKHU SODWH FKDUDFWHUV KHLJKW )ROORZLQJSURFHGXUHLVSHUIRUPHGZKHQ/3FRORULVJUHHQDQG\HOORZILUVWZHSURFHHGE\SHUIRUPLQJKRUL]RQWDOSRVLWLRQLQWKHKLVWRJUDPWZRREMHFWVDUH IRXQGZKHUHHDFKREMHFWFRUUHVSRQGVZLWKRQHURZ7KHQWKHURZVDUHLVRODWHGDQGSURFHVVHGVHSDUDWHO\$VPHQWLRQHGEHIRUHLQ6HFWWZRW\SHVRISODWHDUHFRQVLGHUHG
)LJ$OJRULWKPVFKHPHIRUFDQGLGDWHGHFRPSRVLWLRQ3URFHVVLQJRIWKHXSSHUURZILUVWILOWHUSKDVHLVSHUIRUPHGWRHOLPLQDWHWKHUHJLRQVZLWKRXW
LQWHUHVW7KHQYHUWLFDOSRVLWLRQKLVWRJUDPLVSURFHVVHG7KHXSSHUURZDOVRKDVWZRGLIIHUHQWW\SHVDVZHPHQWLRQHGLQ6HFW$VLWFDQEHREVHUYHGXVXDOO\LQWKHXSSHUURZZHFDQILQGWZRSODWHIL[LQJGRWVDVVKRZQLQ)LJ7KHULJKWSODWHIL[LQJGRWGRHVQRWHYHQDSSHDULQWKHELQDUL]DWLRQSURFHVVGXHWRWKHIDFWWKDWLWLVSULQWHGJUHHQ7KHOHIWSODWHIL[LQJGRWLVDOVRHOLPLQDWHG7KHFKHFNLQJLVPDGHE\KHLJKWFRPSDULVRQ)URPWKHYHUWLFDOSRVLWLRQLQWKHKLVWRJUDPZHFDQILQGLVRODWHGDOSKDQXPHULFFKDUDFWHUV
-
8/2/2019 InTech-Segmenting the License Plate Region Using a Color Model
14/18
2CVVGTP4GEQIPKVKQP
)LJ ([DPSOH LPDJHV D GLIIHUHQW LOOXPLQDWLRQV E FRPSOH[ VFHQHV F YDULRXVHQYLURQPHQWVDQGGGDPDJHGOLFHQVHSODWHV
3URFHVVLQJRIWKHORZHUURZILUVWILOWHUSKDVHLVSHUIRUPHGWRHOLPLQDWHWKHUHJLRQVZLWKRXWLQWHUHVW 7KHQ YHUWLFDO SRVLWLRQ KLVWRJUDP LV SHUIRUPHG DQG IURP WKH YHUWLFDO SRVLWLRQKLVWRJUDPWKHDOSKDQXPHULFFKDUDFWHUVDUHLVRODWHG$FFRUGLQJ WR WKH SULRU NQRZOHGJH RI YHKLFOH /3 LQVSHFWLRQ DOO ZKLWH /3V FRQWDLQ VHYHQDOSKDQXPHULF FKDUDFWHUV DV ZHOO DV ZULWWHQ LQ D VLQJOH URZ 7KH IROORZLQJ SURFHGXUH LVSHUIRUPHGIRUFKDUDFWHUVHJPHQWDWLRQ$IWHUHOLPLQDWLQJERUGHUDUHDYHUWLFDOSRVLWLRQLQWKHKLVWRJUDPLVSHUIRUPHGIRUVHJPHQWLQJSUHGHWHUPLQHGDOSKDQXPHULFFKDUDFWHUV$VLWFDQEHREVHUYHGXVXDOO\ZHFDQILQGDOVRWZRSODWHIL[LQJGRWVLQXSSHUDUHDRISODWHUHJLRQ7KHULJKWSODWHIL[LQJGRWRUERWKSODWHIL[LQJGRWVGRQRWHYHQDSSHDULQWKHELQDUL]DWLRQ
-
8/2/2019 InTech-Segmenting the License Plate Region Using a Color Model
15/18
5GIOGPVKPIVJG.KEGPUG2NCVG4GIKQP7UKPIC%QNQT/QFGN
SURFHVVGXHWRWKHIDFWWKDWLWLVSULQWHGZKLWH7KHOHIWSODWHIL[LQJGRWLVDOVRHOLPLQDWHGWKLVFKHFNLQJLVPDGHE\KHLJKWFRPSDULVRQ)LJXUHVKRZVWKHIROORZLQJVWHSVIRUYHULI\LQJSUHGHWHUPLQHGDOSKDQXPHULFFKDUDFWHUV
ZKLWHEDFNJURXQG/3DH[WUDFWLQJFDQGLGDWHUHJLRQEYHUWLFDOSRVLWLRQKLVWRJUDPZLWK/3 ERUGHU F KRUL]RQWDO SRVLWLRQ KLVWRJUDP ZLWK /3 ERUGHU G KRUL]RQWDO SRVLWLRQKLVWRJUDP ZLWKRXW /3 ERUGHUH YLHZ RI QRUPDOL]DWLRQ FDQGLGDWH UHJLRQ DIWHU UHPRYLQJERUGHUDQGQRLV\DUHDIYHUWLFDOSRVLWLRQKLVWRJUDPVHYHQSHDNVIRUSUHGHWHUPLQHGVHYHQDOSKDQXPHULFFKDUDFWHUVLQ/3UHJLRQDQGJFKDUDFWHUH[WUDFWLRQ
'ZRGTKOGPVCNTGUWNVU
$OOH[SHULPHQWVKDYHEHHQGRQHRQ3HQWLXP,9*+]ZLWK0%5$0XQGHU0DWODE
HQYLURQPHQW,QWKHH[SHULPHQWVLPDJHVZHUHXVHGWKHVL]HLV uSL[HOVVRPHLPDJHVZKLFKDUHVKRZQLQ)LJ7KHLPDJHVDUHWDNHQIURPDGLIIHUHQWLOOXPLQDWLRQV
QLJKWWLPHVWURQJVXQVKLQHDQGVKDGRZEFRPSOH[VFHQHVZKHUHVHYHUDOREMHFWVVXFKDVWUHHV OLJKWSRVW LQ IURQWRIYHKLFOHV FYDULRXV HQYLURQPHQWV LQFDPSXV SDUNLQJDFFHVVDUHDVDQGPRUHWKDQRQHOLFHQVHSODWHVLQWKHVDPHLPDJHDQGGGDPDJHG/3DVEHQWRUROG7KH\ZHUHWDNHQLQGLVWDQFHIURPXSWRPDQGWKHFDPHUDZDVIRFXVHGLQWKHSODWHUHJLRQ 8QGHU WKHVH FRQGLWLRQV VXFFHVV RI /3 GHWHFWLRQ KDV UHDFKHG WR PRUH WKDQ 5HVXOWVRIFDQGLGDWHUHJLRQGHWHFWLRQDUHVKRZQLQ7DEOH
,PDJHJURXS 7RWDOLPDJHV 'HWHFWHG/3V 6XFFHVVUDWH
'LIIHUHQWLOOXPLQDWLRQV
&RPSOH[VFHQHV
9DULRXVHQYLURQPDQWV
'DPDJHG/3
7RWDO
7DEOH'HWHFWLRQUHVXOWV$FRPPRQGUDZEDFNRIWKHSURSRVHG9/3'V\VWHPLVWKHIDLOXUHWRGHWHFWWKHERXQGDULHVRUERUGHU RI OLFHQVH SODWHV 7KLV RFFXUV ZKHQ YHKLFOH ERGLHV DQG WKHLU OLFHQVH SODWH SRVVHVVVLPLODU FRORUV 7KH DYHUDJH FRPSXWDWLRQDO WLPH IRU WKH FRORU VHJPHQWDWLRQ DQG ILOWHULQJRSHUDWLRQVRIWKHSURSRVHGPHWKRGDUHVKRZQLQ7DEOH
6WDJH $YJWLPHV 6WGGHYLDWLRQV
&RORUVHJPHQWDWLRQ
)LOWHULQJ
7DEOH$YHUDJHFRPSXWDWLRQWLPH
-
8/2/2019 InTech-Segmenting the License Plate Region Using a Color Model
16/18
2CVVGTP4GEQIPKVKQP
)LJ6WHSVIRUYHULI\SUHGHWHUPLQHGDOSKDQXPHULFFKDUDFWHUVZKLWHEDFNJURXQG/3D
H[WUDFWLQJFDQGLGDWHUHJLRQEYHUWLFDOSRVLWLRQKLVWRJUDPZLWK/3ERUGHUFKRUL]RQWDOSRVLWLRQKLVWRJUDPZLWK/3ERUGHUGKRUL]RQWDOSRVLWLRQKLVWRJUDPZLWKRXW/3ERUGHUHYLHZRIQRUPDOL]DWLRQFDQGLGDWHUHJLRQDIWHUUHPRYLQJERUGHUDQGQRLV\DUHDIYHUWLFDOSRVLWLRQKLVWRJUDP VHYHQ SHDNV IRU SUHGHWHUPLQHG VHYHQ DOSKDQXPHULF FKDUDFWHUV LQ /3UHJLRQDQGJFKDUDFWHUH[WUDFWLRQ
%QPENWUKQP
,QFRQFOXVLRQDQHZPHWKRGLVDGRSWHGLQWKLVSDSHUWRVHOHFWVWDWLVWLFDOWKUHVKROGYDOXHLQ+6,FRORUPRGHO,QWKHSURSRVHGPHWKRGFDQGLGDWHUHJLRQVDUHIRXQGE\XVLQJ+6,FRORUPRGHO7KHVHFDQGLGDWHUHJLRQVPD\LQFOXGH/3UHJLRQVJHRPHWULFDOSURSHUWLHVRI/3DUH
WKHQ XVHG IRU FODVVLILFDWLRQ 7KH SURSRVHGPHWKRG LVDEOH WRGHDOZLWK FDQGLGDWH UHJLRQVXQGHU LQGHSHQGHQW RULHQWDWLRQ DQG VFDOH RI WKH SODWH )LQDOO\ 9/3 UHJLRQV FRQWDLQLQJSUHGHWHUPLQHG /3 DOSKDQXPHULF FKDUDFWHU DUH YHULILHG DQG GHWHFWHG E\ XVLQJ SRVLWLRQKLVWRJUDP&RORUDUUDQJHPHQWDQGSUHGHWHUPLQHG/3DOSKDQXPHULFFKDUDFWHURIWKH.RUHDQOLFHQVHSODWHDUHLPSRUWDQWIHDWXUHVIRUYHULILFDWLRQDQGGHWHFWLRQRIOLFHQVHSODWHUHJLRQV:KLOH FRQGXFWLQJ WKHH[SHULPHQWV GLIIHUHQWLOOXPLQDWLRQFRQGLWLRQV DQGYDULHG GLVWDQFHVEHWZHHQYHKLFOHDQGFDPHUDRIWHQRFFXUUHG,QWKDWFDVHWKHUHVXOWWKDWKDVEHHQFRQILUPHGLVYHU\PXFKHIIHFWLYHZKHQWKHSURSRVHGDSSURDFKLVXVHG+RZHYHUWKHSURSRVHGPHWKRGLVVHQVLWLYH ZKHQ YHKLFOH ERGLHV DQG WKHLU OLFHQVH SODWHV SRVVHVV VLPLODU FRORUV :HOHDYHWKHVHLVVXHVWREHFRQVLGHUHGLQIXWXUHVWXGLHV
-
8/2/2019 InTech-Segmenting the License Plate Region Using a Color Model
17/18
5GIOGPVKPIVJG.KEGPUG2NCVG4GIKQP7UKPIC%QNQT/QFGN
#EMPQYNGFIOGPVU
7KHDXWKRUVZRXOGOLNHWRWKDQNWR8OVDQ0HWURSROLWDQ&LW\0.(DQG0(67ZKLFKKDYH
VXSSRUWHGWKLVUHVHDUFKLQSDUWWKURXJKWKH1$5&WKH+XPDQ5HVRXUFH7UDLQLQJSURMHFWIRU UHJLRQDO LQQRYDWLRQ WKURXJK.27() WKH+XPDQ 5HVRXUFH 'HYHORSPHQW3URJUDPIRU&RQYHUJHQFH5RERW6SHFLDOLVWVWKURXJK.,$7DQGSRVW%.DW8QLYHUVLW\RI8OVDQ$OVRZHH[SUHVVVSHFLDOWKDQNVWR,,7$IRUWKHLULQWHUQDWLRQDOJUDGXDWHVWXGHQWVVFKRODUVKLS
4GHGTGPEGU
$QDJQRVWRSRXORV&$QDJQRVWRSRXORV,/RXPRV9.D\DIDV(/LFHQVHSODWHUHFRJQLWLRQIURPVWLOOLPDJHVDQGYLGHRVHTXHQFHVDVXUYH\,(((7UDQVRQ,QWHOO7UDQVS6\VWV9RO1R6HSWHPEHUSS
$QDJQRVWRSRXORV & $QDJQRVWRSRXORV , /RXPRV 9 .D\DIDV ( $ OLFHQVH
SODWHUHFRJQLWLRQDOJRULWKPIRULQWHOOLJHQWWUDQVSRUWDWLRQV\VWHPDSSOLFDWLRQ,(((7UDQVRQ,QWHOO7UDQVS6\VWV9RO1R6HSWHPEHUSS&DQR-3HUH]&RUWHV-& 9HKLFOHOLFHQVHSODWHVHJPHQWDWLRQLQQDWXUDOLPDJHV
,Q/HFWXUHQRWHVRQFRPSXWHUVFLHQFH9ROSS&KDFRQ0,=LPPHUPDQ$ /LFHQVHSODWHORFDWLRQEDVHGRQD G\QDPLF3&11
VFKHPH,Q3URFHHGLQJVRIWKH,QW-RLQW&RQIRQ1HXUDO1HWZ9ROSS
&KDQJ 6 / &KHQ / 6 &KXQJ
-
8/2/2019 InTech-Segmenting the License Plate Region Using a Color Model
18/18
2CVVGTP4GEQIPKVKQP
.LP6.LP'5\X