BXGrid: A Data Repository and Computing Grid for Biometrics Research
description
Transcript of BXGrid: A Data Repository and Computing Grid for Biometrics Research
![Page 1: BXGrid: A Data Repository and Computing Grid for Biometrics Research](https://reader036.fdocuments.us/reader036/viewer/2022062520/56815f85550346895dce8ac8/html5/thumbnails/1.jpg)
BXGrid: A Data Repository and Computing Grid for Biometrics
ResearchHoang Bui
University of Notre Dame
1
![Page 2: BXGrid: A Data Repository and Computing Grid for Biometrics Research](https://reader036.fdocuments.us/reader036/viewer/2022062520/56815f85550346895dce8ac8/html5/thumbnails/2.jpg)
Overview
• Biometrics Research• What is BXGrid?• BXGrid & Condor• Future Works• Questions
2
![Page 3: BXGrid: A Data Repository and Computing Grid for Biometrics Research](https://reader036.fdocuments.us/reader036/viewer/2022062520/56815f85550346895dce8ac8/html5/thumbnails/3.jpg)
Biometric Research
• Facial recognition
• Iris recognition
3
![Page 4: BXGrid: A Data Repository and Computing Grid for Biometrics Research](https://reader036.fdocuments.us/reader036/viewer/2022062520/56815f85550346895dce8ac8/html5/thumbnails/4.jpg)
Acquisition process• Computer Vision Research Laboratory
4
![Page 5: BXGrid: A Data Repository and Computing Grid for Biometrics Research](https://reader036.fdocuments.us/reader036/viewer/2022062520/56815f85550346895dce8ac8/html5/thumbnails/5.jpg)
5
![Page 6: BXGrid: A Data Repository and Computing Grid for Biometrics Research](https://reader036.fdocuments.us/reader036/viewer/2022062520/56815f85550346895dce8ac8/html5/thumbnails/6.jpg)
Biometric Research
• Now what?– I have collected 100,000 irises.– I have an algorithm to compare 2 irises
– I want evaluate my algorithm by comparing only brown irises
– First, I need to convert raw iris images to iris codes
– But I need to find all brown irises
6
![Page 7: BXGrid: A Data Repository and Computing Grid for Biometrics Research](https://reader036.fdocuments.us/reader036/viewer/2022062520/56815f85550346895dce8ac8/html5/thumbnails/7.jpg)
BXGridHow do I search for brown irises fast?
Where do I store iris images?
How do I evaluate my algorithm?
DBMS
Relational Database (2x)
Active Storage Cluster (16x)
CPU
Relational Database
CPU CPU CPU
CPU CPU CPU CPU
Condor Pool (500x)
7
![Page 8: BXGrid: A Data Repository and Computing Grid for Biometrics Research](https://reader036.fdocuments.us/reader036/viewer/2022062520/56815f85550346895dce8ac8/html5/thumbnails/8.jpg)
8
![Page 9: BXGrid: A Data Repository and Computing Grid for Biometrics Research](https://reader036.fdocuments.us/reader036/viewer/2022062520/56815f85550346895dce8ac8/html5/thumbnails/9.jpg)
9
![Page 10: BXGrid: A Data Repository and Computing Grid for Biometrics Research](https://reader036.fdocuments.us/reader036/viewer/2022062520/56815f85550346895dce8ac8/html5/thumbnails/10.jpg)
10
![Page 11: BXGrid: A Data Repository and Computing Grid for Biometrics Research](https://reader036.fdocuments.us/reader036/viewer/2022062520/56815f85550346895dce8ac8/html5/thumbnails/11.jpg)
11
![Page 12: BXGrid: A Data Repository and Computing Grid for Biometrics Research](https://reader036.fdocuments.us/reader036/viewer/2022062520/56815f85550346895dce8ac8/html5/thumbnails/12.jpg)
12
![Page 13: BXGrid: A Data Repository and Computing Grid for Biometrics Research](https://reader036.fdocuments.us/reader036/viewer/2022062520/56815f85550346895dce8ac8/html5/thumbnails/13.jpg)
Workflow Abstractions
B1
B2
B3
A1 A2 A3
F F F
F
F F
F F
F
L brown
L blue
R brown
R brown
S1
S2
S3
eye color
F
F
F
ROCCurve
S = Select( color=“brown” )
B = Transform( S,F )
M = AllPairs( A, B, F )
Bui, Thomas, Kelly, Lyon, Flynn, ThainBXGrid: A Repository and Experimental Abstraction… poster at IEEE eScience 200813
![Page 14: BXGrid: A Data Repository and Computing Grid for Biometrics Research](https://reader036.fdocuments.us/reader036/viewer/2022062520/56815f85550346895dce8ac8/html5/thumbnails/14.jpg)
Transform Abstraction• B = Transform( S,F )• Transform set S into set B using function F
• Single PC and 100,000 iris images– Core 2 Duo 1.8Ghz 1GB RAM PC– 6 seconds/transform 170 hours– Storage: 30GB• Let’s use Condor• You want to:– Do it faster– Manage resource properly
14
![Page 15: BXGrid: A Data Repository and Computing Grid for Biometrics Research](https://reader036.fdocuments.us/reader036/viewer/2022062520/56815f85550346895dce8ac8/html5/thumbnails/15.jpg)
• Fileservers
J1
Condor pool
J2 J3 J J J1 JN
User Local Machine
15
![Page 16: BXGrid: A Data Repository and Computing Grid for Biometrics Research](https://reader036.fdocuments.us/reader036/viewer/2022062520/56815f85550346895dce8ac8/html5/thumbnails/16.jpg)
• Fileservers
J1
Condor pool
J2 J3 J J J1 JN
User Local Machine
Wait()
J2 JN+1
16
![Page 17: BXGrid: A Data Repository and Computing Grid for Biometrics Research](https://reader036.fdocuments.us/reader036/viewer/2022062520/56815f85550346895dce8ac8/html5/thumbnails/17.jpg)
Result
17
![Page 18: BXGrid: A Data Repository and Computing Grid for Biometrics Research](https://reader036.fdocuments.us/reader036/viewer/2022062520/56815f85550346895dce8ac8/html5/thumbnails/18.jpg)
18
![Page 19: BXGrid: A Data Repository and Computing Grid for Biometrics Research](https://reader036.fdocuments.us/reader036/viewer/2022062520/56815f85550346895dce8ac8/html5/thumbnails/19.jpg)
Transform Summary
• Use up to 1GB local storage• Transform 10,000 irises– Single PC: 60,000 seconds– Condor: 1400 seconds
• Speedup: ~43 times
19
![Page 20: BXGrid: A Data Repository and Computing Grid for Biometrics Research](https://reader036.fdocuments.us/reader036/viewer/2022062520/56815f85550346895dce8ac8/html5/thumbnails/20.jpg)
AllPairs AbstractionAllPairs( set A, set B, function F )
returns matrix M whereM[i][j] = F( A[i], B[j] ) for all i,j
B1
B2
B3
A1 A2 A3
F F F
A1A1An
B1B1Bn
F
AllPairs(A,B,F)F
F F
F F
F20
![Page 21: BXGrid: A Data Repository and Computing Grid for Biometrics Research](https://reader036.fdocuments.us/reader036/viewer/2022062520/56815f85550346895dce8ac8/html5/thumbnails/21.jpg)
AllPairs Result
• 10,000 irises vs. 10,000 irises• Condor pool: 32 nodes• AllPairs took 150 minutes to complete 100,000,000 comparisons
• Speedup: ~ 7 times
21
![Page 22: BXGrid: A Data Repository and Computing Grid for Biometrics Research](https://reader036.fdocuments.us/reader036/viewer/2022062520/56815f85550346895dce8ac8/html5/thumbnails/22.jpg)
ROC Cruve
22
![Page 23: BXGrid: A Data Repository and Computing Grid for Biometrics Research](https://reader036.fdocuments.us/reader036/viewer/2022062520/56815f85550346895dce8ac8/html5/thumbnails/23.jpg)
Workflow Summary
23
Transform AllPairsB1
B2
B3
A1 A2 A3
F F F
F
F F
F F
F
Condor Condor
Iris Iris Code
Result Matrix
Storage Cluster
![Page 24: BXGrid: A Data Repository and Computing Grid for Biometrics Research](https://reader036.fdocuments.us/reader036/viewer/2022062520/56815f85550346895dce8ac8/html5/thumbnails/24.jpg)
Future Works
• Run bigger Transform & All-Pairs experiments• Using Condor to perform Automated Validation
• Extend the repository for other types of data
24
![Page 25: BXGrid: A Data Repository and Computing Grid for Biometrics Research](https://reader036.fdocuments.us/reader036/viewer/2022062520/56815f85550346895dce8ac8/html5/thumbnails/25.jpg)
25
![Page 26: BXGrid: A Data Repository and Computing Grid for Biometrics Research](https://reader036.fdocuments.us/reader036/viewer/2022062520/56815f85550346895dce8ac8/html5/thumbnails/26.jpg)
Acknowledgments
• Cooperative Computing Lab– http://www.cse.nd.edu/~ccl
• BXGrid– http://bxgrid.cse.nd.edu
Grad StudentsGrad Students– Chris MorettiChris Moretti– Li YuLi Yu– Deborah ThomasDeborah Thomas– Karen HollingswortKaren Hollingswort– Tanya PetersTanya Peters
Faculty:Faculty:– Douglas ThainDouglas Thain– Patrick FlynnPatrick Flynn
Undergrads & StaffUndergrads & Staff– Mike KellyMike Kelly– Rory CarmichaelRory Carmichael– Mark PasquierMark Pasquier– Christopher LyonChristopher Lyon– Diane WrightDiane Wright
26
![Page 27: BXGrid: A Data Repository and Computing Grid for Biometrics Research](https://reader036.fdocuments.us/reader036/viewer/2022062520/56815f85550346895dce8ac8/html5/thumbnails/27.jpg)
Question
27