FBI: Facial Recognition and Identification Initiatives

7/30/2019 FBI: Facial Recognition and Identification Initiatives

1/18

Richard W. Vorder Bruegge

Federal Bureau of Investigation


2/18

2

Image Technology in the Forefront

Unparalleled ease of capturing, storing, copying, andsharing images

Proliferation of surveillance cameras, expanding global

media enterprises, and average citizens with mobilephone still and video camera capabilities

Unprecedented level of sharing images and videos via

the internet and other advanced communication methods Photographs and videos depicting victims, suspects, and

eyewitnesses are becoming the subject of investigations
http://images.google.com/imgres?imgurl=http://www.dasecurity.co.uk/content/images/stories/security_cctv.jpg&imgrefurl=http://www.dasecurity.co.uk/content/index.php?option=com_content&view=article&id=54&Itemid=62&usg=__DCdTSqP-PclvlYA-gOOOZ9241OY=&h=309&w=480&sz=85&hl=en&start=15&um=1&itbs=1&tbnid=9CqKlbNNFozafM:&tbnh=83&tbnw=129&prev=/images?q=cctv&hl=en&rlz=1T4GGLL_enUS352US353&um=1http://images.google.com/imgres?imgurl=http://www.softhook.com/cctv.jpg&imgrefurl=http://www.softhook.com/cctv.htm&usg=__8ugkoKHq9RzaTEdbjcPo4zG1tJI=&h=300&w=400&sz=34&hl=en&start=1&um=1&itbs=1&tbnid=vKk4rorrYOlvBM:&tbnh=93&tbnw=124&prev=/images?q=cctv&hl=en&rlz=1T4GGLL_enUS352US353&um=1http://images.google.com/imgres?imgurl=http://imag.malavida.com/mvimgbig/download/webshots-desktop-383-1.jpg&imgrefurl=http://webshots-desktop.en.malavida.com/d383-free-download-windows&usg=__Db0lE3JqEk3szWvB6oiZ-cxk3y4=&h=400&w=550&sz=64&hl=en&start=5&um=1&itbs=1&tbnid=YFOUs7vX3biTjM:&tbnh=97&tbnw=133&prev=/images?q=webshots&hl=en&rlz=1T4GGLL_enUS352US353&um=1http://images.google.com/imgres?imgurl=http://lifeinthenhs.files.wordpress.com/2009/02/facebook.jpg&imgrefurl=http://lifeinthenhs.wordpress.com/2009/02/01/facebook-good-or-evil/&usg=__InULO8YyGGNQAghU21c7rsqNNnU=&h=303&w=404&sz=42&hl=en&start=4&um=1&itbs=1&tbnid=d67dH1OGh4R_sM:&tbnh=93&tbnw=124&prev=/images?q=facebook&hl=en&rlz=1T4GGLL_enUS352US353&um=1


3/18

Face: Forensic Discipline And Biometric

3

Biometrics

Biometrics Forensics

Forensics

A measurable biological(anatomical andphysiological) or behavioralcharacteristic used foridentification Facial Recognition (FR) -

the automated searchingof a facial image in acomputer database,

typically resulting in agroup of facial imagesranked by computer-evaluated similarity

A measurable biological(anatomical andphysiological) or behavioralcharacteristic used foridentification

Facial Recognition (FR) -the automated searchingof a facial image in acomputer database,

typically resulting in agroup of facial imagesranked by computer-evaluated similarity

Visible physical characteristicsone can use for the purposesof measurements orcomparisons that are collectedafter an event

Facial Identification (FI) - themanual examination of thedifferences and similaritiesbetween two facial images

for the purpose ofdetermining if they representdifferent persons or thesame person

Visible physical characteristicsone can use for the purposesof measurements orcomparisons that are collectedafter an event

Facial Identification (FI) - themanual examination of thedifferences and similaritiesbetween two facial images

for the purpose ofdetermining if they representdifferent persons or thesame person

Event


4/18

4

FI & FR Address Multiple Missions

Mission Areas:

Access control

Automated identityverification

Human identification

ScreeningSurveillance

Law enforcement &

national securityinvestigations

Identity intelligence to

understand intent


5/18

5

FBI Facial Use Cases

Identifying fugitives and missing persons in FRsystems

Identifying unknown persons of interest fromimages (1:N)

Tracking subjects movements to/from criticalevents (e.g., 9/11)

Conducting automated surveillance at lookoutlocations (1:M, where 1


6/18

6

Identifying Subjects from Images

for 40 Years The FBIs Facial Recognition/Identificationwork is performed within the Forensic Audio,

Video, and Image Analysis Unit (FAVIAU) The FAVIAU is one of only a few accredited

laboratories in the world that conductsexaminations in the disciplines of video,image, and audio analysis


7/18

The Biometric Center of Excellence (BCOE)is the Federal Bureau of Investigations (FBI) program for

exploring and advancing the use of new and enhanced biometric

technologies and capabilities for integration into operations7

Driving New FBI Biometric Capabilities


8/18

8

Sponsoring Applied Research

Ongoing applied research, development, test & evaluation:Universal Face & Iris WorkstationFBI Facial Collaboration-Facial

Landmarking/Facial AgingAutomated Face Detection andRecognition in Video

FI/FR of Twins (blemishes)Obscuring Identity in VideoReproFace (2D-3D-2D)Facial Image and Camera Certification Process

Automated Retrieval of Scars, Marks, and TattoosEar RecognitionMultiple Biometric Grand Challenge/Multiple Biometric

Evaluation/ III Data Set Testing


9/18

9

Sponsoring Standards Development

Facial Identification Scientific Working Group (FISWG)

Sponsored by the BCOE and established in 2009

Mission - develop consensus standards, guidelines, andbest practices for the discipline of image-basedcomparisons of human features

Participants include federal, state, local, andinternational government agencies, as well as invitednon-governmental organizations

Next meeting scheduled for November 15-18 inSan Antonio, Texas

Visit www.FISWG.org
http://www.fiswg.org/http://www.fiswg.org/


10/18

Deepening FR Collaboration

Sponsored the International Face Collaboration Meeting

5 foreign countries and 11 U.S. agencies participated

Participated in the FR workshop From Bones to Bits

55 U.S. government and 47 contractor attendees

Sponsored the U.S. Government Facial CollaborationMeeting

88 attendees representing numerous law

enforcement, intelligence, and militaryagencies

10


11/18

Analyzing Legal And Privacy Concerns

Tasks associated with this analysis include:

Identifying databases external to the FBI to which theFBI has legal access

Defining policy for both automated and human-tandem

searching of databases and methods of how the imagesare used in searching and how they are destroyed orretained

Identifying privacy implications of applied research usingimages of human subjects

11


12/18

Developing Training Curriculum

12


13/18

Preparing for FR incorporation into

Next Generation Identification (NGI)

The NGI system: Incremental replacement of the current IAFIS Improving current functionality and providing new

functionality Developing multimodal collection and search identification

services

An upgrade to IAFIS The FBI is developing an automated,interoperable multimodal biometric system

13

Enhancedtenprintservices

2011

Palmprints

and latents

2012Photos/Facial,scars, marks,and tattoos

2013Iris

2014

13


14/18

Value Of the FBI-DMV Pilot

OperationalResults

FR SystemTesting

Identificationof Follow-OnProjects

The BCOE-sponsored FR pilot program with NC

DMV led to more than 700 leads including:

One federal fugitive apprehension Six state fugitive apprehensions

One missing person resolution

The BCOE-sponsored FR pilot program with NC

DMV led to more than 700 leads including:

One federal fugitive apprehension Six state fugitive apprehensions

One missing person resolution

FACEMASK has also served as an opportunityfor FBI analysts to operationally test a FR systemand determine its strengths and weaknesses.This aids the FBI as it develops its own FR

capability

FACEMASK has also served as an opportunityfor FBI analysts to operationally test a FR systemand determine its strengths and weaknesses.This aids the FBI as it develops its own FR

capabilityDue to this success, the FBI took advantage of anongoing survey of U.S. DMVs and used it as anopportunity to identify other prospective state

DMVs for follow-on projects

Due to this success, the FBI took advantage of anongoing survey of U.S. DMVs and used it as anopportunity to identify other prospective state

DMVs for follow-on projects


15/18

Purpose Of The DMV Survey

Initial PurposeInitial Purpose

Collect DMV FR POCInformation

Identify DMVs that

have implementedFR systems

Collect DMV FR POCInformation

Identify DMVs that

have implementedFR systems

Expanded PurposeExpanded Purpose

Gather data about FR vendors, state laws, andsearch protocol to help the FBI identify a DMV for apotential follow-on project

Technical systems information Receptiveness to collaborating with the FBI

Various concerns and suggestions voiced by theDMVs and trends were recorded

Gather data about FR vendors, state laws, andsearch protocol to help the FBI identify a DMV for apotential follow-on project

Technical systems information Receptiveness to collaborating with the FBI

Various concerns and suggestions voiced by theDMVs and trends were recorded

The FBI wanted to identify key FR POC in order to directinquiring investigators and agencies. The original DMVsurvey focuses around contact information; however, with the

success of the original pilot the purpose and scope of thedata gathering effort changed.


16/18

Potential FBI-DMV FR Pilot Expansion

Active FR System

NO FR System

Unknown/No Response

Key Takeaway: More than half of all state DMVs have FR systems. Their main goal is to

detect and combat fraud

Key Takeaway: More than half of all state DMVs have FR systems. Their main goal is to

detect and combat fraud

Responses current as of (05/28/2010)

16

* *

**

* ***

*

*

*

*

*

*

*

*

*

*

Permit Law EnforcementAccess to Data*


17/18

DMV Survey High Level FindingsSpecific FindingsSpecific Findings

The vast majority of states that have FR Systems use L1 Technologies The vast majority of states that have FR Systems use L1 TechnologiesTechnologyTechnology

VendorsVendors

Legal RequirementsLegal Requirements

FundingFunding

KnowledgeKnowledge

Many DMV image databases are maintained and searched by their vendors.This presents privacy issues that should be explored

Many DMV image databases are maintained and searched by their vendors.This presents privacy issues that should be explored

Across the nation, there are widely varying legal requirements. To initiatesearches, some DMVs require Memorandums of Understanding (MOU)while some just require the requesting agency to buy their vendorssoftware

Across the nation, there are widely varying legal requirements. To initiatesearches, some DMVs require Memorandums of Understanding (MOU)while some just require the requesting agency to buy their vendors

software

Due to a lack of funding, some states who had planned to develop FRsystems had to delay or cancel their plans due to budgetary constraints

Due to a lack of funding, some states who had planned to develop FRsystems had to delay or cancel their plans due to budgetary constraints

Many DMV POCs lacked technical knowledge about their systems and thelegal issues involved in their use. Since most POCs were unable orunwilling to nominate alternative POCs, more in-depth research may berequired before FBI collaboration can be considered (i.e., researching statelaws that apply to the DMVs FR system or interviewing a DMVs vendor formore specific systems information)

Many DMV POCs lacked technical knowledge about their systems and thelegal issues involved in their use. Since most POCs were unable orunwilling to nominate alternative POCs, more in-depth research may berequired before FBI collaboration can be considered (i.e., researching statelaws that apply to the DMVs FR system or interviewing a DMVs vendor formore specific systems information)


18/18

Questions / Comments

Contact Information:

Richard Vorder Bruegge

Email: [email protected]

Additional Resources:

www.BiometricCoE.gov

Email: [email protected]

18

FBI: Facial Recognition and Identification Initiatives

Documents

Transcript of FBI: Facial Recognition and Identification Initiatives