Facial Image Comparison Feature List for Morphological ... · FISWG Facial Image Comparison Feature...

FISWG Facial Image Comparison Feature List for Morphological Analysis 0

This document includes a cover page with the FISWG disclaimer

Disclaimer: As a condition to the use of this document and the information contained herein, the Facial Identification Scientific Working Group (FISWG) requests notification by e-mail before or contemporaneously to the introduction of this document, or any portion thereof, as a marked exhibit offered for or moved into evidence in any judicial, administrative, legislative, or adjudicatory hearing or other proceeding (including discovery proceedings) in the United States or any foreign country. Such notification shall include: 1) the formal name of the proceeding, including docket number or similar identifier; 2) the name and location of the body conducting the hearing or proceeding; and 3) the name, mailing address (if available) and contact information of the party offering or moving the document into evidence. Subsequent to the use of this document in a formal proceeding, it is requested that FISWG be notified as to its use and the outcome of the proceeding. Notifications should be sent to: [email protected]

Redistribution Policy: FISWG grants permission for redistribution and use of all publicly posted documents created by FISWG, provided that the following conditions are met: Redistributions of documents, or parts of documents, must retain the FISWG cover page containing the disclaimer. Neither the name of FISWG, nor the names of its contributors, may be used to endorse or promote products derived from its documents. Any reference or quote from a FISWG document must include the version number (or creation date) of the document and mention if the document is in a draft status.

Version 1.0 2013.11.22

Section X

Facial Image Comparison Feature List for Morphological Analysis



Purpose The purpose of this document is to provide a standardized facial feature list to be considered when conducting a morphological analysis.

Introduction The FISWG document “Guidelines for Facial Comparison Methods” (see current version at https://www.fiswg.org/doc) states, “Morphological analysis should be undertaken in a systematic manner and include a list of the features to be compared for every examination.” The feature list presented in this document is intended to serve as the FISWG standard. Any reference in this document to the word “face” refers to features of the face, head and neck. This list includes the features of the face that may be visible and comparable between images. Features in this document are presented from top to bottom of the face, and are not provided in order of importance or priority. This document is not intended to cover the entire comparison process. Future FISWG documents will cover topics such as how much features change over time (natural, accidental and intentional), how imaging conditions (e.g., pose, illumination, expression, resolution) affect feature appearance, comparison and evaluation strategies, and conclusion scales.

Facial Feature List The following feature list is divided into two sections with different levels of detail. The contents of the first section, Facial Components, are gross features considered in virtually all comparisons. The contents of the second section, Component Characteristics, expand on the Facial Components section by providing a list of detailed features and their associated Characteristic Descriptors. Note: There are several instances in this document in which the term “distance” or “approximate distance” is used. When this term is used, FISWG does not mean to imply that the precise value of this dimension must be determined, but rather the relative size of this dimension compared to the overall width or height of the face, if not otherwise specified. FISWG recommends that photoanthropometry not be used at all due to its limitations (see current version of “Guidelines for Facial Comparison Methods” at https://www.fiswg.org). Note on illustrations: In the illustrations, dotted lines indicate the relevant feature.

Version 1.0 2013.11.22



Facial Components The details of the human face can be subdivided at multiple scales. The “Facial Components” list provided below represents the first subdivision of the face. When imaging conditions allow, it may be possible to further subdivide these components. Any standard procedure addressing facial comparison analysis should consider all of the components identified below.

ID Facial Components 1 Skin

2 Face/Head Outline

3 Face/Head Composition

4 Hairline/Baldness Pattern

5 Forehead

6 Eyebrows

7 Eyes

8 Cheeks

9 Nose

10 Ears

11 Mouth

12 Chin/Jawline

13 Neck

14 Facial Hair

15 Facial Lines

16 Scars

17 Facial Marks

18 Alterations

19 Other

Facial Components: 1—Skin “Skin” refers to the overall appearance of the skin.

1—Skin Component Characteristics Characteristic Descriptors

1.1 Overall Skin Appearance Overall Texture Overall Tone: e.g. luminance and color

Version 1.0 2013.11.22



Facial Components: 2—Face/Head Outline “Face/Head Outline” refers to the overall shape of the head and face.

2—Face/Head Outline Component Characteristics Characteristic Descriptors

2.1 Shape of Cranial Vault Portrait Contour Profile Contour

2.2 Overall Shape of Face Portrait Contour Profile Contour

Version 1.0 2013.11.22



Facial Components: 3—Face/Head Composition “Face/Head Composition” refers to the overall configuration of the facial components, to include their alignment and relative sizes, internal to a single face.

3—Face/Head Composition Component Characteristics Characteristic Descriptors

3.1 Proportions/Position of Features on Face

Approximate width of nose relative to eye distances (e.g., interpupillary distance, individual eye width, or overall distance between outer corners)

Approximate width of mouth relative to eye distances

Approximate width of nose relative to mouth

Approximate distance from nose to upper lip relative to face length

Approximate distance from chin to lower lip relative to face length

Ear position relative to eyes, nose, and mouth

Eye position relative to face length

Illustration 3.1a shows some of the traditional canons for ideal facial proportions (Vegter and Hage, 2000). Not all faces will conform to the proportions presented in this diagram. In this illustration: A. The face can be divided into three equal parts: hairline to nasal root (bridge), nasal root to nasal base, and nasal base to chin; B. The width of the chin is the same as the width of the mouth; C. The distance between the inner corners of the eyes is equal to the width of one eye; D. The mentolabial sulcus is half the distance from the nasal base to the chin.

Version 1.0 2013.11.22



Illustration 3.1b shows examples of alterations to the positions among facial components and the effect those positions have on the overall face/head composition. A. This face shows the proportions as they are presented in the previous illustration. B. The eyes and eyebrows have been moved toward the midline (medially) and the tip of the nose, the lips and philtrum have been raised toward the nose. C. The eyes and eyebrows have been raised, and the tip of the nose, the lips and philtrum have been moved down. D. The eyes and eyebrows have been moved away from the midline and the lips have been made smaller. The overall face shape has not been modified in any of the illustrations.

Version 1.0 2013.11.22



Facial Components: 4—Hairline/Baldness Pattern “Hairline/Baldness Pattern” refers to the shape and distribution of hair along top and side of the forehead to the top of the ears, to include gaps on the crown and sides of the head.

4—Hairline/Baldness Pattern

Component Characteristics Characteristic Descriptors

4.1 Forehead Hairline Detailed Shape (e.g. symmetry, “widow’s peak”, part line, “cowlick”)

4.2 Hairline Right Side 4.3 Hairline Left Side

Detailed Shape

4.4 Cranial Baldness Pattern Detailed Shape and distribution

Version 1.0 2013.11.22



Facial Components: 5—Forehead “Forehead” refers to the part of the face above the orbits, including the brow ridges.

5—Forehead Component Characteristics Characteristic Descriptors

5.1 Forehead Shape Relative height Relative width Slope/contour (visible in profile)

5.2 Brow Ridges Prominence Continuity

Version 1.0 2013.11.22



Facial Components: 6—Eyebrows “Eyebrows” refers to the strips of hair above the eye sockets.

6—Eyebrows Component Characteristics Characteristic Descriptors

6.1 Right Eyebrow 6.2 Left Eyebrow

Shape (may include detailed observations) Size (width and length of eyebrow relative to eye

size) Lateral eyebrow vertical end position relative to

medial eyebrow vertical position (tilt of eyebrow) (“A” in illustration)

Vertical end position of lateral eyebrow relative to the lateral canthus (“B” in illustration)

Vertical end position of medial eyebrow relative to the medial canthus (“C” in illustration)

Horizontal end position of lateral eyebrow relative to lateral canthus (“D” in illustration)

Horizontal end position of medial eyebrow relative to medial canthus (“E” in illustration)

Conjoined left-right eyebrows (“unibrow”) Density of hair within eyebrow and distribution of

density Hair details (e.g. texture, length, thickness,

shape, color) Noticeably longer hairs

6.3 Asymmetry Between Right and Left Eyebrows

e.g. overall shape, size, position, and hair details (see individual eyebrow Descriptors)

Illustration 6.1 (6.2) shows the position of the eyebrow relative to the position of the eye opening. A. Lateral eyebrow vertical end position relative to medial eyebrow vertical position. B. Vertical end position of lateral eyebrow relative to the lateral canthus. C. Vertical end position of medial eyebrow relative to the medial canthus. D. Horizontal end position of lateral eyebrow relative to the lateral canthus. E. Horizontal end position of medial eyebrow relative to the medial canthus. Facial Components: 7—Eyes “Eyes” refers to the ocular region below the eyebrows and above the cheeks.

Version 1.0 2013.11.22



7—Eyes Component Characteristics Characteristic Descriptors

7.1 Inter-Eye Distance Distance between right and left eye

7.2 Right Eye Fissure Opening 7.3 Left Eye Fissure Opening (Outline)

Shape Angle (angle from inner corner and outer corner

[when eyes are horizontal])

7.4 Right Upper Eyelid 7.5 Left Upper Eyelid (Including Lashes)

Prominence (e.g. visibility, folds) Protrusion Visibility of the crease above the upper eyelid

(superior palpebral furrow) Position in relation to iris and/or pupil Lash characteristics (e.g. length, density, flow,

irregular)

7.6 Right Lower Eyelid 7.7 Left Lower Eyelid (Including Lashes)

Prominence (e.g. visibility, folds) Protrusion Visibility of the crease below the lower eyelid

(inferior palpebral furrow) Visibility of infraorbital furrow (a place where a

line or wrinkle may appear parallel to and below the lower eyelid running from near the inner canthus and following cheek bone laterally)

Position in relation to iris and/or pupil Lash characteristics (e.g. length, density, flow,

irregular)

7.8 Right Eyeball Prominence 7.9 Left Eyeball Prominence

Degree of Protrusion

7.10 Right Eye Sclera 7.11 Left Eye Sclera

Visibility of blood vessels and defects Color

7.12 Right Iris 7.13 Left Iris

Color Visibility Diameter relative to eye opening Position relative to eye opening (in front view) Irregularity in pupil

7.14 Right Eye Medial Canthus 7.15 Left Eye Medial Canthus

Caruncle (fleshy prominence at inner eye corner) Shape and angle of inner corner of the eye

7.16 Right Eye Lateral Canthus 7.17 Left Eye Lateral Canthus

Shape and angle of outer corner of the eye

7.18 Asymmetry Between Right and Left Eyes

Shape, Angle Off-set (e.g. one eye higher than the other) Eyelids (e.g. one drooping, one retracted) &

Eyelashes Color Iris and pupil position (i.e. cross-eyed)

e.g. overall shape, size, position, and hair details (see individual eyebrow Descriptors)

Version 1.0 2013.11.22



7.1

7.4 (7.5)

7.2 (7.3)

7.14 (7.15)

7.6 (7.7)

7.12 (7.13)

7.16 (7.17)

7.10 (7.11)

Version 1.0 2013.11.22



Illustration 7.8 (7.9) shows the anterior (forward) projection of the eyes. A shows an eye with minimal prominence (projection forward from the socket), whereas B shows an eye with significant prominence.

7.8 (7.9)

7.14 (7.15)

7.16 (7.17)

Version 1.0 2013.11.22



Facial Components: 8—Cheeks “Cheeks” refers to the regions surrounded by the eyes, ears, nose, mouth, chin and jawline.

8—Cheeks Component Characteristics Characteristic Descriptors

8.1 Right Cheekbone 8.2 Left Cheekbone

Prominence

8.3 Right Cheek Shape 8.4 Left Cheek Shape (Soft Tissue)

Presence of dimple

Facial Components: 9- Nose “Nose” refers to the entire nasal region.

9—Nose Component Characteristics Characteristic Descriptors

9.1 Nasal Outline (Profile and Front view) Overall Shape Length and/or width relative to rest of

face Prominence Symmetry

9.2 Nasal Root (Bridge) Front View: width, length, shape, depth Profile View: length, depth, angle

9.3 Nasal Body Front View: width, length, shape, angle Profile View: length, angle, contour

9.4 Nasal Tip Shape (in front and profile view) Angle (e.g. up , down) Symmetry

9.5 Nasal Base Width Height Deviation to the right or left

9.6 Nasal Base: Alae (Wings of Nose) Thickness Symmetry Shape

9.7 Nasal Base: Nostrils (Nasal Openings) Shape and size of opening Symmetry Hair

9.8 Nasal Base: Columella (Soft Tissue between Nostrils)

Width and length Relative position Symmetry

Version 1.0 2013.11.22



9—Nose

Version 1.0 2013.11.22



Facial Components: 10—Ears “Ears” refers to the external characteristics of the ears.

10—Ears Component Characteristics Characteristic Descriptors

10.1 Asymmetry Between Left and Right Ears

Size Shape Protrusion Positioning (e.g. One is above the

other)

10.2 Right Ear Protrusion 10.3 Left Ear Protrusion

Extent of Protrusion

10.4 Overall Right Ear 10.5 Overall Left Ear

Size Shape Angle

10.6 Right Ear Helix—Superior/Inferior (Tail) 10.7 Left Ear Helix—Superior/Inferior (Tail)

Size Shape

10.8 Right Ear Tubercles (Auricular Tubercle) 10.9 Left Ear Tubercles (Auricular Tubercle)

Size Shape Quantity

10.10 Right Ear Antihelix 10.11 Left Ear Antihelix

Size Shape

10.12 Right Ear Crura of Antihelix (Superior, Inferior) 10.13 Left Ear Crura of Antihelix (Superior, Inferior)

Size Shape

10.14 Right Ear Triangular Fossa 10.15 Left Ear Triangular Fossa

Size Shape

10.16 Right Ear Crus of Helix 10.17 Left Ear Crus of Helix

Size Shape

10.18 Right Ear Scaphoid Fossa 10.19 Left Ear Scaphoid Fossa

Size Shape

10.20 Right Ear Concha (Superior, Inferior) 10.21 Left Ear Concha (Superior, Inferior)

Size Shape

10.22 Right Ear Tragus 10.23 Left Ear Tragus

Size Shape Protrusion

10.24 Right Ear Antitragus 10.25 Left Ear Antitragus

Size Shape Protrusion

10.26 Right Ear Intertragic Notch 10.27 Left Ear Intertragic Notch

Size Shape

10.28 Right Ear Anterior Knob 10.29 Left Ear Anterior Knob

Size Shape

Version 1.0 2013.11.22



10—Ears Component Characteristics Characteristic Descriptors

10.30 Right Ear Anterior Notch 10.31 Left Ear Anterior Notch

Size Shape

10.32 Right Ear Posterior Auricular Furrow 10.33 Left Ear Posterior Auricular Furrow

Size Shape

10.34 Right Ear Lobule (Lobe) 10.35 Left Ear Lobule (Lobe)

Size Shape Attached or Detached

10.36 Ear Abnormalities e.g. Cleft lobe; cauliflower

10.1 10.1

10.2 10.3

Version 1.0 2013.11.22



10.12 (10.13) Superior Crus

10.14 (10.15)

10.12 (10.13) Inferior Crus

10.16 (10.17)

10.20 (10.21)

10.22 (10.23)

10.20 (10.21)

10.26 (10.27)

10.34 (10.35)

(Unattached)

10.6 (10.7)

10.18 (10.19)

10.10 (10.11)

10.24 (10.25)

10.32 (10.33)

10.8 (10.9)

10.30 (10.30)

10.28 (10.29)

10.34 (10.35)

Attached

Version 1.0 2013.11.22



Facial Components: 11- Mouth “Mouth” refers to the entire oral region including the teeth and encompasses the philtrum.

11—Mouth Component Characteristics Characteristic Descriptors

11.1 Philtrum Prominence Width of ridges Width of furrow Symmetry

11.2 Overall Mouth Shape Symmetry

11.3 Upper Lip Shape Fullness Protrusion Symmetry Upper Vermilion Border Shape (e.g.

“Cupid's bow”) and definition Detail (e.g. tubercle, lip creases, alae)

11.4 Lower Lip Shape Fullness Protrusion Symmetry Lower Vermilion Border Shape &

definition Detail (e.g. median sulcus, tori, lip

creases)

11.5 Lip Fissure (Opening between Lips) Shape Symmetry Degree of contact/occlusion along

length of opening Corners/angles of mouth (Labial

Commissure)

11.6 Mouth Asymmetry Difference between left and right sides

11.7 Overall Dental Occlusion (Contact between Upper and Lower Teeth)

Symmetry Degree of contact/occlusion

11.8 Prognathism (Forward protrusion of mouth complex)

Degree

11.9 Characteristic Detail of Teeth Shape Size Alignment/Position (e.g. gaps, crooked,

missing) Condition (e.g. wear, damage, disease,

color)

11.10 Mouth Abnormalities Cleft Lip – A congenital deformity caused by abnormal facial development during gestation

Version 1.0 2013.11.22



Upper Vermilion Border

Lower Vermilion Border

Version 1.0 2013.11.22



Facial Components: 12—Chin/Jawline “Chin/Jawline” refers to the area of the face defined by the lower border of the mandible (a.k.a. "jaw bone"). The chin is the area on the lower jaw below the mouth. Jawline specifically refers to the area of the face defined by the lower border of the mandible between the chin and the Gonial Angle, or the point at which the lower border of the mandible abruptly changes direction from a primarily horizontal line to a primarily vertical line.

12—Chin/Jawline Component Characteristics Characteristic Descriptors

12.1 Chin (Profile and Frontal view) Overall Shape Length and/or width relative to rest of

face Prominence Symmetry Details (e.g. cleft, dimple, mental

groove; refer to wrinkles and folds)

12.2 Jawline (from Chin to Gonial Angle) Shape Definition (e.g. jowls)

12.3 Gonial Angle (Angle of the Jaw) Shape Definition

Version 1.0 2013.11.22



Facial Components: 13—Neck “Neck” refers to the transitional zone between the head and the trunk and limbs of the body.

13—Neck Component Characteristics Characteristic Descriptors

13.1 Neck (Overall) Width Height Details (e.g. musculature, veins,

wrinkles, folds, wattle, “double chin”)

13.2 Laryngeal Prominence (Adam's Apple) Shape Size Prominence Location on neck

Version 1.0 2013.11.22



Facial Components: 14—Facial Hair “Facial Hair” refers to hair on the face, typically covering the cheeks, chin/jaw, upper and lower lip, and neck of the face.

14—Facial Hair Component Characteristics Characteristic Descriptors

14.1 Facial Hair Above Upper Lip 14.2 Facial Hair Below Lower Lip

Shape/Spatial distribution (including overall hair length)

Texture Symmetry Density and distribution of density

including gaps Variation in color/tonality Orientation (slanted, straight) Outline/edge definition (e.g., sharp,

irregular) Continuity with facial hair on side(s) or

below/above mouth Noticeably Longer Hairs

14.3 Facial Hair on Right Side 14.4 Facial Hair on Left Side




irregular) Continuity with facial hair above or below

mouth Noticeably Longer Hairs

14.5 Facial Hair on Neck, below Chin/Jawline




irregular) Continuity with facial hair on side(s) or

below mouth Noticeably Longer Hairs

Facial Components: 15—Facial Lines Facial lines are described as wrinkles, folds or creases. Creases or folds are determined by craniofacial structure. Other lines, such as wrinkles, are age-related and are caused by muscle action, loss of elasticity of the skin and/or loss of subcutaneous fat/teeth at sunken areas. The

Version 1.0 2013.11.22



following list represents the most common facial lines and is not an exhaustive list. Special attention should be paid to any lines that do not correspond to those listed below.

15—Facial Lines Component Characteristics Characteristic Descriptors

15.1 Forehead Creases (Wrinkles) Distribution Orientation (vertical or horizontal) Quantity Pattern (Including relation to one

another) Depth/Prominence

15.2 Vertical Glabellar Line(s) Length Pattern (including relation to one


15.3 Nasion Crease Distribution Quantity Pattern (Including relation to one


15.4 Bifid Nose Crease Depth/Prominence Length

15.5 Wrinkles Adjacent to Right Eye (Crow's Feet) 15.6 Wrinkles Adjacent to Left Eye (Crow's Feet)

Distribution Quantity Pattern (Including relation to one


15.7 Right Superior Palpebral Crease 15.8 Left Superior Palpebral Crease (Crease between the Upper Eyelid and the Top of the Bony Orbit)

Visibility Position Depth/Prominence Shape

15.9 Right Lower Lid Crease 15.10 Left Lower Lid Crease (Crease between the Lower Eyelid and the Bottom of the Bony Orbit)

Visibility Position Depth/Prominence Shape

15.11 Right Infraorbital Creases 15.12 Left Infraorbital Creases (Creases below the Eyes)



15.13 Upper Lip Creases (Vertical Wrinkles above Upper Lip)



15.14 Lower Lip Creases (Vertical Wrinkles below Lower Lip)


Version 1.0 2013.11.22



15—Facial Lines Component Characteristics Characteristic Descriptors


15.15 Mentolabial Sulcus (Horizontal Crease or Fold between Lower Lip and Chin)

Shape Length Depth/Prominence

15.16 Right Nasolabial Crease/Folds 15.17 Left Nasolabial Crease/Folds (Creases or Folds extending from Nose to Corners of Mouth)



15.18 Right Marionette Lines 15.19 Left Marionette Lines

Pattern Depth/Prominence

15.20 Cleft Chin Depth/Prominence Size

15.21 Right Buccal Creases/Folds 15.22 Left Buccal Creases/Folds (Cheek to Chin)



15.23 Wrinkles on Neck Distribution Quantity Pattern (Including relation to one


(See next page for Facial Lines Illustration)

Facial Components: 16—Scars Scars are discolored areas of skin where permanent damage has healed (i.e. not recent damage). These areas may occur at any place on the face since they are typically caused by random trauma.

16—Scars Component Characteristics Characteristic Descriptors

16.1 Scars Location Shape Orientation Size Color/Tonality Depth/Prominence

Version 1.0 2013.11.22



Version 1.0 2013.11.22



Facial Components: 17—Facial Marks Facial marks are portions of skin such as freckles, moles, acne, rosacea, birth marks, bruises, abrasions, vitaligo, dark/light patches, etc. which contain a different level of pigment than the rest of the surrounding skin. These areas may occur at any place on the face since they are typically random in nature. Some facial marks, such as acne, bruises, abrasions, etc. are transient features, which require contemporaneous images for comparison.

17—Facial Marks Component Characteristics Characteristic Descriptors

17.1 Skin Marks (e.g. freckles, moles, acne, rosacea, birth marks, bruises, abrasions, vitaligo, dark/light patches, etc.)

Location/Distribution (Including relation to one another)

Shape Size Color Prominence

Facial Components: 18—Alterations Refers to any intentional modification to the face.

18—Alterations Component Characteristics Characteristic Descriptors

18.1 Piercing Location Description

18.2 Makeup Location Description (Shape, Size, Color, etc.)

18.3 Tattoo (Including Cosmetic)

Location Description (Content, Shape, Size,

Color, etc.)

18.4 Other Location Description

Facial Components: 19—Other The suite of components and characteristics identified above should be sufficient to address the vast majority of faces encountered in facial comparison situations. However, in some instances there may be deformities or other irregularities on a face that do not conform to this set of features. In such instances, it will be necessary to include these irregular features in the analysis. Given the unconstrained range of possibilities that this component set represents, FISWG has simply labeled this as “Other”.

19—Other Detailed Feature Characteristic List Feature Attribute List

19.1 Other text Description and Details

Version 1.0 2013.11.22



Reference List Vegter, F. and J. Hage, Clinical Anthropometry and Canons of the Face in Historical Perspective, Plastic and Reconstructive Surgery, Vol. 106, No. 5, 1090-1096, 2000.

Version 1.0 2013.11.22



FISWG documents can be found at: www.FISWG.org

Section Title

Section 1 Glossary

Section 2 Facial Comparison Overview

Section 3 Guidelines and Recommendations for Facial Comparison Training to

Competency

Section 4 Guidelines for Specifications, Procurement, Deployment, and Operations of Facial Recognition Systems

Section 5 Capture and Equipment Assessment for Facial Recognition Systems

Section 6 Guidelines for Facial Comparison Methods

Section 7 Recommendations for a Training Program in Facial Comparison

Section 8

Section 9

Section 10

Facial Image Comparison Feature List for Morphological ... · FISWG Facial Image Comparison Feature...

Documents

Transcript of Facial Image Comparison Feature List for Morphological ... · FISWG Facial Image Comparison Feature...