Messinger.openshapa.091511

Measurement, analysis, and sharing

September 15, 2011

From openshapa to open data sharing

Daniel Messinger, Ph.D.

University of Miami

Overview

Problem: Lack of sharing

Continuous measurement

Objective—automated

Subjective

Analysis tools

Categorical measurement

Analysis tools

Solution? Share behavioral databases…

http://measurement.psy.miami.edu/

Measurement problems

plague the behavioral sciences

Investigator-specific systems

Each lab re-invents the wheel

in its own image

hampering replication


Broader systems have emerged

Facial Action Coding System (FACS)

Require substantial training & implementation


Instantiate with automated measurement

Computer Vision


Parent-Infant Interaction Infant Smile, Mother Smile

http://measurement.psy.miami.edu/ Messinger, et al., 2009

Variability at Every Level

0

1

2

3

4

5

0 10 20 30 40 50 60 70 80 90 100 110 120 130 140 150 160 170 180

Fa

cial

Act

ion

s &

Tic

klin

g

0

1

2

3

4

5

Dyad

AD

yad B

.35 .50 .36 .21

.47 .42 .28 .58



Tools for continuous data

Rating Constructs Directly

Baker et al., 2010;

Chow et al., 2010


Rationale

Human beings are

expert at the

continuous, intutive

evaluation of others

The wisdom of

crowds….aggregate

independent

observations http://measurement.psy.miami.edu/


Seconds

180.00170.00160.00150.00140.00130.00120.00110.00100.0090.0080.0070.0060.0050.0040.0030.0020.0010.00.00

Em

oti

on

al V

ale

nce R

ati

ng

s

140.00

120.00

100.00

80.00

60.00

40.00

20.00

0.00

Infant

Parent

Object of Measurement: 11.10

Time-series Mean

Baker et al., 2010a

Data analysis tools

(responsivity varies in time)

it

ti

it

itit

B

ParentInfant 1,01

itB

it

ti

ti

ti

it

ti

it

BB ,

,

1,

2,

1,21

1, 0

100

001

0

Chow et al., 2010

Inte

rac

tive

In

flu

en

ce

http://measurement.psy.miami.edu/ Chow et al., 2010

Reliability with expert measurement


Non-Expert Sensitivity Ex

per

t S

ensi

tiv

e S

tru

cturi

ng

Exper

t F

amil

y C

on

flic

t

Non-Expert Family Conflict

Baker et al., 2010b

http://measurement.psy.miami.edu/cms.phtml


Coding tool


Frame-by-frame

procession

Easy Interface

User-defined

codes

Categorical data enable

identification of patterns


Finding Temporal Patterns

http://measurement.psy.miami.edu/ Yale et al., 1999;

Yale et al., 2003

psy.miami.edu/faculty/dmessinger/

To Create Simulated Pattern

Smile

Gaze

SM SM

No Smiles Gazes Away

Gazes at Mom Smiles

SM

SM

Observed Behaviors

Time

Document the existence of patterns

psy.miami.edu/faculty/dmessinger/

Gaze

Observed Pattern

Smile SM SM

Z = (Observed – Simulated)/SDS

Smile in Gaze!

Finding Temporal Patterns in Data

Simulated

Random Pattern

SM SM Smile

Gaze

Time

Subtract

Repeat 2000 times.

The problem:

Studying a common phenomenon…

Neonatal imitation or not…

Meltzoff

Google search…. macaques


Sharing Behavioral Data


Automated measurement is

collaborative research

The Computer Expression

Recognition Toolbox

http://mplab.ucsd.edu/~marni/Pro

jects/CERT.htm

http://www.pitt.edu/~jeffcohn/

http://www.ri.cmu.edu/research_lab_group

_detail.html?lab_id=51&menu_id=263

Commercial software…http://www.noldus.com/news/new-facereader-30


http://www.noldus.com/news/new-facereader-30





Computer vision models


The IRB issue…


Surmountable…

Thanks!

Mohammad Mahoor, Lisa Ibanez, Jeffrey

Cohn, Alan Fogel, & Sy-Miin Chow


Messinger.openshapa.091511

Technology

Transcript of Messinger.openshapa.091511