Practical privacy issuesaround Learning Analytics

Learning Analytics and Knowledge 2013

Abelardo Pardo (@abelardopardo)The University of Sydney

www.slideshare.net/abelardo_pardo

danxoneilFlickr

Abelardo Pardo Practical privacy issues around Learning Analytics 2

horrigansFlickr

This talk is NOT about...

Generic analysis of privacy

Ramifications into ethics,societal issues, laws,governments

Abelardo Pardo Practical privacy issues around Learning Analytics 3

nevolutionFlickr

This talk IS

Restricted to theLA context

Review principlesto consider

Based on practicalguidelines

Abelardo Pardo Practical privacy issues around Learning Analytics 4

EleafFlickr.comGenerate more questions

Where to focus the questions?

Abelardo Pardo Practical privacy issues around Learning Analytics 5

Mark

Coggins

flickr.com

Delicate issue!

Abelardo Pardo Practical privacy issues around Learning Analytics 6

Wootpeanuts

flickr.com

Prevents reaching a practical solution

Abelardo Pardo Practical privacy issues around Learning Analytics 7

malias

flickr.com

EnvironmentGeneralview

LAScenarios

Abelardo Pardo Practical privacy issues around Learning Analytics 8

malias

flickr.com

Environment

Abelardo Pardo Practical privacy issues around Learning Analytics 9

http://blog.stephenwolfram

.com/2012/03/the-personal-analytics-of-m

y-life(lastaccessed

March

2013)

Is she pregnant?

Abelardo Pardo Practical privacy issues around Learning Analytics 10

Dailym

ail.co.uk/news/article-2102859/H

ow-Target-know

s-shoppers-pregnant–figured-teen-father-did.html(lastaccessed

March

2013)

Abelardo Pardo Practical privacy issues around Learning Analytics 11

http://hdguru.com/is-your-new

-hdtv-watching-you/7643

(lastaccessedM

arch2013)

Abelardo Pardo Practical privacy issues around Learning Analytics 12

GreatB

eyondflickr.com

Privacy as a currency

B2B Data Market

Abelardo Pardo Practical privacy issues around Learning Analytics 13

http://theweek.com

/article/index/229508(lastaccessed

March

2013)

Lowerpremium

With GPS

Without GPS

Abelardo Pardo Practical privacy issues around Learning Analytics 14

ww

w.nytim

es.com(lastaccessed

March

2013)

Abelardo Pardo Practical privacy issues around Learning Analytics 15

malias

flickr.com

EnvironmentGeneralview

Abelardo Pardo Practical privacy issues around Learning Analytics 16

https://ww

w.privacyassociation.org/resource_center/consum

er_data_privacy_in_a_networked_w

orld(lastaccessed

March

2013)

Abelardo Pardo Practical privacy issues around Learning Analytics 17

http://ww

w.csa.ca/cm

/ca/en/privacy-code(lastaccessed

March

2013)

Abelardo Pardo Practical privacy issues around Learning Analytics 18

arstechnica.com/tech-policy/2013/02/eu-data-law

-proposal-uses-language-word-for-w

ord-from-us-eu-corporations

(lastaccessedM

arch2013)

Similar legislation

Absolute confidentiality: undesiredData ownershipInformation flow

Abelardo Pardo Practical privacy issues around Learning Analytics 19

Reigh

LeBlanc

flickr.com

Uninformed consent isconsidered under specialcircumstances

Abelardo Pardo Practical privacy issues around Learning Analytics 20

http://ww

w.nature.com

/nm/journal/v13/n9/full/nm

0907-999.html

Abelardo Pardo Practical privacy issues around Learning Analytics 21

anthonylibrarianFlickr

Internet requires new approach to privacy

Before: Limitingsurveillance, restrictingaccess to information,curtailing intrusions intoprivate space.

Additionally: How is datacaptured, who owns it, howis it shared?

Abelardo Pardo Practical privacy issues around Learning Analytics 22

Sm

all_Realm

Flickr

People act in different roles and contexts

Applications should respect these contexts

Context Integrity: Framework to provideguidance to solve privacy related conflicts.

Abelardo Pardo Practical privacy issues around Learning Analytics 23

ContextTravelflickr.com

Appropriateness & Distribution

(Nissenbaum, H., 2004, Privacy as Contextual Integrity, Washington Law Review, 79(1))

Abelardo Pardo Practical privacy issues around Learning Analytics 24

Cotton|Joe

Flickr

Appropriateness

What is collected?

What is revealed?

Valid in one context,invalid in another

Abelardo Pardo Practical privacy issues around Learning Analytics 25

johnthrmFlickr

Distribution

Who sees the data?

When?

For what purpose?

Abelardo Pardo Practical privacy issues around Learning Analytics 26

malias

flickr.com

EnvironmentGeneralview

LAScenarios

Database withK-12 Student data

Abelardo Pardo Practical privacy issues around Learning Analytics 27

http://ww

w.reuters.com

/article/2013/03/03/us-education-database-idUS

BR

E92204W

20130303(lastaccessed

March

2013)

Abelardo Pardo Practical privacy issues around Learning Analytics 28

deepwarren

Flickr

Observe in and out of the classroom

Case 1: K-12 Out-of-class support

1 Collection while doing homework in tablet

2 Data used by teachers to personalizeactivities.

3 Available to all teachers in the school.

4 Performance vs demographic factorscorrelated.

5 Available to platform vendors.

6 Kept for ever.

Abelardo Pardo Practical privacy issues around Learning Analytics 29

Case 2: University course

1 Collected in LMS and mobile application.

2 Available to instructors for personalization.

3 Some data considered for assessment.

4 Available to university-wide units:counseling, recruiting, marketing.

5 Analyzed Retention vs demographic.

6 eTextbook access available to publishers.

7 Kept for ever.

Abelardo Pardo Practical privacy issues around Learning Analytics 30

Case 3: Distance education

1 Data collected in LMS.

2 Available to instructors for personalizationpurposes.

3 Analyzed performance vs demographic.

4 Some data considered for assessment.

5 Results used in scientific publication.

6 Results available to funding institutions.

7 Student right to request data removal.Abelardo Pardo Practical privacy issues around Learning Analytics 31

Ethical Principles

• LA as a moral practice

• Students as agents at the center

• Data is temporal and dynamic

• Student success is complex andmultidimensional

• Transparency

• Institutions obliged to use data

Abelardo Pardo Practical privacy issues around Learning Analytics 32

(Slade, S., Prinsloo, P. 2013, Learning Analytics: Ethical Issues and Dilemmas, American Behavioral Scientist)

Practical Principles• Transparency: Explicit description of how

data is collected, manipulated, stored andaccessed

• Students as data owners: Include right toconsult, modify or remove data

• Data access policies: clearly stated andobserved.

• Accountability and assessment:Embedded constant review and auditing ofthe policy.

Abelardo Pardo Practical privacy issues around Learning Analytics 33

Transparency• Means to achieve Legitimacy

• Apply across the board

• Easily accessible and clearly explaineddocumentation

• How is data collected

• Who has access to the data

• Which calculations are performed

• How long is the data valid and availableAbelardo Pardo Practical privacy issues around Learning Analytics 34

lrargerichFlickr

Students as data owners• Right to access, amend,

delete data

• Institutions areborrowing the data

• In conflict with deriveddata

• Affects system design

• Consider fixed life spanof collected data

Abelardo Pardo Practical privacy issues around Learning Analytics 35

Images

ofMoney

Flickr

Data Access Policies• Clarify the roles when

accessing data

• Extend to derived data

• Consider connectionwith research

• Beware of“anonymization” or“deidentification”

Abelardo Pardo Practical privacy issues around Learning Analytics 36

Chris

Cam

bpelll

On “anonymization”

• Comprehensiveanonymized dataset ofcourse participation

• Include forum posts

• All students introducedthemselves in forum thefirst week

• Student joins the courselater.

Abelardo Pardo Practical privacy issues around Learning Analytics 37

OperationP

aperStorm

Flickr

Accountability and Assessment

• Each aspect has aresponsible person,body, department.

• Process continuously“under improvement”

• Consider allstakeholders

Abelardo Pardo Practical privacy issues around Learning Analytics 38

colemam

aFlickr

Case 1: K-12 Out-of-class support

1 Collection while doing homework in tablet

2 Data used by teachers to personalizeactivities.

3 Available to all teachers in the school.

4 Performance vs demographic factorscorrelated.

5 Available to platform vendors.

6 Kept for ever.

Abelardo Pardo Practical privacy issues around Learning Analytics 39

Case 2: University course

1 Collected in LMS and mobile application.

2 Available to instructors for personalization.

3 Some data considered for assessment.

4 Available to university-wide units:counseling, recruiting, marketing.

5 Analyzed Retention vs demographic.

6 eTextbook access available to publishers.

7 Kept for ever.

Abelardo Pardo Practical privacy issues around Learning Analytics 40

Case 3: Distance education

1 Data collected in LMS.

2 Available to instructors for personalizationpurposes.

3 Analyzed performance vs demographic.

4 Some data considered for assessment.

5 Results used in scientific publication.

6 Results available to funding institutions.

7 Student right to request data removal.Abelardo Pardo Practical privacy issues around Learning Analytics 41

Abelardo Pardo Practical privacy issues around Learning Analytics 42

johnthurmFlickr

Privacy changed inInternet era

Integrity of the LearningContext

Appropriateness &Distribution

Ethical and Implementationprinciples

Practical privacy issuesaround Learning Analytics

Learning Analytics and Knowledge 2013

Abelardo Pardo (@abelardopardo)The University of Sydney

www.slideshare.net/abelardo_pardo

danxoneilFlickr