TheDELICATEchecklistinac3onApplyingEthics&PrivacyPoliciestoaLearningAnaly6csDashboard

HendrikDrachsler|@hdrachsler|#laceprojecteMadridconference,21.10.2016,Madrid,Spain.

LearningAnaly3cs

HEManagerssee:•  Promisevs.Concerns•  Poten6alvs.Risks•  Benefitsvs.Cost•  Purposevs.Compe66vePressures•  Inten6onsvs.Hesita6ons

•  LeadingtoConfusion

HEIs:HowtoimplementLA?

Ins3tu3onalisingLA

Recentset-backsineduca6on:•  (1)inBloom•  (2)Snappet

Acceptancefactors:Datasubjectsbeingsufficientlyawareoftheconsequencesofusingthesystem,thevalidityandrelevanceoftheresultsobtained,andtheleveloftransparencyofthedatamodel.

5

•  $100millioninvestment•  Aim:Personalizedlearninginpublicschools,throughdata&technology

standards•  9USstatespar6cipated,in2013dataaboutmillionsofchildren

havebeenstored

PrivacyasShow-StopperforLA

6

PrivacyasShow-StopperforLA

Ignoringthefearsandpublicpercep3onoftheapplica6onofanaly6cscanleadtoalackof

acceptance,protests,andevenfailureofen6reLAimplementa6ons.

7

RelatedResearchWork

Prinsloo&Slade(2013)Slade&Prinsloo(2013)Pardo&Siemens(2014)Prinsloo&Slade(2015)Hoel&Chen(2015)Sclater,Bailey(2015)Steiner,Kickmeier-Rust,Albert(2015)

hNp://bit.ly/lace-privacy.

8

RelatedPolicies

h]p://www.open.ac.uk/students/charter/essen6al-documents/ethical-use-student-data-learning-analy6cs-policy#

h]ps://www.jisc.ac.uk/sites/default/files/jd0040_code_of_prac6ce_for_learning_analy6cs_190515_v1.pdf

9

RelatedPolicies

h]p://www.ed.ac.uk/informa6on-services/learning-technology/learning-analy6cs

10

RelatedPolicies•  HEIlawondatacollec6oninNLlikeinall

EUcountriessinceNurembergtrials(datacollec6onallowedtoimproveeduca6on,clearpurpose,consent,limitedaccess)

•  Engelfriet,A.,Jeunink,E.,Manderveld,J.(2015).Learninganaly3csonderdeWetbeschermingpersoonsgegevens.h]ps://www.surf.nl/kennis-en-innova6e/kennisbank/2015/learning-analy6cs-onder-de-wet-bescherming-persoonsgegevens.html

•  SURFfollow-upreportwithusecasesinprepara6on

ResearchEthics

Originslieinpost-WWII.–Milestones:•  NurembergCode(1949)•  HelsinkiDeclara6on(1964)•  BelmontReport(1978)•  2000s:BiomedicalScience•  RRI(ResponsibleResearchandInnova6on)

UnethicalResearch

MilgramExperiment

StanfordPrisonExperiment

FacebookStudy

Privacy

•  Therighttobeleialone(Wes6n1968)•  Informa6onalself-determina6on(Flaherty1989)

•  Informa6onal,decisional,localprivacy(Roessler2005)

•  Privacyisnotanonymityordatasecurity!

Privacy

Contextual Integrity vs. Big Data Research

Context bound information vs.

Repurposing of data

WhoaretheBadGuys?

ME&

MYDATAGovernment? Commerce?

Educa6on? Hackers&BadGuys?

LegalFrameworks

•  EUDataProtec6onDirec6ve95/46/EC(automatedprocessingof‘personaldata’)2016:GeneralDataProtec6onRegula6on(GDPR)

•  Restric6ngthe(re-)useofdataà vs.andcontradic6ng•  BigDatabusinessmodels•  EuropeanDataReten6onDirec6ve2006/24/EC(datastorageforsecuritypurposes)

Moderniza3onofEUUniversi3esreportRecommenda3on14MemberStatesshouldensurethatlegalframeworksallowhigher

educa6onins6tu6onstocollectandanalyselearningdata.Thefullandinformedconsentofstudentsmustbearequirementandthedatashouldonlybeusedforeduca6onalpurposes.

Recommenda3on15Onlineplapormsshouldinformusersabouttheirprivacyanddata

protec6onpolicyinaclearandunderstandableway.Individualsshouldalwayshavethechoicetoanonymisetheirdata.

hNp://ec.europa.eu/educa3on/library/reports/modernisa3on-

universi3es_en.pdf

19

LegalFrameworks

h]ps://studentprivacypledge.org/

20

LegalFrameworks

Fears

•  Power-rela6onship,userexploita6on•  Dataownership•  Anonymityanddatasecurity•  Privacyanddataiden6ty•  Transparencyandtrust

Power-rela3onship

•  Trackingandid-ingusersorci6zensbystateorcorpora6ons(e.g.insurancecompanies,banks,carmanufacturers,etc.)=benefitnottotheuser!

•  Power-rela6onshipisasymmetrical

Exploita3on

•  Freelabourasbusinessmodeloffor-profitcompanies

•  Crowdsourcingoutsidethe„commons“

DataOwnership

DataOwnership

DataOwnership

AnonymityandDataSecurity

•  Noabsoluteanonymityorde-iden6fica6on

•  Integra6onofmul6pledatasourcesincreasecompromisedpersonaliden6ty

•  Datastoresarenot100%secure

PrivacyandDataIden3ty

•  Systemiden6tyvs.Socialiden6ty•  Peopleapproximatedontodatamodelsbyprobability

•  Power:datasubjectshavenosayinthedesignofdatamodel

TransparencyandTrust

•  Assump6on:moretransparency=moretrust•  But:rela6onshipismostlyasymmetrical(individualvs.bigcorpora6on)

•  Transparencyasinstrumentofcontrol

Introducing:DELICATE

•  Isnotreplacingdeepthoughts!

•  Checklistforquickdataconversa6ons

•  TofacilitatetrustedLA

•  Guidefordatascien6sts,decisionmakers

•  Inspiredbymedicalchecklistsforpa6entinforma6on

Introducing:DELICATE

Introducing:DELICATE

Introducing:DELICATE

Puh,heavytobacco!Ques3onsfornow?

LASER - Learning Analytics !for Sustaining Europe’s Resources !Groupawarenessforstudentsincollabora3velearningenvironments

Welten: Hendrik Drachsler, Maren Scheffel, Karel Kreijns, Aad Slootmaker MST: Joop de Kraker

AfirstLearningAnaly3csapplica3onthatfollowedtheDELICATEchecklist.

Context!

Project aims: •  Stimulating awareness and reflection by visualising platform

activities •  Getting insights into effects that visual of learning analytics

feedback may have on individuals and groups

Expected Outcomes: •  Fostering awareness and reflection for students and tutors •  Improving engagement with the platform •  Improving team performance and group atmosphere •  Reducing conflicts in the groups

EVS: Platform!Developed and Open Source Widget that provides:

–  Awareness of and reflection on individual performance –  Awareness of and reflection on group performance

•  Hurdle: pass the ethics board

•  Solution: reciprocal relations

g r o u p p e r f o r m a n c e

The Activity Widget!Cumula3veView PeriodicView

DELICATEfortheLADashboard

DELICATEfortheLADashboard

DELICATEfortheLADashboard

Reciprocal Relationship!

The Widget!

The Widget!

The Widget!

The Widget!

Andnowguess,howmanyofthe45studentswantedtheirdatahidden?

Lessons-Learned!1.  E&Pispartofthegame2.  GeneralDataProtec3onRegula3onatdefinesseriousfees

andrights.Privacy->asservices3.  WefollowE&Pguidelinesfortheonepersonthatneeds

thatprotec6on4.  WidgetneedstobefurtherdevelopedtowardsDELICATE

checklist•  Studentsneedtobeabletogetfullaccesstotheirdata•  PreventrepurposingofwidgetormakeotherpurposestransparentUsingthewidgetforassessment