Report on WP4 Events - LACE Projectlaceproject.eu/wp-content/uploads/2016/06/LACE_D4_2.pdf ·...

25
Learning Analytics Community Exchange www.laceproject.eu Report on WP4 Events Public Deliverable – D4.2 Deliverable Coordinators: Peter Karlberg, Wietse van Bruggen, and Jan Hylén Coordinating Institution: Skolverket Data due: 31 May 2016 Keywords: schools, learning analytics, state of the art Abstract: This deliverable summarises the state of art regarding learning analytics in the school sector in Europe. It also summarises the events delivered and attended by LACE work package 4 (WP4) since 2015.

Transcript of Report on WP4 Events - LACE Projectlaceproject.eu/wp-content/uploads/2016/06/LACE_D4_2.pdf ·...

Page 1: Report on WP4 Events - LACE Projectlaceproject.eu/wp-content/uploads/2016/06/LACE_D4_2.pdf · Learning Analytics Community Exchange Report on WP4 Events Public Deliverable – D4.2

LearningAnalyticsCommunityExchangewww.laceproject.eu

ReportonWP4EventsPublicDeliverable–D4.2

DeliverableCoordinators:PeterKarlberg,WietsevanBruggen,andJanHylén

CoordinatingInstitution:Skolverket

Datadue:31May2016

Keywords:schools,learninganalytics,stateoftheart

Abstract: Thisdeliverablesummarisesthestateofartregarding learninganalytics intheschoolsector inEurope. ItalsosummarisestheeventsdeliveredandattendedbyLACEworkpackage4(WP4)since2015.

Page 2: Report on WP4 Events - LACE Projectlaceproject.eu/wp-content/uploads/2016/06/LACE_D4_2.pdf · Learning Analytics Community Exchange Report on WP4 Events Public Deliverable – D4.2

LACEDeliverable4.2–ReportonEventsv2

Contents

Introduction...........................................................................................................................................1

Successcriteria......................................................................................................................................2

EventsorganisedbyLACEWP4.............................................................................................................3

SeminaratBETT2015........................................................................................................................3

SpringBriefingandPolicyEvent,15April2015,Brussels..................................................................3

SeminaratBETT2016........................................................................................................................4

WP4participationinexternalevents....................................................................................................6

Onderwijsfestival...............................................................................................................................6

SeminarinAlmedalen,Visby.............................................................................................................6

EPALElaunch.....................................................................................................................................7

12thEdReNEseminar,Copenhagen...................................................................................................7

HigherandVocationalEducationResearchDay,Helsinki.................................................................8

Onderwijsdagen.................................................................................................................................8

SwedishParliamenttrainingsession,Stockholm..............................................................................8

PolicyandInnovationcommittee(PIC).............................................................................................8

FrenchMinistryofEducationworkshop,Paris..................................................................................8

LearningAnalyticsExpertWorkshop,Amsterdam............................................................................9

Stateoftheartinlearninganalyticsfortheschoolsector..................................................................10

Generaloverview.............................................................................................................................10

Stateoftheartofimplementationoflearninganalyticsfortheschoolsector...............................12

Conclusion.......................................................................................................................................15

Opportunitiesandissues.....................................................................................................................16

Evidence...........................................................................................................................................16

StrengthsandweaknessesofLAinschools.....................................................................................16

Strategicconsiderationsforschools................................................................................................17

Datasharing.....................................................................................................................................18

Supportingtheworkofteachersandorganisationmodels............................................................19

TheEUGeneralDataProtectionRegulation....................................................................................20

Conclusion...........................................................................................................................................22

About...................................................................................................................................................23

Page 3: Report on WP4 Events - LACE Projectlaceproject.eu/wp-content/uploads/2016/06/LACE_D4_2.pdf · Learning Analytics Community Exchange Report on WP4 Events Public Deliverable – D4.2

LACEDeliverable4.2–ReportonEventsv2

1

IntroductionWP4focusesonlearninganalyticsintheschoolsector.Duringthelatestpartoftheproject-reportingperiod-continuingworkhasbeendoneonraisingawarenessinthesectoronwhatlearninganalyticsisabout,howitcancontributetoimproveteachingandlearningbutalsotheproblemsthatgoesalongwithanincreaseduseofdatamostlyconcerningpersonalintegrityforpupils/students.

ThemembersofWP4havebothbeenorganisingandparticipatinginseveraleventswhichinmostcaseshavebeendocumentedattheLACEwebsite.WehavealsocontributedtotheEvidenceHubandbeenabletoinviteanumberofguestwriterstotheblogaspartofourcommunitybuildingandtoincreaseawarenessofwhatgoesoninanumberofEuropeancountriesconcerninglearninganalytics.

WP4alsoconductedasmallstudyonthestateoftheartthroughaquestionnairedistributedthroughEuropeanSchoolnet(EUN)whichshowsthatitisonlyafewcountriessofarthathaveraisedquestionsonlearninganalyticsatthepolicylevel.

Page 4: Report on WP4 Events - LACE Projectlaceproject.eu/wp-content/uploads/2016/06/LACE_D4_2.pdf · Learning Analytics Community Exchange Report on WP4 Events Public Deliverable – D4.2

LACEDeliverable4.2–ReportonEventsv2

2

SuccesscriteriaTheLACEdescriptionofwork(DOW)identifieseightstakeholdergroupstargetedbyLACE:

1. Policymakers2. Headsandmanagersofinformationsystems3. HeadsofeLearningandTELdevelopmentteams4. Suppliersoftechnology-enhancedlearning(TEL)software5. Softwaredevelopers6. Earlyadopterpractitioners7. Learninganalytics(LA)andeducationaldatamining(EDM)researchers8. Standardsandinteroperabilityexpertsandbodies

Acrossalltheworkpackages,andacrossthelifeoftheproject,successisdefinedas

• 600directcontactsinvolvingmoststakeholdergroups.AdirectcontactisdefinedasattendanceatoneofoureventsoratasessionswhereaLACEprojectmemberpresents.

• 50%ofeventsinvolveatleastthreestakeholdergroupsoratleasttwosectors• Attendeesblogortweetabouttheevent

ThisdocumentestimatesdirectcontactsforalleventsLACEWP6hasrun.Insomecasesthesearenecessarilyvague–thenumberofeventattendees.Inothercases,morespecificnumbersofregistrationsandengagedparticipantsarerecorded.StakeholderengagementisnotedforeventsrunbyWP6andengagementwithsocialmediaisalsonotedforeventsorganisedortargetedbytheworkpackage.

Page 5: Report on WP4 Events - LACE Projectlaceproject.eu/wp-content/uploads/2016/06/LACE_D4_2.pdf · Learning Analytics Community Exchange Report on WP4 Events Public Deliverable – D4.2

LACEDeliverable4.2–ReportonEventsv2

3

EventsorganisedbyLACEWP4InthissectioneventsrelatedtolearninganalyticsintheschoolsectorwhichWP4membershaveattendedwiththepurposetoshareknowledgeaboutlearninganalytics,shareLACEprojectactivitiesandresultsandcapturetrendsinthefield.Duringthereportingperiodweplanned,organisedanddeliveredthreeeventsonLAintheschoolsector.

SeminaratBETT2015

StartinginJanuary2015inLondon,aseminarwasarrangedasapartoftheinternationalBETTshow.MembersoftheLACEteamgaveanintroductiontolearninganalyticsinschoolsandgavesomepracticalexamplesofhowanalyticsisimplementedinlearningresourcesandusedbyteachersonlocallevel.Some125peopleattendedtheseminar.

ProgresstowardsLACEobjectives:

Directcontacts:125peopleattendedtheevent.

Stakeholderengagement:Headsandmanagersofinformationsystems,Suppliersoftechnology-enhancedlearning(TEL)software,Softwaredevelopers,Earlyadopterpractitioners

LACEblogposthttp://www.laceproject.eu/blog/learning-analytics-making-learning-better-dutch-perspective/

SpringBriefingandPolicyEvent,15April2015,Brussels

Figure2:RobertMadelin,Director-GeneralofDGConnect,speakingtoapackedaudienceattheLACESpringBriefing

ThisbriefingwasorganisedbytheLACEprojectconsortiumincollaborationwiththePELARS,Lea’sBoxandWatchMeprojectconsortiaandwiththesupportofEuropeanSchoolnet.Ittookplaceon

Figure1:MichaelvanWeteringfromKennisnetrepresentingLACEsharesinsightsfromtheNetherlands.

Page 6: Report on WP4 Events - LACE Projectlaceproject.eu/wp-content/uploads/2016/06/LACE_D4_2.pdf · Learning Analytics Community Exchange Report on WP4 Events Public Deliverable – D4.2

LACEDeliverable4.2–ReportonEventsv2

4

Wednesday,15April2015from09.30until16.30intheThonHotelEU,RuedelaLoi/Wetstraat75inBrussels.

Thisone-daybriefingeventwasaimedateducationalpolicy-makers,influencersandstakeholdersaswellaspoliticalrepresentativesinterestedingettingtogripswiththecurrentstate-of-theartinlearninganalyticsandeducationaldatamining.Thosetakingpartwereintroducedtothelatestdevelopmentsinthisfieldandtheexplosionofinterestintoolsthatcanbeusedtomeasurelearningimpact.Theywerealsoinvitedtotakepartindiscussionsonhowbesttodeveloppoliciesrelatedtothefairandethicaluseofsuchdatainschools,universitiesandtheworkplace.

TheeventresultedinthepublicationofaLACEReview:‘Policyrecommendationsforlearninganalyticsfromthreestakeholderworkshops’.ThispublicationreviewedtheissuesthatwereconsideredtobeprioritiesbyEuropeaneducationaladministrators,professionalsandacademicsinconsideringanalyticsanditsrelationshiptopolicyandpractice.TheReviewincludesaseriesofinterviewswithSpringBriefingparticipants.

ProgresstowardsLACEobjectives:

Directcontacts:67peopleattendedtheevent.Stakeholderengagement:MEPsandrepresentativesfromtheEuropeanParliament,EuropeanCommissionprojectofficersandadvisors(DGCONNECTandDGEAC),representativesfromkeylobbyingandstakeholderorganisationsincludingEuropeanSchoolnet,theEuropeanTradeUnionCommitteeforEducation,DIGITALEUROPE,EuropeanPublishersAssociationandorganisationswithamoregeneralinterestindatamanagementinEuropeincludingEuropeanDataProtectionsupervisorsandtheBigValueDataAssociation.

LACEReview:Policyrecommendationsfromtheworkshop:http://www.laceproject.eu/learning-analytics-review/policy-recommendations-lace-workshops/Eventwebsitehttp://www.laceproject.eu/spring-briefing/

LACEblogposthttp://www.laceproject.eu/blog/springtime-is-learning-analytics-time-in-brussels/

SeminaratBETT2016InJanuary2016weorganisedanddeliveredanotherseminarattheBETTshowwithmembersoftheworkpackagepresentingandsharingsomeofourinsightswithimplementingLAinaschools,onlocallevelandnationallevel:Whathavewelearnedthatisimportantwhendoingimplementations?Wetackledissuesliketoolselection,privacyandprivacyagreements,andamodel/proceduretosupporttheusageofdatafordecisionmakinginaschool.

Page 7: Report on WP4 Events - LACE Projectlaceproject.eu/wp-content/uploads/2016/06/LACE_D4_2.pdf · Learning Analytics Community Exchange Report on WP4 Events Public Deliverable – D4.2

LACEDeliverable4.2–ReportonEventsv2

5

Figure3:StartingpageforthepresentationgivenattheseminarattheBETTshow2016

AllmembersofWP4participatedinthenetworkingeventthattookplaceduringtheLACEAnnualmeeting,whichattractedavarietyofpeoplefromschools,researchersandvendorsandrepresentativesfromothersectors.

Figure4:LACEAnnualMeetingatBETT2016

ProgresstowardsLACEobjectives:

Directcontacts:250peopleattendedLACEsessionsandnetworkingeventintotalStakeholderengagement:Headsandmanagersofinformationsystems,Suppliersoftechnology-enhancedlearning(TEL)software,Softwaredevelopers,Earlyadopterpractitioners LACEblogposthttp://www.laceproject.eu/blog/sharing-insights-on-implementing-la-in-schools-at-bett-2016/

Slideshttp://www.slideshare.net/wietsevanbruggen/bett-2016-implementing-learning-analytics-in-your-school

Page 8: Report on WP4 Events - LACE Projectlaceproject.eu/wp-content/uploads/2016/06/LACE_D4_2.pdf · Learning Analytics Community Exchange Report on WP4 Events Public Deliverable – D4.2

LACEDeliverable4.2–ReportonEventsv2

6

WP4participationinexternaleventsWorkshopatOECDGoverningComplexEducationSystemsConference,Tallinn

InFebruary2015LACEparticipatedinaneventinTallinn,EstoniaarrangedbytheOECDandtheEstonianMinistryofEducationontheissueofgoverningcomplexeducationalsystems.TheworkshopsessionsthatfocusedonlearninganalyticswasledbyLACEandtherewasabout40attendingintotal.

Eventdocumentationhttp://www.oecd.org/edu/ceri/Summary%20of%20GCES%20Tallinn%20Conference.pdf

SXSWeduconference

InMarch2015membersofLACEpresentedattheSXSWeduconferenceinAustin,USAonprivacyissuesconcerninglearninganalytics,andpossiblefuturesolutionstothisproblem.Some100educators,policymakers,technologistsfromEurope,theAmerica’sandOceaniaattendedthissession.

Figure5:ErwinBomasrepresentingLACEatSXSWedu2015

Eventdocumentationhttp://www.laceproject.eu/blog/international-interest-for-privacy-solution-in-education/

OnderwijsfestivalInMay2015theLACEteamdidapresentationonscientificevidenceconcerninglearninganalyticsattheOnderwijsfestivaleventintheNetherlands.Usingtheknowledgethathasbeengatheredintheproject’sEvidenceHubLACEpresentedanoverviewofwhatweknowsofar,highlightingafewexamples.Teachers,schoolmanagersandproductdevelopersattendedthissession.

Eventwebsitehttp://www.liketoshare.education/onderwijsfestival/

Eventdocumentation:http://www.slideshare.net/wietsevanbruggen/presentatie-learning-analytics-wat-weten-we-dat-werkt

SeminarinAlmedalen,VisbyInJuly2015membersoftheLACEteamparticipatedinaseminarinVisby,Swedenonthe“hiddendataofschools”.Thetitlewasatwistofthemorewell-knowndiscussiononopendata.Butthistime

Page 9: Report on WP4 Events - LACE Projectlaceproject.eu/wp-content/uploads/2016/06/LACE_D4_2.pdf · Learning Analytics Community Exchange Report on WP4 Events Public Deliverable – D4.2

LACEDeliverable4.2–ReportonEventsv2

7

thepaneldiscussedallthedatathatschoolsalreadyhave,butseldomuseorthedatatheycouldgatherandanalyseinordertoimprovethelearningoftheirstudents.

Figure6:JanHylenrepresentingLACEtheseminarinAlmedalen

LACEblogpost:http://www.laceproject.eu/blog/the-hidden-data-of-schools-discussed-in-almedalen-sweden/

EPALElaunchInSeptember2015theEuropeanplatformforAdultLearning,EPALE,waslaunchedinGermanybytheGermanNationalCoordinationPointEuropeanAgendaforAdultLearning.LACEwasaskedtogiveapresentationatthelaunchingconferenceinBerlin.Some100schoolmanagersanddecisionmakersonlocalandregionallevelattendedtheconference.

Eventdocumentation:https://ec.europa.eu/epale/en/blog/learning-analytics-can-shape-future-adult-learning

12thEdReNEseminar,CopenhagenInOctober2015LACEwasaskedtogiveapresentationonLearningAnalyticsandLearningResourcesatthe12thseminarwiththeEducationRepositoriesNetwork,EdReNe,hostedbytheDanishMinistryofEducationinCopenhagen.Some50peoplefromapproximately15differentEuropeancountriesparticipatedintheseminar.

Eventdocumentation:https://files.itslearning.com/data/826/open/co6/1354.pdf

Figure7:JanHylénpresentingattheEdReNeseminarinCopenhagen

Page 10: Report on WP4 Events - LACE Projectlaceproject.eu/wp-content/uploads/2016/06/LACE_D4_2.pdf · Learning Analytics Community Exchange Report on WP4 Events Public Deliverable – D4.2

LACEDeliverable4.2–ReportonEventsv2

8

HigherandVocationalEducationResearchDay,HelsinkiInNovember2015theFinnishEducationEvaluationCentre(FINEEC)organisedtheHigherandVocationalEducationResearchDaysinHelsinki,Finland,attendedbysome150teachers,schoolmanagers,researchersanddecisionmakers.LACEwasinvitedtogiveapresentationandalsotoparticipateinanewsprogrammeproducedbyaSwedishspeakingTVchannel.

OnderwijsdagenAlsoinNovemberLACEpartnersco-organised,attendedandpresentedattheOnderwijsdagen(educationdays)intheNetherlands,athreedayconferenceorganisedbyKennisnetincollaborationwithSurfnet.Thepre-conferencedaywascompletelydevotedtothetopicoflearninganalytics.AschoolsspecificpresentationwaspresentedbyKennisnettoanaudienceofabout40people,givingtheminsightsintotoolsavailableandwhattospecificallylookoutforwhenselectingtools.Duringtheconference’sdayspecificallyaimedattheschoolssectorLACEdidworkshopsanddeliveredtheclosingkeynoteoftheconferencetoanaudienceofabout300people.

Figure8:LACErepresentativespresentingattheOnderwijsdagen

Eventdocumentation:http://www.laceproject.eu/blog/lace-keynote-at-onderwijsdagen-2015/

http://www.laceproject.eu/blog/keynote-on-introduction-to-learning-analytics-still-highly-needed/

SwedishParliamenttrainingsession,StockholmOnDecember8,2015LACEparticipatedinatrainingsession,calledCyberAcademy,onissuesregardingdigitisationofdifferentsectorsofsociety,fornewmembersofparliamentintheSwedishParliament.8-10MPsparticipatedinthetrainingsession.

PolicyandInnovationcommittee(PIC)LACEwasrepresentedatthePolicyandInnovationcommittee(withintheEUN)meetingsinMayandNovemberreportingontheprojectandleadingtheon-goingdiscussionwithinthecommitteeonlearninganalytics.

FrenchMinistryofEducationworkshop,ParisOnFebruary11,2016WP4participatedinaworkshoparrangedbytheFrenchMinistryofEducationtogetherwithMicrosoft.ThescopeoftheworkshopwastoinitiateacooperationbetweenFranceandMicrosoftintheareaoflearninganalyticsandtodiscussthefeasibilityofanumberofpilot

Page 11: Report on WP4 Events - LACE Projectlaceproject.eu/wp-content/uploads/2016/06/LACE_D4_2.pdf · Learning Analytics Community Exchange Report on WP4 Events Public Deliverable – D4.2

LACEDeliverable4.2–ReportonEventsv2

9

projectswithintheschoolsector.LACEgaveanoverviewofthestateofartoflearninganalyticsinEuropeanschoolsandLAissuesdiscussedinotherEuropeancountries.

Figure9:DiscussionattheworkshopintheFrenchMinistryofEducation

LearningAnalyticsExpertWorkshop,AmsterdamOnMarch15–16,2016WP4participatedinaworkshoporganisedbytheprojectLAEPtogetherwithLACE.TheworkshopfocusedonthecurrentstateoftheartoflearninganalyticsinEuropeandonprospectsfordevelopmentoverthenext10-15years.Itwaspartofastudythatisconsideringtheimpact,potentialandlimitsoflearninganalyticsinordertoproviderecommendationsforEuropeaneducationpolicythatwillguideandsupportthetake-upandadaptationofthistechnologytoenhanceeducationinEurope.

Eventreport:https://dougclow.org/2016/03/16/laep2016-weds-pm/

Page 12: Report on WP4 Events - LACE Projectlaceproject.eu/wp-content/uploads/2016/06/LACE_D4_2.pdf · Learning Analytics Community Exchange Report on WP4 Events Public Deliverable – D4.2

LACEDeliverable4.2–ReportonEventsv2

10

Stateoftheartinlearninganalyticsfortheschoolsector

GeneraloverviewIntheschoolsectortherequirements,whichareexpressedforlearninganalyticsarestronglylinkedtodemandsfromregulatorybodiesforgreateraccountabilityfromschools,and,sometimes,fromparentswantingtofollowtheprogressofthechild,sothattheycancommunicatemoreefficientlywiththeschools.SchoolsinEuropedogenerallynothavethecapacitytodeveloptheirownecosystemofdatacollectionandanalysesandmuchofthisagendaisdrivenfromthecentrebyministriesofeducation,whichdealswithmuchofthedecision-makingonprogramsandoninfrastructure(especiallyinfrastructurewhichisbeyondtheconfinesofanindividualschool).Schoolsdonothavethecapacitytodeveloptheirownecosystemofapplicationstomeettheseneeds,ortheinteroperabilitystrategythatwouldneedtoaccompanythis,andsotheyeithermakeuseofstate-provisionedsoftware,ortheyturntovendors.

DuringthetimeoftheLACEprojectwehavefoundverylittlepublishedevidenceofthecollectionorcollationofstakeholderneedsintheschoolssector.InordertoconfirmifthiswasanaccuratepictureoftheEuropeanschoolsectorweconsultedwithEuropeanministriesofeducation.Ourquestionsrelatedtoinitiativesdrivenbyministriesofeducation.Thesurveywasdeliveredduringautumn2015incollaborationwithEuropeanSchoolnet,anetworkof31ministriesofeducation.Thepeopletargetedbythequestionnaireweretypicallydecision-shapersorseniorcivilservantsworkingwithissuesrelatedtoICTinschools.25nationalrepresentativeswerecontacted,butonlyfiveresponseswerereceived,oneofwhichcontainednoinformation.InformationwasobtainedfromSwitzerland,Denmark,NorwayandTurkey,andthiswassupplementedbyinformationfromLACEparticipantsfortheNetherlandsandSweden.

TheresultsshowthatlittleishappeningyetregardinglearninganalyticsintheEuropeanschoolsector,directlyorindirectlyinvolvingtheformulationofneedsorrequirements,andthatthereislittlereadinessatnationalleveltoengageasstakeholdersintheLAinteroperabilityprocess.

Insomecountrieslearninganalyticsisjustbecominganissue.Forexample,inSwitzerlandtheEDK(representingthecantons)iscarryingouttheassessmentonthebasicskillsofSwisspupilswithweb-basedtests,andthey(includingeduca.ch)noticenowthatSwitzerlandwillgetdatathattheycouldusefurtherinthehorizonoflearninganalytics.TheteamatEduca.chrepliesinthesurveythatthey“donotknowaboutanyconcretelearninganalyticsprojectinSwitzerland”.

Thisapproachseemstobetypicalofmanycountries.Nevertheless,someanswersrevealthatcountriesarestartingtodiscussLA,inparticularDenmark,NorwayandtheNetherlands.

IntheirresponsetothesurveyDenmarkdescribesanumberofinitiativesrelatedtolearninganalytics.Denmarkisinaninitialclarificationphasewheresuppliersoflearningplatformsandproducersoflearningresourcesaremakingsystemsthatcancreatedataandhandledata-supportededucation.4-5platformvendorsareprovidingprogressiondataagainstlearningobjectives.Atthesametimemoreandmoredigitallearningresourcesfromproprietaryvendorsincludesystemsfordatacollectionthatcanbeusedforlearninganalytics.AccordingtotheDanishanswer,DenmarkhasinitiatedaroundtendifferentprojectsintheirnationalITservicesinorderto

Page 13: Report on WP4 Events - LACE Projectlaceproject.eu/wp-content/uploads/2016/06/LACE_D4_2.pdf · Learning Analytics Community Exchange Report on WP4 Events Public Deliverable – D4.2

LACEDeliverable4.2–ReportonEventsv2

11

createanintegrationplatformaspartoftheUserPortalinitiative.1Theseincludeanationalrepositoryoflearningresourcesandaccesstoalargevirtuallibrary,nationalonlinetestsandnationalmeasurementsofwell-beinginprimaryandlowersecondaryschools,adigitalapplicationprocessforenrolmenttosecondaryandhighereducationandadatawarehouseandbusinessintelligenceenvironmentthatgathersdataontheentireeducationsector.TheDanishrepresentativesinoursurveysaidthatDenmarkwasworkingtomovefrommanagementinformationtodataforteachingandlearning.Forexample,thenationalonlinetestsarealsoforusebyteachersintheirdailyteaching.Thedataaretobeusedformorethansummativemanagementinformation.ThusitappearsthatDenmarkisbuildingthefoundationforlearninganalyticsandimprovedinteroperabilityofdata,onthebasisthatthiswillprovideopportunitiesforvaluableservicestobeprovided.

ThesituationintheNetherlandsseemstobesimilartoDenmark,withaparticularfocusonprivacy.Kennisnetiscarryingoutworktosafeguardtheprivacyofstudentsatthesametimeasmakingsurethatpartiesintheeducationsupplychainreceiveallthedatatheyneed.Thisinvolvesthecreationofanumericalidentificationsystem2thathelpsprotectpersonaldataandagreementbetweenschoolsandvendorsonhowtheyhandlepersonaldata.Thisaddressestheinteroperabilityneedofmakingdatatransfercompatiblewiththelegalframeworkandwitheducationalpolicy,achallengewhichisalsofeltinothercountries.

Norwayisworkingonaninfrastructureforidentitymanagement(incl.SSO),andwearenowextendingthisinfrastructuretoincludeaservicethatletstheeducationsectorconnectdatasourcesandend-userapplications.3Sweden,ontheotherhand,isworkingonasolutionforsinglesignon.4AnotherareawheretheNordiccountriesareestablishingaverybasicinfrastructureforcominglearninganalyticapplicationsismakingcurriculumdocumentsdigitallyavailableformachinereading

1NationalITservicesintheintegrationplatform:‒KnowledgePortal(e.g.EMU,Materialeplatformen,SkoDa-Portalswhereyoufindinspirationforlearning)‒EMUportal-Overviewoftheknowledge,methodsandtoolswithdocumentedevidenceofeffect‒Materialeplatformen-nationalrepositoryoflearningresources‒SkoDa-accesstoagiantvirtuallibrary‒CommonObjectives(CommonObjectivesdescribesnationalattainmenttargetsatdifferentstepsineachsubject)‒Well-beingobjectives(Nationalmeasurementsofwell-beinginprimaryandlowersecondaryschools(indicatorsofpupils’learningenvironment,well-being,peaceandorder))‒Nationalonlinetests(Toolsforcontinuousmonitoringinprimaryandlowersecondaryschool,whichcancontributetofutureorganisationoflearning)‒Thefinalexams‒Accession(Digitisingtheapplicationprocessforenrollmenttosecondaryandhighereducation)‒GuidetoEducationandTraining/e-Guide(Digitalguideprovidinginformationabouteducation,jobs,businessandlabor,aswellasofferingguidanceontrainingandjobviaemail,chat,SMSorphone)‒Datawarehouse(Acentraldatawarehouseandbusinessintelligenceenvironmentthatgathersdataontheentireeducationsector,e.g.analyticalresultsfromtheMoE’sanalysesofnationaltestsandexaminations)2Inthestateoftheartofimplementationsectionofthisreportamoredetaileddescriptionofthissystemcanbefound.

3www.dataporten.no4https://www.skolfederation.se/

Page 14: Report on WP4 Events - LACE Projectlaceproject.eu/wp-content/uploads/2016/06/LACE_D4_2.pdf · Learning Analytics Community Exchange Report on WP4 Events Public Deliverable – D4.2

LACEDeliverable4.2–ReportonEventsv2

12

orasinNorwayhavingaservicethatallowsuserstoconnectdigitalobjectstolearningobjectivesdefinedinthenationalcurricula.

Somecountrieshavereportedoccasionalexamplesofprojectsthathavesomerelationtointeroperabilityandlearninganalytics.TheseincludeTurkeywhoiscreatingtheconditionsforrelatingstudentresultstodifferenttargetsinthecurriculum.Teacherswillsoonhavethepossibilitytodigitallyrelatetheirownplanningoftheirteachingtothecurriculumtargets.

StateoftheartofimplementationoflearninganalyticsfortheschoolsectorLearninganalyticsisseenasatechnologyofinteresttosupportwaysofimprovingthecontextsinwhichlearningoccursinalotofcountries.Anincreasingamountoftoolsareavailableandschoolsareincreasinglylookingathowitcansupporttheirvisiononpersonalisedlearning.TheNMCHorizonStrategicBriefonpersonalisedlearningfrom2015statesthatthoughthereisanincreasingnumberofexperimentalanddemonstrationseffortsitcannotbesaidthatlearninganalyticsisatapointofmainstreamadoption.Thereare,however,forerunnerinitiativeswhichcanbeseenasprovidinginsightintowhatisneededforwideradoption.Therearealsointerestingcasesinwhichweseethatschoolsanddevelopersareundertakingstepstoimplementorsupporttheimplementationlearninganalyticsininterestingways.

AsalreadyreportedDenmarkhasinitiatedaroundtendifferentprojectsintheirnationalITservicesinordertocreateanintegrationplatformaspartoftheUserPortalinitiative.5

AveryinterestingexampleoflearninganalyticsinschoolswasfoundinEngland.IanDewes,whoisheadteacheratDunchurchInfantSchoolandNursery,isusinglearninganalyticsinearlyyearseducation.Theyuseddigitalmeanstorecordobservationsandvisualizethem.Thishelpedmakingtheprocessofrecordingobservationsmoreefficientandthevisualizationsgavethemquickandeffectivewayofmonitoringprogress,seeingwhichpartsofthecurriculumwerecovered,whichchildrenshowednewlearningandwhichwereatrisk.Thisexampleshowsthatlearninganalyticscanhaveanimpactevenwithlearnersataveryearlystage.6

AnotherexampleofaschoolusinglearninganalyticstohelppersonalizelearningistheColegioMontserratinBarcelona7.Everylearnerinthefourthyearofschoolhastheirowndevicetoworkon.TheyuseanLMSsystembuiltonthebaseofMoodletohelpprovideguidancetolearnersonchoosingtheirlearningpathandprovidesteacherswithinformationtohelpguidethemthroughthisprocess.Italsohelpsprovideparentswithinformationonhowtheyaredoingatschool.

InFrancetheFrenchMinistryofEducationisplanningtostartanuberofpilotprojectsregardinglearninganalytics.Thescopeandset-upofthesepilotprojectswerediscussedataworkshopinParisinFebruary.8

OutsideofEuropeinAustraliaweseeaninterestingcasewhereadeveloperhasalignedtheiranalyticssolutionwiththeAustralianCurriculumandtheNSW(NewSouthWales)syllabus9.It

5Comparefootnote16http://www.laceproject.eu/blog/using-learning-analytics-in-an-english-school-setting/7http://openeducationeuropa.eu/en/news/colegio-montserrat-pedagogical-innovation-never-ending-process8Seeeventreportaboutthemeetingonpage10

Page 15: Report on WP4 Events - LACE Projectlaceproject.eu/wp-content/uploads/2016/06/LACE_D4_2.pdf · Learning Analytics Community Exchange Report on WP4 Events Public Deliverable – D4.2

LACEDeliverable4.2–ReportonEventsv2

13

providespersonalizedfeedbacktothelearnersandinsightintotheresultsanddevelopmenttotheteachers.Developersthataligntheirtoolswithacurriculumwillmakeiteasierforteacherstoworkwiththemandintegrateitintotheirteachingpractice.Ifaschoolusesseveraltoolsthecurriculumcanserveasabasetoworkwithandthealignmentoftoolstothemcanhelpschoolsuseseveraltoolsatonceandkeeptrackonwheretheyare.

AsdescribedbyvanBruggenontheLACEEvidenceHub10,KennisnetisbeginningtosetupanumericalidentificationsystemthatgeneratesauniqueidentifierfromthenationalidentificationnumberusedintheNetherlands(BSN).Thesystemensuresthatidentificationnumbersofnofurtherpersonalsignificancecanbeexchangedwithintheeducationsupplychainwithoutpupils’personaldetailsbeingsharedwithandbetweenprovidersofeducationalresources.Thenumberisapseudonym;inotherwords,institutionsandcommercialsupplierscannottracethenumberbacktoanypersonalinformation.Amongotherthings,thissystemmakesitpossibletorestrictthepartiesthattrackpupilprogresstothoseauthorisedtodoso(usuallytheschool),withthepupils’privacybeingwellprotected(vanBruggen2015).Designandcreationofthesystemhasalreadybeencompletedin2016,butevenwiththepseudonymisationofdata,theMinistryofEducationwillneedsometimein2016andpossibly2017toadoptthelegalexemptionthatisneededforthesystemtobeimplemented.

Theneedfromalegalexemptioncomesfromusingthenationalidentificationnumberasabasistogenerateapseudonymandtheneedtoexchangethispseudonym.Thisrequiresanexemptionincurrentlaws.IncurrentpracticethenationalidentificationnumberisconvertedintoasocalledPSGwhichstandsfor“PersoonsgebondenNummer”(personalnumber).Everystudentenrolledinschoolhasthisnumber.ThisPGNisthenstoredintotheadministrativeinformationsystemusedbyaschool.Schoolsarethenpermittedtousethisnumberwhenexchanginginformationwiththegovernment,butnotwithprivatepartieslikepublishersandotherdigitallearningtoolscreatorsbecausetherewasnolegalbasisforthis.Thealternativetothiswastochangealotofpersonalinformationwithforexamplepublishersandotherschoolstobeabletoidentifystudents.Thiswasdeemedundesirableinlightofprivacyandpronetoproduceerrors.

ThesolutiontheserviceprovidesisthattheadministrativeinformationsystemnowsendsamessagetothenumericalidentificationservicewhichthenencryptsthePGN.Theservicethenencryptsthatencryptednumberanextratimeandcreatesapseudonyminthatway.Thispseudonymisthensentbacktotheadministrativeinformationsystem.Followingasetofagreementsthenumbercanthenbeusedtocommunicateaboutastudent.Itcanbeusedforthingslikepassingonlicensesandexchanginglearningandtestingdata.Otherpersonaldatawillonlybeexchangedifitstrictlynecessary.Whilethelegalframeworkisbeingputinplace,Kennisnetwillbetestingthesystemincooperationwithpractitionersandsuppliers.

WorkisbeingundertakenintheNetherlandstofacilitatetheexchangeoflearninginformationthroughthedevelopmentoftheUWLRstandard11,whichtranslatedtoexchangeoflearning9https://www.kennisnet.nl/fileadmin/kennisnet/publicatie/Personaliseren_in_het_Leren_een_Internationale_Schets.pdf,page21.10http://evidence.laceproject.eu/project/numerical-identification-system-pseudonymise-pupil-data/11https://www.edustandaard.nl/standaarden/afspraken/afspraak/uwlr/2.1/

Page 16: Report on WP4 Events - LACE Projectlaceproject.eu/wp-content/uploads/2016/06/LACE_D4_2.pdf · Learning Analytics Community Exchange Report on WP4 Events Public Deliverable – D4.2

LACEDeliverable4.2–ReportonEventsv2

14

information.Thisstandardaimstoprovideastandardfortheexchangeoflearningresultsbetweeneducationalapplicationsandlearninginformationsystems.ThestandardisdevelopedincollaborationwithsuppliersofsystemsactiveintheDutcheducationmarket.

Adecisionwasmadetobasethestandardondevelopmentalreadyundertakenbythemarketitselfandtobuilduponthat.AstandardlikeIMSLISiscomplexandcomprehensive12.Largeportionsofthestandardsarenotofinterestfortheschoolssector.Thedevelopmentgroupfeltthattherewasnointerestfromtheschoolsandvocationaleducationsectorstodevelopacomplexandcomprehensivestandard.Theworkalreadysetinmotionseemedsufficientforboththeneedsofdevelopersandlearninginstitutions.ThereisanagreementtoresearchwhetherandifyeshowthisbasestandardwhileberelatedtoaninternationalstandardlikeIMSLISorotherstandardsdevelopinginthefield.

Atthemomentofwritingofthisdocumentthisexchangeoflearningresultsfocusesonsummativeassessmentsbetweenthesesystemsandimplementationiswellunderwayintheprimaryeducationsector.Implementationinthesecondaryeducationsectorisinanearlierphase,focusedondoingexperimentalimplementationstoworkoutanytechnical,interoperabilityandpracticalusabilityissuesforschoolsandstaff.

DevelopmentoffurtherstandardsfortheexchangeoflearningresultswillbefedbytheneedsofinnovativeschoolsintheNetherlands.Someofthisdevelopmentwillbefedbytheso-called“DoorbraakpjectOnderwijsenICT”.The“DoorbraakprojectOnderwijsenICT”(breakthroughprojecteducationandICT)supportsschools,schoolboards,schoolleadersandteachersintheirstepstowardspersonalisededucationsupportedbyICT.TheDoorbraakprojectworksontakingawaybarriers,andoncreatingatransferrable,integralandaffordableapproachforschoolsinprimaryandsecondaryeducation.Itisaninitiativeofthenationalcouncilsforprimaryandsecondaryeducation,theMinistryofEducationandtheMinistryofEconomicAffairs.

Schoolandschoolboardscansubmitsocalled“versnellingsvragen”(accelerationquestions)tothisprojectinwhichtheystateachallengetheyhavewithimplementingandusingtechnologyineducation.Ifthequestionisdeemedtoberelevantforthesectorasawhole,theprojectwillworktoprovideasolutionforthis.Oneoftheneedsstatedbyseveralforerunningschoolsacrosssectorsactiveinthisprojectistheneedforadashboardthatprovidesanoverviewofstudentresultsandlearning,coveringalloftheirsubjectsandskills.Itisseenasavitalinstrumenttosupporttheirvisionandimplementationofpersonalisedlearning,andtheyseelearninganalyticsasanimportantdevelopmenttosupportdecision-makingprocesses.13

Bygatheringandcomparingthefunctionalrequirementsschoolsattributetothisdashboard,anoverarchingpicturecouldbemadethatillustratestheirneeds.Itwasvisualisedinaninfographicthatcanbeusedforschoolswhentheydiscusstheirneedswiththemarket.14Thiscomparisonalso

12https://www.imsglobal.org/activity/onerosterlis13https://www.poraad.nl/themas/ict-in-het-onderwijs/ondersteuning-bij-ict/versnellingsvragen/intervenieren-op-basis-vanhttps://www.poraad.nl/nieuws-en-achtergronden/nieuwe-film-help-7-systemen-om-mijn-leerlingen-te-monitoren-kan-dat14http://doorbraakonderwijsenict.nl/images/uploads/Infographic_Voortgangsinformatie_en_Dashboards.pdf

Page 17: Report on WP4 Events - LACE Projectlaceproject.eu/wp-content/uploads/2016/06/LACE_D4_2.pdf · Learning Analytics Community Exchange Report on WP4 Events Public Deliverable – D4.2

LACEDeliverable4.2–ReportonEventsv2

15

showedthatthereisbothaneedforacentraldashboardgatheringinsightsandresultsfromseveralsources,andmoredetailedandspecialiseddashboardsthatfocusonforexamplejustonesubject.Acentraliseddashboardhelpsinprovidinginsightintostudentprogressoverall,andaspecialiseddashboardhelpsinprovidingdeepinsightintotheprogressonaparticularsubjectorskill.Someoftheseschoolsuseseveralsystemswithlearninganalyticscomponents,butfacepracticalproblemsofbringingallofthisinformationtogethertostreamlinedecision-makingprocesses.

Bydoingexperimentswithschools,educationaldatasuppliersanddashboardmakersonexchanginginformation,analysinginformationandvisualisinginformationabetterunderstandingwillbedevelopedoftherequirementsforsupportinginfrastructure.Forexample,questionsregardingthelevelofgranularityoftheinformationrequiredtosupportteachersandtheinterpretationandvisualisationofdatafromdifferenteducationalapplicationswillinformfurtherdevelopment.

ConclusionThereareforerunnerexamplesliketheNetherlands,DenmarkandtosomeextentNorwaythatareworkingtowardsprovidingsystems,standardsandotherresourcesinorderforschoolstomakemoreeffectiveuseoflearninganalytics.ButlearninganalyticsseemsstillnottobeanissueontheagendainmostEuropeanMinistriesofEducation.Theforerunnerexamplescouldserveasaninspirationtothoseothercountries.BytellingandspreadingtheirstorythroughnetworkslikeLACEandthroughworkshopsandpresentationsateventslikeBETTinLondon,decisionmakersinanumberofcountrieshavebeenmadeawareofthepotentialofandtheissuestobetakenintoconsiderationregardinglearninganalytics.

Page 18: Report on WP4 Events - LACE Projectlaceproject.eu/wp-content/uploads/2016/06/LACE_D4_2.pdf · Learning Analytics Community Exchange Report on WP4 Events Public Deliverable – D4.2

LACEDeliverable4.2–ReportonEventsv2

16

Opportunitiesandissues

EvidenceTheLACEevidencehubshowsagrowingamountofresearchonlearninganalyticsinschools.Schoolshaveahighinterestinlearninganalyticssolutionsthathaveproventhemselvesinpractice,anditwillhelpguidetheminmakinginformeddecisionsonhowtoimplementlearninganalytics.Convertingevidenceintopracticalrecommendationswillhelpguidethemevenmore.

StrengthsandweaknessesofLAinschoolsLearninganalyticsprovidesbigopportunitiesforschools,butalsohasitsweaknessesandchallengestoovercome.BasedonexperienceintheNetherlandsaSWOTanalysishasbeencreatedtoinformschoolsintheirdecision-making,aspartofthebi-yearlytrendreportKennisnetmakes.Thetrendreportdescribestechnologicalinnovationsworldwideandconsiderstheirusefulnessinaddressingchallengesinthefieldofeducation.AlthoughformulatedbasedontheDutchcontext,wefeelthatthisanalysisappliestotheschoolsectorasawholeconsideringlearninganalytics:

StrengthsAsschoolsincreasinglyusemoredigitallearningtools,learninganalyticscanfacilitatedetailedandhighfrequencyregistrationoflearningactivitydata.Ifthisdataiscollectedautomaticallyandpresentedtoteachersinmeaningfulwaysitcanlightentheadministrativeburdenplacedonthem.

Whenvisualisedandanalysedinmeaningfulways,theamountofdatathatcanbegatheredinlargequantitiesandtheanalysisofthisdatacanprovidearichsourceofinformationforthemtoworkwith.Thiscanhelptoinformdecision-making.

Learninganalyticscansupporteducationprofessionalsinprovidingpersonalisedinterventionstoindividualandgroupsofpupils.Thetechnologycanhelpmakethecomplexlearningprocessmorecomprehensible.

WeaknessesNoteveryaspectoflearningisaseasilyquantifiable.Learninganalyticscanprovideaninsightintoapartofthelearningprocess,buttherewillalwaysbeaneedtoputtheoutputintocontext.Teachersandtutorsplayapivotalroleinprovidingthiscontext.

Datacanalsobespreadoutoverdifferentlocationsandisdisparateinnatureinmanytimes.Bringingtogetherinformationfromdifferentsourcestoprovideinsightintothelearningprocessesisthereforenotaneasyprocess.Itisbothatechnologicalandsemanticchallengetobringinsightstogether.

OpportunitiesSupportedbyinsightintotheirlearning,pupilscometounderstandtheirownactivities,interactionsandlearningprocess,encouragingself-reflectionandthedevelopmentofstudyskills.

Theteachercanmonitorthelearningprocesscontinuouslyfortheentireclassandspendslesstimewritingandupdatingprogressreports.Heorshehasmoretimetoguideandsuperviseandhasbettertoolsforearlyproblemidentification.

Page 19: Report on WP4 Events - LACE Projectlaceproject.eu/wp-content/uploads/2016/06/LACE_D4_2.pdf · Learning Analytics Community Exchange Report on WP4 Events Public Deliverable – D4.2

LACEDeliverable4.2–ReportonEventsv2

17

Theschoolheadand/orschoolboardaresupportedintheireffortstostreamlinetheorganisation.Learninganalyticsmakesitpossibletoidentifythreatsatanearlystagesothatproactivestepscanbetaken(forexampletopreventpupilsfromdroppingout).Itisalsoeasiertobenchmarktheschool’sorboard’sperformance.

Fordevelopersofdigitallearningmaterialsitprovidesopportunitiestohaveabetterunderstandingofhowtheirlearningmaterialsarebeingusedandhowthequalityoftheirproductscanbeimproved.

ThreatsCollecting,sharingandusingsomuchdataaboutapupilincreasestheriskofprivacyinfringementsfromtheeducationorganisationsandthird-partyuseofthatdata.Schoolsanddevelopersbothplaypivotalrolesinensuringdatasharingisdonecorrectly.

Asyet,teachersdonothavesufficientaccesstodigitallearningmaterialsthatofferlearning-analyticsfunctionality.Teachertrainingandworkexperiencedonotincludetheanalysis,interpretationandapplicationofeducationaldata.Teachersprovidemorepersonalisedfeedbackandlearningpaths,butittakestrainingandexperiencetoreallyingrainthisintotheteachingprocess.

Schooland/orschoolboardsalsofacedifficultchoicesinanimmaturemarketwithtechnicallycomplexproducts.Thereisaneedforobjectiveexperientialdatatosupportgooddecision-making;atthemoment,thetechnologyisbeinghyped.Dashboardsareseenasanimportanttoolforsupportingteaching,andespeciallytheonesthatprovideinsightacrosssubjectsstillneedalotofdevelopmentactivities.

StrategicconsiderationsforschoolsTakingthisSWOTanalysisintoconsideration,andtodirectlearninganalyticscapabilitiesinsuchawaythattheysupportwhatschoolsneed,weidentifythefollowingstrategicconsiderationsschoolsshouldtakeintoaccountwhenimplementinganddevelopingtheirlearninganalyticsstrategies:

DecideonwhichdatawilltohelptoimplementpolicyandstrategyInordertoregister,collectandsavetherightdata,thereneedstobetransparencyonwhichaspectsofthelearningprocessinformationandthegeneraloperatingoftheschoolorganisationisneeded.Thereneedstobeclarityontheindicatorsthatwillsupporttheimplementationofpolicyandtherealisationofachosenstrategy.Isitrelevanttogatherinformationonhowlongapupilisworkingonexercises?Isitimportanttohaveinsightintoresultsofothersubjects?Dowewanttohaveinsightsintolearningprogressacrossdifferentsubjects?Whichdatacanweusetoimprovethelearningprocessofpupils,theperformanceofteachersandthegeneralrunningofaschool?Schoolsneedtobeabletomakedecisionsonthistothenseewhetherthereareproductsavailableonthemarketthatsupportthis,ortobeabletogointoaconstructivedialoguewithdeveloperstomakethisareality.

WorkonprovidingintegratedinsightinrelevantdataoneverylevelwithinaschoolorganisationThetargetfortheschoolshouldbetoprovideintegratedinsightgatheredfromdisparateinformationsources.Adashboardthatprovidesclearinsightinhowthingsaregoingforthepupil,teacher,schoolheadandschoolboardtosupportwellinformeddecision-making.

Page 20: Report on WP4 Events - LACE Projectlaceproject.eu/wp-content/uploads/2016/06/LACE_D4_2.pdf · Learning Analytics Community Exchange Report on WP4 Events Public Deliverable – D4.2

LACEDeliverable4.2–ReportonEventsv2

18

Thechallengeistobringallthisinformationfromdifferentplatformsandonvaryingaspectsinacomprehensivemanner.Thereisaneedforinteroperabilitybetweensystemsandstandardisedconnections.Whatthesestandardsandinteroperabilityneedsareandshouldentailhasbedrivenbywhatschoolsneed.Whatschoolsneedshouldbetheleadingfactorintheselectionandimplementationofneworsubstitutedigitallearningtoolsandplatforms.

DecideonwhichdatatocollectLearninganalyticsandbigdatademandconsciouslymadechoicesonwhatdatatocollectandstorethatis(potentially)availableasaby-productfromworkingdigitally.Whatinformationshouldideallybeavailabletocontinuouslyimproveeducation?Schoolsshouldmakeaninventoryonwhatdataisavailableinallownedsystemsandwhatisavailableindigitallearningmaterialsandsystemsfrom(cloud)vendors.Schoolsshouldthenmakeachoiceonwhatdatashouldbeactivelycollectedandstoredtodecidewhichindicatorstheyshouldusetoseewhethersetgoalsaremetornot.Bygettingaclearideaondataneedsschoolswillbeinabetterinformedpositionwhentalkingwithvendorsofdigitallearningmaterials,platformsandinformationsystems.

ChooseinformationsystemsthatarecomplementaryandcanbeeasilyconnectedtoeachotherTolowertoburdenonadministrativetaskswiththeuseofICTandtobeabletoprovideacomprehensiveandintegratedinsightintolearningprocesses,thereshouldbeaclearinsightintowhatdatashouldbestoredinwhichinformationsystemsandforwhatreason.Theseinformationsystemsshouldideallybeconnectedtoeachotherinsuchamannerthateachbitofinformationisstoredinjustoneinformationsystems.Thisshouldbedonetoensurethatdataisavailableinitsoriginalcontextandforthepersonsthatneedsthem.Havingthesamedataregisteredinmultiplesystemsincreasestheamountofworkandthechanceforerrors.Relevantdatainsystemsforvendorsshouldbestandardisedautomaticallyimportedintoschoolsystems.Thismightnotbethecaseatthemomentforallsystems,butschoolsshouldbeaskingforthis.

Guaranteeaccessandcontrolontheavailabilityof(online)educationaldataDataonlearningexperiencesofpupils,howtheybehaveinlearningplatformsbutalsothebusinessadministrationofaschool:allofthisstoredonlineincloudplatformsfromvendors.Vendorsareveryawareofthehuge(commercial)valuethesedatarepresent.Schoolsshouldthereforedemandfortheavailabilityandportabilityofdata.Thisisaprerequisiteforschoolstopersonaliseanddifferentiateineducationwiththesupportofinsightintothelearningprocess.Schoolsshouldthereforetakeupownershiponthisissueandmakethisanimportantdiscussionpointwithvendorsforthecomingyears.

AprivacycovenanttoprotectpersonaldataandprovidesafeguardsforproperusageofpersonaldataineducationhasbeenmadeintheNetherlands.Itcontainsasetofagreementsonhowpersonaldatashouldbehandledwhenusingdigitallearningtools/materialsanddigitaltesting.Theprivacycovenanthasbeenundersignedanddevelopedincollaborationbetweenschoolrepresentativesandthemajorsuppliersofdigitallearningtools/materials,studentinformationsystems,distributorsoflearningmaterialsandICTsupportsuppliers.Itcouldserveasanexampleforothercountriesonhowtotacklethisissue.

DatasharingDatasharingisapreconditionforrealisingthepotentialoflearninganalytics.IthasbeenthefocusofWP7intheLACEproject,whichhaspublishedanumberofreportsonthetopic,wheretheissuesare

Page 21: Report on WP4 Events - LACE Projectlaceproject.eu/wp-content/uploads/2016/06/LACE_D4_2.pdf · Learning Analytics Community Exchange Report on WP4 Events Public Deliverable – D4.2

LACEDeliverable4.2–ReportonEventsv2

19

analysedfromatechnical,semantic,organisational,andlegalperspective.Datasharingaimstosupportlearninganalyticsondifferentlevels,fromcontributingtonewknowledgeandresearchthroughbringingmoredataforresearchanddevelopment;improvingorganisationalanalysisthroughaggregationsofeducationaldatatoimproveretentionstrategiesandlearningdesign;toactivelearningsupportthroughsynchronousadaptationofthelearningcontextandcontent.

Butthereareanumberofissuesthatneedtobeaddressedinordertorealisethepotentialofdatasharingintheschoolsector.WP7identifiesimportantissuesbothwithinthetechnical,semantic,organisational,andlegalarea.Fromtheperspectiveoftheschoolsectorissuesrelatedtoprivacyandethicstogetherwithlackofdataandanalyticsknowledgeamongdecision-makerswithintheorganisationaldomainareamongthemostimportant.

Whenitcomestothepossiblewaysofaddressingtheissues,WP7findsavarietyofsolutions.Insomecasesthereappeartobetechnicalsolutionstoproblems-bothintermsofICTandstatistics-butsometimesitismoreaboutspreadingknowledgeandchangingattitudes,forexampletoembracerisk-basedapproaches.Attheheartofthemorechallengingtechnicalactionsshowsthatparticipativeanditerativeapproachesarenecessary.Approachestoprivacymustinvolvethedatasubjects.Activitiesintendedtomodellearninganalyticsinformationmusthavefoundationsinpracticeiftheinformationistobesharedwithmeaning.

SupportingtheworkofteachersandorganisationmodelsLearninganalyticscanbeseenasawaytoaugmentthe“traditional”schoolexperienceorsupportdifferentwaysoforganisingeducation.However,manytoolsthathavealearninganalyticscomponentarestructuredinsuchawaythattheycansupportthetraditionalmodelverywell,butaremoredifficulttousethefurtheritmovesawayfromthismodel.Itisthereforeimportantforschooltotakeintoconsiderationwhetheratoolsupportsthevisionoftheschoolonpersonalisedlearning.Notaligningthetoolstothevisionmeanstoolscanbeveryhardtoworkwithornotbeingabletoworkwithitatall.

AtBETT2016wepresentedsomeinsightintoresearchKennisnethasdoneregardingthis.AwidevarietyofdigitallearningtoolsthatallhavesomeformoflearninganalyticsfunctionalityintheNetherlandswerelookedattounderstandwhatkindsofvisiononpersonalisedlearningthesetoolssupported15.Mostsignificantlyisthatthesevisionsonlearningchangesthewaythelearningprocessisorganised.

Thesethreegeneralisedversionsoflearningwereused:

1. Teacherdrivenlearning• Teacherdirectsthelearningprocessofthegroup.• Learningmaterialsarematchedtothelevelofthegroup.• Learnersareorganisedingroupsdependingontheirageandlevel.

2. Autonomouslearning• Learningmaterialsareaimedattheneedsoftheindividuallearner(pace,level,order).• Learningisorganisedtoworktowardsapre-setgoal.• Teacherdirectsthelearningprocessoftheindividual.

15http://www.slideshare.net/wietsevanbruggen/bett-2016-implementing-learning-analytics-in-your-school

Page 22: Report on WP4 Events - LACE Projectlaceproject.eu/wp-content/uploads/2016/06/LACE_D4_2.pdf · Learning Analytics Community Exchange Report on WP4 Events Public Deliverable – D4.2

LACEDeliverable4.2–ReportonEventsv2

20

3. Self-Organisedlearning• Learnerthemselvesdirectsthelearningprocess(withassistanceandcoaching)• Learnerisresponsiblefortheirownlearningprocess.• Learnerlearnsontheirownlevel,theirownpace,intheirownstyle,fromtheirinterests.

Thestudyfoundthatmostoftheanalysedtoolsfitverywellintotheteacher-drivenvision.Sometoolsfitintotheautonomouslearningmodelorwouldnotrequireextensivemodificationtobeabletosupportit.Self-organisedlearningistheleastsupportedmodel.

Whichvisionofpersonalisedlearningissupportedcanbeseenmostclearlyfromthewaytheyorganiseanddisplayinformation.Toolsthatsupporttheclassicalmodeloforganisationpresenttheirinformationmainlyintheformofgroups.Toolsthatareaimedmoreatgaininginsightsforanindividuallearner,regardlessofanygrouptheymaybepartof,presentinformationinadifferentmanner.Youcanalsoseethevisionreflectedintheplanningfeaturesofthetoolswhichareaimedatgroups(orsubsetsofgroupswithinalargergroup)oraimedattheindividual.

AnexampleofaschoolintheNetherlandswhichexperiencedthisinpracticeisoneinwhichlearnersallhavetheirownindividualprogramandschedule,andwhicharenotpartofapre-definedgroupbasedonageorlevel.Regardingtoolselectiontheytellusthefollowing:

“Wehavetolookcarefullyatdigitallearningtoolsandwhethertheysupportourviewsonlearning.Creatorsofdigitallearningtoolsoftensaythattheirtoolsupportspersonalisedlearning,butinthedesignoftheirtooltheyoftenworkwiththeideaofgroupsoflearnersorclasses,andnottheindividual.Alotofproductsthereforearenotusefulforusorcanbehardtoworkwithbecausetheydon’tfullysupportourwayorworking.”

Itisimportantvendorsandschoolsworktogethertoprovidetoolsthatsupportawidevarietyoflearningorganisationmodels.Schoolshavetobeabletostatewhattheirrequirementsare,andvendorshavetotaketheserequirementsintoconsiderationwhendevelopingtheirproducts.

TheEUGeneralDataProtectionRegulationInApril2016theEuropeanParliamentvotedinfavourofadoptingtheGeneralDataProtectionRegulation(GPDR).16ThoughthenewregulationcomesintoeffectinMay2016,itwillnotbeenforceduntilMay2018.Theregulationwill‘override’nationalpolicyregardingofallEUmemberstates.Itrequiresschoolstotakeonfurtherstepsregardingdataprotectionandprivacy,andwillthusimpactschoolpolicyconcerninglearninganalytics.Itwillrequireschoolsandvendorstobecometransparentontheiruseofdataandtominimisedatausagetoonlywhatisstrictlyrequiredtoperformthetaskathand.

Schoolswillhavetodealwithstricterregulationontheusageofpersonaldata.Theywillbecomerequiredtobettersupportwhypersonaldataoflearnersiscollectedandprocessedandforhowlongthisdatawillbekept.Dataminimalisationwillbeastartingpointforthis:schoolswillnotbeallowedaskandcollectmoredatathanisstrictlynecessary.The‘righttobeforgotten’regulation

16http://ec.europa.eu/justice/data-protection/index_en.htm

Page 23: Report on WP4 Events - LACE Projectlaceproject.eu/wp-content/uploads/2016/06/LACE_D4_2.pdf · Learning Analytics Community Exchange Report on WP4 Events Public Deliverable – D4.2

LACEDeliverable4.2–ReportonEventsv2

21

appliestothisaswell;ifthedatanolongerservesapurposeparentsforexamplewillbeabletomoreeasilyaskschoolstodeletedata.

Permissiontouselearnerdatawillberequiredfromlearnersandparents.Learnersandparentshavetobeinformedaboutthereasonforaskingcertaindataandtheremustbeevidenceofclearandconfirmativeconsentfromthem.Ifaschoolwantstouseacertainproductthatrequireslearnerdatatofunction,theyarerequiredtobeabletoshowthatthereisconsent.Thisrequestforproofofconsentcanalsocomefromthevendoroftheproduct.

TheGPDRstimulatestheusageofriskanalyses.Schoolswillberequiredtoperformriskanalysesfortheproductsthatthey(wantto)usethatinvolvepersonaldata.Theywillhavetobringintofocuswhatthepotentialbigrisksareforacertainproductanddescribemeasurestobetakentominimisethoserisks.

Publicsectorinstitutionslikeschoolswillmostlikelyhavetoappointanofficerfordataprotection.Thisofficerwillhavethetasktoperforminternalsupervisionandoversightonthecollectionandprocessingofpersonaldatawithintheinstitution.Thistaskwillbecomeprotectedbylaw.

TheGPDRalsocallsfordesigningproductsthatuseaslittlepersonaldataaspossible.Privacybydesignhastobecomeanimportantpartoftheconceptionanddesignofproductsandthereforealsoimpactsonthedevelopmentoflearninganalyticsproducts.Privacybydesignhastobecomeanessentialprincipleandhastobecomeoftheconceptionanddesignoftheproduct,insteadofsomethingthathasbeenaddedasanafterthought.

Page 24: Report on WP4 Events - LACE Projectlaceproject.eu/wp-content/uploads/2016/06/LACE_D4_2.pdf · Learning Analytics Community Exchange Report on WP4 Events Public Deliverable – D4.2

LACEDeliverable4.2–ReportonEventsv2

22

ConclusionItisstillveryearlydayswhenitcomestotheuseoflearninganalyticsintheschoolsectorinEurope.Mostcountriesarestillnotactivelyimplementing,norevenpursuingpreparationstoimplement,learninganalyticelementsintheschoolsectoratnationallevel.TheschoolsectorinEuropeisnotperceivedasonebutratherclosednationallywhichmeansthattherearefeweventsattractingparticipantsfromthemajorityofcountries.OnelessonWP4learntisthatitisdifficulttoapproachtheschoolsectorasawholesincethereisonlyoneortwoconferencesinEuropethatattractpeoplefrommorethanonecountry.

Thereare,however,countrieslikeDenmark,theNetherlandsandtosomeextentNorwayfromwhichtheschoolssectorcanlearnanddrawinspirationfrom.ThroughnationalworkshopsandseminarsaswellaspresentationsinlargereventssuchasBETTinLondon,andconferencestogetherwithkeyorganisationslikeEuropeanSchoolnet,decisionmakersinanumberofcountrieshavebeenmadeawareofthepotentialofandtheissuestobetakenintoconsiderationregardinglearninganalytics.ItisthebeliefofWP4thatinthecomingyears,learninganalyticswillbecomeanimportantissueformostMinistriesofEducationinEurope.Andwhenthisinterestgrows,theworkoftheLACEprojectwillbeconsideredasafirmfoundationtosteponintheirfurtherexplorationofthepotentialoflearninganalyticsintheEuropeanschools.

Page 25: Report on WP4 Events - LACE Projectlaceproject.eu/wp-content/uploads/2016/06/LACE_D4_2.pdf · Learning Analytics Community Exchange Report on WP4 Events Public Deliverable – D4.2

LACEDeliverable4.2–ReportonEventsv2

23

About

VersionHistoryDate Notes Person2016-05-20 Firstdraft WietsevanBruggen,JanHylén

2016-05-29 Revisions,basedonreviewbyToreHoelandMarcoPaini

WietsevanBruggen,JanHylén

2016-05-31 FinalDraft PeterKarlberg,WietsevanBruggen,JanHylén

2ß16-05-31 ClearedforsubmissiontotheEC HendrikDrachsler,MarenScheffel

AboutthisdocumentLicensedforuseunderthetermsoftheCreativeCommonsAttributionv4.0licence.Attributionshouldbe“byPeterKarlberg,WietsevanBruggen,JanHylénfortheLACEProject(http://www.laceproject.eu)”.

Formoreinformation,seetheLACEPublicationPolicyhttp://www.laceproject.eu/publication-policy/.

AboutLACETheLACEprojectbringstogetherexistingkeyEuropeanplayersinthefieldsoflearninganalytics&educationaldataminingwhoarecommittedtobuildingcommunitiesofpracticeandsharingemergingbestpracticeinordertomakeprogresstowardsfourobjectives.

Objective1–PromoteknowledgecreationandexchangeObjective2–IncreasetheevidencebaseObjective3–ContributetothedefinitionoffuturedirectionsObjective4–Buildconsensusoninteroperabilityanddatasharing

http://www.laceproject.eu @laceproject

ThisdocumentwasproducedwithfundingfromtheEuropeanCommissionSeventhFrameworkProgrammeaspartoftheLACEProject,grantnumber619424.