Smarter Law Study Habits: An Empirical Analysis of Law ... · Learning Strategies and Relationship...

24
Electronic copy available at: https://ssrn.com/abstract=3004988 Page | 1 DRAFT 7.15.2017 Smarter Law Study Habits: An Empirical Analysis of Law Learning Strategies and Relationship with Law GPA Jennifer M. Cooper 1 and Regan A. R. Gurung 2 Table of Contents PART I. INTRODUCTION 2 PART II: COGNITIVE SCIENCE RESEARCH ON STUDY & LEARNING STRATEGIES 4 A. UNDERGRADUATE STUDY & LEARNING STRATEGY RESEARCH 5 I.RETRIEVAL &SELF-TESTING 6 II.PERIODIC REVIEW 7 III.OTHER HIGHLY EFFECTIVE STUDY AND LEARNING BEHAVIORS 8 B: LAW STUDENT STUDY & LEARNING STRATEGY RESEARCH 9 PART III: METHODOLOGY OF THE LAW STUDENT STUDY HABITS SURVEY 11 A. RESEARCH QUESTIONS &HYPOTHESES 12 B. DEVELOPMENT OF THE LAW STUDENT STUDY HABITS SURVEY 13 C. ADMINISTRATION OF THE LAW STUDENT STUDY HABITS SURVEY 15 PART IV: RESULTS OF THE LAW STUDENT STUDY HABITS SURVEY 16 A. POSITIVE CORRELATION WITH LAW GPA 17 B. NEGATIVE CORRELATION WITH LAW GPA 18 C. DISCUSSION OF RESULTS 19 PART V: RECOMMENDATIONS 21 A. RECOMMENDATIONS FOR LEGAL EDUCATORS 22 B. RECOMMENDATIONS FOR LAW STUDENTS 22 C. FUTURE OF THE LAW STUDENT STUDY HABITS SURVEY 24 1 Adjunct Professor, Tulane University Law School. Eternal gratitude to my co-author, co-investigator, and friend, Dr. Regan A. R. Gurung. Without his assistance, this project would have died long ago. Special thanks to Michael Hunter Schwartz and Louis N. Schulze, Jr. who provided valuable advice and recommendations. 2 Professor of Human Development and Psychology, Chair of Human Development, University of Wisconsin-Green Bay. Ph.D., University of Washington, M.S., University of Washington, B.S., Carleton College.

Transcript of Smarter Law Study Habits: An Empirical Analysis of Law ... · Learning Strategies and Relationship...

Page 1: Smarter Law Study Habits: An Empirical Analysis of Law ... · Learning Strategies and Relationship with Law GPA Jennifer M. Cooper1 and Regan A. R. Gurung2 Table of Contents PART

Electronic copy available at: https://ssrn.com/abstract=3004988

Page|1 DRAFT7.15.2017

SmarterLawStudyHabits:AnEmpiricalAnalysisofLawLearningStrategiesandRelationshipwithLawGPA

JenniferM.Cooper1andReganA.R.Gurung2

TableofContents

PARTI.INTRODUCTION 2

PARTII:COGNITIVESCIENCERESEARCHONSTUDY&LEARNINGSTRATEGIES 4

A.UNDERGRADUATESTUDY&LEARNINGSTRATEGYRESEARCH 5I.RETRIEVAL&SELF-TESTING 6II.PERIODICREVIEW 7III.OTHERHIGHLYEFFECTIVESTUDYANDLEARNINGBEHAVIORS 8

B:LAWSTUDENTSTUDY&LEARNINGSTRATEGYRESEARCH 9

PARTIII:METHODOLOGYOFTHELAWSTUDENTSTUDYHABITSSURVEY 11

A.RESEARCHQUESTIONS&HYPOTHESES 12B. DEVELOPMENTOFTHELAWSTUDENTSTUDYHABITSSURVEY 13C.ADMINISTRATIONOFTHELAWSTUDENTSTUDYHABITSSURVEY 15

PARTIV:RESULTSOFTHELAWSTUDENTSTUDYHABITSSURVEY 16

A.POSITIVECORRELATIONWITHLAWGPA 17B.NEGATIVECORRELATIONWITHLAWGPA 18C.DISCUSSIONOFRESULTS 19

PARTV:RECOMMENDATIONS 21

A. RECOMMENDATIONSFORLEGALEDUCATORS 22B. RECOMMENDATIONSFORLAWSTUDENTS 22C.FUTUREOFTHELAWSTUDENTSTUDYHABITSSURVEY 24

1AdjunctProfessor,TulaneUniversityLawSchool.Eternalgratitudetomyco-author,co-investigator,andfriend,Dr.ReganA.R.Gurung.Withouthisassistance,thisprojectwouldhavediedlongago.SpecialthankstoMichaelHunterSchwartzandLouisN.Schulze,Jr.whoprovidedvaluableadviceandrecommendations.2ProfessorofHumanDevelopmentandPsychology,ChairofHumanDevelopment,UniversityofWisconsin-GreenBay.Ph.D.,UniversityofWashington,M.S.,UniversityofWashington,B.S.,CarletonCollege.

Page 2: Smarter Law Study Habits: An Empirical Analysis of Law ... · Learning Strategies and Relationship with Law GPA Jennifer M. Cooper1 and Regan A. R. Gurung2 Table of Contents PART

Electronic copy available at: https://ssrn.com/abstract=3004988

Page|2 DRAFT7.15.2017

PartI.IntroductionLawstudentsspendanenormousamountoftimestudyingduringtheirfirstyear,relying

heavilyonreadingandrereading.3Mostlawschoolsorientincomingstudentsonbasicskillsofcasereadingandbriefing.However,mostlawschoolsdonotteachlawstudentshowtostudy,howtoapplyinformationfromreadingandbriefingtolearningthelawconceptsnecessaryforacademicsuccess,leavingacademicpreparationtonon-empiricallawschoolsuccessresources,4andstudents’ownimprovisedstudyandlearningstrategies.Duetoalackofresearchonlawstudentlearning,legaleducatorsandlawstudentsdonotactuallyknowwhichlawstudyandlearningbehaviorsleadtosuccessinlawschoolandwhichmerelywastestudents’time.5

Cognitivescienceresearchonstudyandlearningstrategiesshowsthatundergraduatestudentsoverwhelmingrelyonpassive,ineffectivestrategies,likereadingandrereading,insteadofactive,effectivestrategieslikeretrieval,self-testing,andperiodicreview,whichincreaselearningandgaugecomprehension.Undergraduatestudentsareabletogetbyandmatriculateusingineffective,passivelearningstrategies,butalsodevelopillusionsofconfidenceinineffectivestrategies,andcontinuetousetheseineffectivelearningandstudystrategiesinlawschool.

ThisArticleshowsthatlawstudentsunwittinglyfallintoa“lawschoollearningtrap”6byrelyingonpassivestrategieslikereading,rereading,andbriefingcaseswithouttestingwhethertheyarelearningthroughactivestrategies.Lawstudentscanavoidthelawschoollearningtrapbyusingactivestrategies,likeretrieval,self-testing,andelaboration,thatincreaselearning,testwhatstudentsknowanddonotknow,providingcriticalformativeself-assessmentand

3Lawstudentreadingandstudyingbehaviorsrefertomanydifferentcognitivestepsandactivitieslikereadingandhighlightingcases,rereadingcases,summarizingandbriefingcases,goingtoclass,takingnotes,outlining,memorizingrules,meetingwithstudygroups,workingthroughpracticequestions,etc.EdwardL.Kimball,LarryC.Farmer,andD.GladeMonson,Ability,Effort,andPerformanceAmongFirst-YearLawStudentsatBrighamYoungUniversity,1981AM.BARFOUND.RES.J.671,676(1981)(findingfirstyearstudentsstudyonaverage53hoursperweekoutsideofclass).TheLawSchoolSurveyofStudentEngagement(LSSSE)askedfirstyearlawstudentstoestimatehowmanyhourstheyspentinatypical7-dayweekreadingassignedtextbooks,onlineclassreading,andothercoursematerials.Firstyearlawstudentsestimatedtheyspent31-33hoursperweekreadingassignedtextbooks,onlineclassreading,andothercoursematerials.4The“triedandtrue”studyadviceinlawschoolsuccessresourcescanbesummarizedas:readandbriefeverycase,gotoclass,takenotes,makecourseoutlines,andpracticebeforeyourexams.Inthepastfiftyyears,onlythreeempiricalinquirieshavetargetedlawstudentstudybehaviors,andtwoofthethreearefrom1968and1975respectively.Incontrast,undergraduateandgraduatedisciplineshaveroutinelyusedcomprehensivestudybehaviorresearchinstrumentssincethe1930’s.Seee.g.Study-HabitsInventory(Wren,1933);StudySkillsInventory(Locke,1940);SurveyofStudyHabits&Attitudes(SSHA,Brown&Holtzman,1955);LearningandStudyStrategiesInventory(LASSI,Weinsten&Palmer,2002);StudyBehaviorsChecklist(SBC,Gurung,2005;Gurung,Weidert&Jeske,2010).SeealsoNoelEntwhistleandVeldaMcCune,TheConceptualBasesofStudyStrategyInventories,16EDUC.PSYCHOL.REV.325(2004).5Legalscholarshavelamentedthelackofempiricalresearchinlegalscholarshipingeneral.JamesR.P.Ogloff,DavidR.Lyon,KevinS.Douglas,andV.GordonRose,Morethan“LearningtoThinkLikeaLawyer:”TheEmpiricalResearchonLegalEducation,34CREIGHTONL.REV.73,100(2000)(“Perhapsitissurprisingthatsolittleresearchattentionhasbeenpaidtothestudyhabitsthatstudentsemploytohelpthemnavigatetheirwaythroughtheobstaclesoflawschool.”).SeegenerallyPeterH.Schuck,WhyDon’tLawProfessorsDoMoreEmpiricalResearch?,39J.LEGALEDUC.323(1989);MatthewSpitzer,EvaluatingValuingEmpiricism(atLawSchools),53J.LEGALEDUC.328(2003)(discussingwaystopromoteempiricalresearchinlegalscholarship).StevenFriedland,ACriticalInquiryIntotheTraditionalUsesofLawSchoolEvaluation,23PACEL.REV.147(2002)(Althoughtestinghasbeena“steadfastfixtureoflegaleducationsincethelate1700s…comparativelyfewinstitutionalresourceshavebeendevotedtotheevaluationprocess,andbothinstitutionsandindividualinstructorsgenerallyholdtheevaluationprocesswithasimilarlackofregard.”).6Iusetheterm“lawschoollearningtrap”todescribealawstudentstudypatternwhereastudentfollowstheconventional,triedandtruestudyadviceofreadingandbriefingcasestoprepareforclass,gotoclassandtakenotes,makescourseoutlines,memorizesblackletterlaw,butdoesnotrevieworengageinanyretrievalorpracticetesting,whichleadstoamistakenbeliefreadingandbriefingforclassissufficienttolearnthematerialinlawschool.Studentswhofollowthispatternoftendonottesttheirknowledgewithpracticequestionsorhypotheticalfactualsituations.

Page 3: Smarter Law Study Habits: An Empirical Analysis of Law ... · Learning Strategies and Relationship with Law GPA Jennifer M. Cooper1 and Regan A. R. Gurung2 Table of Contents PART

Page|3 DRAFT7.15.2017

opportunitiesforcorrection.7Fewlegaleducatorsofferformativeassessmentsuchasweeklyquizzesormidtermexams.Lawstudentsthatdonotuseself-testingandformativeself-assessmentmaynotrealizetheyhavefallenintothelawschoollearningtrapuntilsittingforfinalexams.

Thestakesarehighforlawstudentsandlegaleducators.Firstyearlawstudentswhodowellacademicallywincovetedaccesstoscholarships,lawreview,jobinterviews,possibletransferstomoreprestigiouslawschools,andhigherbarpassagerates.8Whilefirstyearlawstudentswithpooracademicperformancearedeniedaccesstoprestigiousopportunities,losescholarships,faceacademicdismissal,andexperiencehigherbarfailurerates.9

Thelawschoollearningtrapaddstothestressful,corrosive,anddehumanizingnatureofthelawschoollearningenvironmentonlawstudents’wellbeing,values,andmotivation,specificallythelackofformativeassessment,unsoundteachingandtestingmethods,andcontinuedrelianceonsummativeassessment.10Legalscholarshavewrittenextensivelyonthedehumanizingnatureoflawschoolandtheneedtoprovidelawstudentswithself-determinationandautonomysupport.11Lawstudentsneedtofeelthattheyaregoodatwhattheyaredoing-namely,studyingandlearninginlawschool-orthattheycanbecomegoodatit.12

Lawschoolsareunderincreasingpressuretoprovethatlegaleducationworksandisworththecost.TheAmericanBarAssociationisputtingmorepressureonlawschoolstocomplywithaccreditationrequirements13andtoassesslawstudentlearningusing“formativeandsummativeassessmentmethodsinitscurriculumtomeasureandimprovestudentlearningand7Asthisarticlewilldiscuss,relyingonreadingandrereadingcasesandotherpassivelearningandstudystrategiesinlawschoolwithoutengaginginactivestrategieslikeretrievalandself-testingcorrelateswithpooracademicperformance.Firstyearstudentsfallintothe“lawschoollearningtrap”becausereadingandbriefingcasestoprepareforclassistimeconsuming,resultinginafluencyandfamiliaritythatcreatesillusionsofconfidencewiththematerial.8Lawschooliscompetitiveandlawstudentsareobsessedwiththeiracademicstanding.Studentsarehighlymotivatedtoengageinbehaviorsthatwillresultinhighergrades,especiallyinlightofthemandatorygradecurvesatmostlawschools.FirstyearlawGPAwillalsodeterminewhetherstudentsareeligibleformeritbasedscholarships,retainscholarshipsgaineduponentry,eligibilityforlawreviewandmootcourt,eligibilityforon-campusinterviewspots(OCI),andnottobeplacedonacademicprobationorworse,academicallydismissed.VernelliaR.Randall,IncreasingRetentionandImprovingPerformance:PracticalAdviceOnUsingCooperativeLearninginLawSchools,16T.M.COOLEYL.REV.201(1999);TheElephantintheAdmissionsOffice:TheInfluenceofU.S.News&WorldReportontheRiseofTransferStudentsinLawSchoolsandaModestProposalforReform.SeveralarticlesdiscussfirstyearlawGPAasmorepredictiveofhigherbarpassageratesthanLSAT,especiallyfordoctrinalclasses.KeithKaufman,V.HollandLaSalle-Ricci,CarolR.Glass,DianeB.Arkoff,PassingtheBarExam:Psychological,Educational,andDemographicPredictorsofSuccess,57J.LEGALEDUC.205(2007);KatherineA.Austin,CatherineMartinChristopher,DarbyDickerson,WillIPassTheBarExam?PredictingStudentSuccessUsingLSATScoresandLawSchoolPerformance,45HOFSTRAL.REV2016(forthcoming)(first-yearlawschoolGPAisstatisticallysignificantindicatorofbarexamsuccess);NicholasGeorgakopoulas,BarPassage:GPAandLSAT,NotBarReviews,RobertH.McKinneySchoolofLawLegalStudiesResearchPaperNo.2013-30,https://papers.ssrn.com/sol3/papers.cfm?abstract-id=2308341(lawschoolGPAstronglycorrelateswithbarpassage).9TheAmericanBarAssociationcollectsdataonthenumberofstudentsacademicallydismissedfromlawschools.http://www.abarequireddisclosures.org/.For2016,lawschoolsreportedacademicdismissalsafterthefirstyearoflawschool,ashighas30%offirstyearstudents.Forexample,CharlotteSchoolofLawreported130academicdismissalsafterthefirstyearoutof391firstyearstudents.ErinLain,ExperiencesofAcademicallyDismissedBlackandLatinoStudents:StereotypeThreat,FightorFlightCopingMechanisms,IsolationandFeelingsofSystemicBetrayal,45J.L.&EDUC.279(2016).10KennethM.Sheldon&LawrenceS.Krieger,Doeslegaleducationhaveunderminingeffectsonlawstudents?Evaluatingchangesinmotivation,valuesandwell-being,22BEHAV.SCI.&L.261(2004).11Id.at262.“Potentialnegativeaspectsoflegaleducationincludeexcessiveworkloads,stress,andcompetitionforacademicsuperiority,institutionalemphasisoncomparativegrading,…lackofclearandtimelyfeedback…”Seee.g.LouisN.Schulze,Jr.andA.AdamDing,AlternativeJustificationsforAcademicSupportIII:AnEmpiricalAnalysisoftheImpactofAcademicSupportonPerceivedAutonomySupportandHumanizingLawSchools,38OHION.U.L.REV.999(2012);MichaelHunterSchwartz,HumanizingLegalEducation:AnIntroductiontoaSymposiumWhoseTimeCame,47WASHBURNL.J.235,239-41(2008).12AccordingtoKrieger,providinginformationaboutempiricallysupportedlawstudybehaviorssupportsself-determinationtheoryandhelpstohumanizelegaleducation.13From2016-2017,theAmericaBarAssociationcensuredAveMariaSchoolofLawandValparaisoLawSchoolfornon-compliancewithadmissionsstandardsandplacedArizonaSummitLawSchoolandCharlotteLawSchoolonprobationforsubstandardadmissionspoliciesandlowbarpassrates.

Page 4: Smarter Law Study Habits: An Empirical Analysis of Law ... · Learning Strategies and Relationship with Law GPA Jennifer M. Cooper1 and Regan A. R. Gurung2 Table of Contents PART

Page|4 DRAFT7.15.2017

providemeaningfulfeedbacktostudents.”14Enrollmentcontinuestodeclineaddingtotheloomingthreatoffailinglawschools.15

Lawstudentsalsoneedtounderstandeffectivelearningstrategiestobeeffectivelifelonglearners.16Lawlearningdoesnotstopwiththebarexam.Afteradmissiontopractice,lawyersareexpectedtocontinuelearningandmasteringcomplicatedmaterialtoeffectivelyrepresentclients.

Legaleducatorsandlawstudentsneedempiricalresearchtoevaluatewhetherthelawstudentstudyandlearningmethodsactuallywork.17ThisArticleprovidesempiricalcorrelationoflawstudentstudyandlearningstrategiestoacademicsuccessinlawschoolandfindsthatpassivelearningstrategieslikereadingandrereadingwithoutpracticeapplyingthelawisnegativelycorrelatedwithlawschoolacademicsuccess,whileactivelearningstrategieslikeretrieval,self-testingandelaborationthatinvolvepracticeapplyingthelawarepositivelycorrelatedwithlawschoolacademicsuccess.PartIIsummarizesexistingcognitivescienceresearchonundergraduatestudyandlearningstrategiesandexistingresearchonlawstudentstudybehaviors.PartIIIdiscussesthedevelopmentandadministrationoftheLawStudentStudyHabitsSurvey.PartIVdiscussestheresultsoftheresearch.PartVmakesrecommendationsbasedontheresults.

PartII:CognitiveScienceResearchonStudy&LearningStrategies

Hundredsofempiricalstudieshaveexaminedundergraduatestudyandlearningbehaviors,18demonstratingaclearlinkbetweenstudybehaviorsandacademicperformancethatareasstatisticallysignificantastherelationshipbetweenacademicperformanceandthetwomostfrequentlyusedpredictors:prioracademicperformance(GPA)andtestscores(ACT,SAT,etc.).19

Undergraduateresearchershavedevelopedandusedresearchinstrumentstoassesswhichstudybehaviorsarecorrelatedwithacademicsuccess,thestudyhabits,skillsandattitudesthemselves,20thedepthofinformationprocessingduringstudy,andstudents’metacognitive

14SeeAmericanBarAssociationStandard314:“Alawschoolutilizebothformativeandsummativeassessmentmethodsinitscurriculumtomeasureandimprovestudentlearningandprovidemeaningfulfeedbacktostudents.”SeealsoJanetFisher,PuttingStudentsattheCenterofLegalEducation:HowanEmphasisonOutcomeMeasuresintheABAStandardsforApprovalofLawSchoolsmightTransformtheEducationalExperienceofLawStudents,35SOUTHERNILLINOISL.J.225(2011);RogelioA.Lasso,IsOurStudentsLearning?UsingAssessmentstoMeasureandImproveLawSchoolLearningandPerformance,15BARRYL.REV.73(2010);GregoryS.Munro,OUTCOMESASSESSMENTFORLAWSCHOOLS(2000).15Lawschoolapplicationscontinuetodeclineyearafteryear.Severallawschoolsareeitherclosingpermanentlyorareinsevereeconomicdistress.InOctober2016,IndianaTechLawSchoolannouncedthatitwouldcloseinJune2017.InApril2017,WhittierLawSchoolannouncedthatitwouldnotacceptincomingstudentsforthe2017-2018academicyear,wouldgraduatetheexistingstudents,thenclosethelawschool.https://www.law.whittier.edu/index/news/article/a-message-from-the-whittier-college-board-of-trustees.16SeeAnthonyNiedwiecki,TeachingforLifelongLearning:ImprovingtheMetacognitiveSkillsofLawStudentsthroughMoreEffectiveFormativeAssessmentTechniques,40CAP.U.L.REV.149,150(2012).17SeeKathrynZeiler,TheFutureofEmpiricalLegalScholarship:WhereMightWeGoFromHere,66J.LEGALEDUC.78,80(2016)(acknowledgingthevalueofcredibleempiricallegalscholarship,andrecommendationsforimprovingempiricallegalscholarship).18SeeJohnHattie,VISIBLELEARNING:ASYNTHESISOFOVER800META-ANALYSESRELATINGTOACHIEVEMENT(2009).19MarcusCredeandNathanR.Kuncel,StudyHabits,Skills,andAttitudes,3PERSPECTIVESONPSYCHOLOGICALSCIENCE435(2008);Hattie,supranote___.20Studyskillsarethestudent’sknowledgeofstudystrategiesandabilitytomanagetimeandresourcestoaccomplishtheacademictask.Studyhabitsarethedegreeandregularitywithwhichthestudentusesspecificactsofstudying(e.g.,reviewsofmaterial)inanappropriateenvironment.Studyattitudesrefertoastudent’spositiveattitudetowardstudyingandacceptanceoftheeducationgoals.CredeandKuncel,StudyHabits,Skills,andAttitudes,3PerspectivesonPsychologicalScience435(2008)

Page 5: Smarter Law Study Habits: An Empirical Analysis of Law ... · Learning Strategies and Relationship with Law GPA Jennifer M. Cooper1 and Regan A. R. Gurung2 Table of Contents PART

Page|5 DRAFT7.15.2017

awarenesswhilestudying.21Thebottomlineisthetimespentstudyingdoesnotpredictacademicsuccess.22Thequalityofthestudydeterminedbythespecificbehaviorsandstrategiesusedbythelearnerdeterminestheacademicsuccess.

A.Undergraduatestudy&learningstrategyresearch

Retrieval,self-testing,andperiodicreviewarelearningsuperfoods,poweringourbrainsforlongtermlearning;rereadingandcrammingarelearningjunkfoods,feelsgood,butbadforlearning.Retrieval,self-testing,andperiodicreviewarehighlycorrelatedwithacademicsuccess.23Yet,theseactivelearningstrategiesarecounter-intuitiveandchallengeconventionalideasaboutstudying.24Despiterobustresearchprovingtheirefficacy,studentseitherdonotknowabouttheseeffectivelearningstrategiesordonottrustthem,andoverlyrelyonineffective“triedandtrue”learningstrategiescobbledtogetherthroughcommonsense,intuition,andtrialanderror.25

21Id.EarlyundergraduateresearchinstrumentsonstudybehaviorsincludetheStudy-HabitsInventorydevelopedin1933.G.G.Wren,Study-habitsInventory(1933);theStudySkillsInventorydevelopedin1940.N.M.Locke,TheStudentSkillsInventory:Astudyhabitstest,24J.APPLIEDPSYCHOL.493(1940),andtheSurveyofStudyHabits&Attitudes(“SSHA”)developedin1954.WayneH.Holtzman,WilliamF.Brown,andW.G.Farquhar,TheSurveyofStudyHabitsandAttitudes:ANewInstrumentforthePredictionofAcademicSuccess,14EDUC.ANDPSYCHOL.MEASUREMENT726(1954).ThemostwidelyusedsurveyistheLearningandStudyStrategiesInventory(“LASSI”),whichwasinitiallydevelopedinthelate1980’s.ClaireWeinstein,ErnestGoetz,PatriciaAlexander,LEARNINGANDSTUDYSTRATEGIES:ISSUESINASSESSMENT,INSTRUCTION,ANDEVALUATION(1988).TheLearningandStudyStrategiesInventory(“LASSI”)hasbeenwidelyusedtomeasureundergraduatestudents’studyhabitsaswellasstudents’motivationandawarenessofhowtheirstudyhabitsrelatetotheirlearning.H&HPublishing,OverviewofLASSIhttp://www.hhpublishing.com/_assessments/LASSI/index.html.22Undergraduatestudentsspendanaverageof15hoursperweekstudying,downfromanaverageof24hoursperweekinthe1960’sandonly1in4collegestudentsdevotemorethan20hoursaweektostudying,whichisrelativelyconsistentacrossdemographics.SeeRichardArum,JosipaRoksa,andEstherCho,IMPROVINGUNDERGRADUATELEARNING2-4(2011);RichardArum&JosipaRoksa,ACADEMICALLYADRIFT:LIMITEDLEARNINGONCOLLEGECAMPUSES(2011);ChristineBartholomew,Time:AnEmpiricalAnalysisofLawSchoolTimeManagementDeficiencies,81U.CIN.L.REV.897,904(2013);SarahA.NonisandGailI.Hudson,PerformanceofCollegeStudents:ImpactofStudyTimeandStudyHabits,85J.EDUC.FORBUSINESS229(2010)(studyfocusednotjustontimespentstudyingbutonhoweffectivelythestudentspendstimestudyingthatinfluencesacademicperformance,studyresultsdidnotdemonstrateasignificantdirectrelationshipbetweentheamountofstudytimeandacademicperformance).MarcusCredeandNathanR.Kuncel,StudyHabits,Skills,andAttitudes,3PERSPECTIVESONPSYCHOL.SCI.435(2008)(Programsthatfocusontheacquisitionofspecificstudyskillsarelikelytobeparticularlyusefulinlightoftheconsistentfindingthatthetimespentstudyingislargelyunrelatedtoacademicperformance);E.AshbyPlant,K.AndersEricsson,LenHillandKiaAsberg,Whystudytimedoesnotpredictgradepointaverageacrosscollegestudents:Implicationsofdeliberatepracticeforacademicperformance,30CONTEMP.EDUC.PSYCHOL.96(2005)(researchershaveconsistentlyfoundaweakorunreliablerelationshipbetweentheweeklyamountofreportedstudytimeandgradepointaverage(GPA)forcollegestudents).23See,e.g.,PeterC.Brown,HenryL.RoedigerIII&MarkA.McDaniel,MAKEITSTICK:THESCIENCEOFSUCCESSFULLEARNING16-17(2014);BenedictCarey,HOWWELEARN:THESURPRISINGTRUTHABOUTWHEN,WHERE,ANDWHYITHAPPENS(2014);BennettL.Schwartz,LisaK.Son,NateKornell,BridgidFinn,FourPrinciplesofMemoryImprovement:AGuidetoImprovingLearningEfficiency,21:1INT’LJ.OFCREATIVITY&PROBLEMSOLVING7(2011)(fourprinciplesofmemoryimprovement:(1)activelyprocessingmaterial,(2)retrievalpractice,(3)distributedpractice(i.e.,spacing),and(4)metamemory).24See,e.g.,BROWN,ROEDIGERIII&MCDANIEL,MAKEITSTICK;CAREY,HOWWELEARN.25Id.at8;RobertA.Bjork,JohnDunlosky,andNateKornell,Self-RegulatedLearning:Beliefs,Techniques,andIllusions,64ANNUALREV.OFPSYCHOL.417,419(2013).Ourintuitionsabouthowtolearnareanunreliableguideastohowweshouldmanageourlearningactivities.Weassumethat“childrenandadultsdonotneedtobetaughthowtomanagetheirlearningactivities.”Collegesanduniversitiesaremoreconcernedaboutwhetherincomingstudentshavenecessarybackgroundknowledgeinimportantdomains(i.e.,English,math,etc.),butdonottestwhetherstudentshavethenecessarylearningskillstoeffectivelearn;seealsoVeronicaX.Yan,Khanh-PhuongThai,RobertA.Bjork,Habitsandbeliefsthatguideself-regulatedlearning:Dotheyvarywithmindset,3J.APPLIEDRESEARCHINMEMORYANDCOGNITION140(2014);JenniferMcCabe,MetacognitiveAwarenessofLearningStrategiesinUndergraduates,39MEMORY&COGNITION462(2011).

Page 6: Smarter Law Study Habits: An Empirical Analysis of Law ... · Learning Strategies and Relationship with Law GPA Jennifer M. Cooper1 and Regan A. R. Gurung2 Table of Contents PART

Page|6 DRAFT7.15.2017

Retrieval,self-testing,andperiodicreviewrequiremoreeffortandplanningthanthemostcommonlyusedstudymethods,rereadingandcramming.26Retrieval,self-testing,andperiodicreviewalsocreatedesirabledifficultiesyieldingdeeper,moredurablelearning.27But,whenstudentsperceivestudyingashard,theyincorrectlybelievetheyarenotlearningandresorttoeasierstudyandlearningmethods,likerereadingandcramming.Whenthelearningfeelseasy,studentsmistakenlybelievethatmaterialiswelllearned.28But,thelearninggainsareshorttermandquicklyfade.Easycome,easygo.

Cognitivescienceandempiricalresearchprovesmuchofwhatwethinkweknowaboutlearningiswrong.Whenlearningfeelshard,itactuallysticksandlastlonger.29Forgettingispartoflearning.Mistakesduringlearningaregoodbecausetheyshowknowledgegapsandcreateopportunitiesforclarificationandconsolidation.Rereadingtricksusintothinkingwelearnmorethanweactuallydo.30Learningismessyandnon-linear,lessasteadyinclinethanaseriesofstarts,turns,dead-ends,reroutes,andexplosivespeed.Whatworksbestforlearningmaynotbeintuitive,butcanbeexplicitlytaught,assistingstudentsinbecomingself-regulated,expertlearners.

i.Retrieval&Self-Testing

Retrievalisanempiricallyprovenlearningtool,morepowerfulthanreading,rereading,oranyotheractofmemorization.Retrievinginformationfrommemoryand“testing”yourknowledgeleadstodeeperlearningthanmorepopularstudybehaviorsofmemorizationandrereading.31Everytimeinformationisretrieved,itbetterconnectstootherlearnedmaterial,andbecomesmoreaccessibleinthefuturebecauseretrievalandtestingcreatesbetterorganizationofknowledge.32

Retrievalismuchmorethananassessmentofone’sknowledge-theretrievalprocesscreateslearningwhilegauginglearningdepth.33Thehardertheinformationistoretrieve,theharderthebrainmustworktodigitup,thegreaterthelearning.34Retrievinginformationfrommemoryisdifferentandharderthanjustseeingtheinformationagainasinrereading.35

26See,e.g.,BROWN,ROEDIGERIII&MCDANIEL,MAKEITSTICK;CAREY,HOWWELEARN.JeffreyD.Karpicke,A.C.Butler,andH.L.Roediger,Metacognitivestudiesinstudentlearning:Dostudentspracticeretrievalwhentheystudyontheirown?17MEMORY471-479(2010).Rereading,highlighting,underliningandporingovernotesandtextsarethemostcommonlyusedstudystrategies.27Desirabledifficultiesreferstolearningconditionsthatarechallengingandseemtoslowdownlearning,butactuallyimprovelong-termlearning,retention,andtransfer.RobertA.Bjork,JohnDunlosky,andNateKornell,Self-RegulatedLearning:Beliefs,Techniques,andIllusions,64ANN.REV.PSYCH.417,434(2013).Self-testingusingretrievalandfreerecallisacommontypeofdesirabledifficulty,aswellasperiodicreview,interleaving,andgeneratinganswers.SeealsoElizabethM.Bloom,CreatingDesirableDifficulties:StrategiesforReshapingTeachingandLearningintheLawSchoolClassroom,95U.DETROITMERCYL.REV.(forthcoming),availableathttps://papers.ssrn.com/sol3/papers.cfm?abstract_id=2951961.28BROWN,ROEDIGERIII&MCDANIEL,MAKEITSTICKat8-22.Studentsexpressabiasfor“error-free”learning,mistakenlybelievingthaterrorsinlearningarelearningfailures,insteadofapartofthelearningprocessitself.29BROWN,ROEDIGERIII&MCDANIEL,MAKEITSTICKat9.30Theauthor’spriorarticledescribedtheseresearchfindingsindetail:JenniferM.Cooper,SmarterLawLearning:UsingCognitiveSciencetoMaximizeLawLearning,44CAP.U.L.REV.551(2016).31JeffreyD.Karpicke,A.C.Butler,andH.L.Roediger,Metacognitivestudiesinstudentlearning:Dostudentspracticeretrievalwhentheystudyontheirown?17MEMORY471-479(2010);BROWN,ROEDIGER&MCDANIEL,MAKEITSTICKat15.32SeeFranklinM.ZarombandHenryL.RoedigerIII,Thetestingeffectinfreerecallisassociatedwithenhancedorganizationalprocesses,38:8MEMORY&COGNITION995(2010).Retrieval&testingcreatesbetterorganizationofknowledge.33Seegenerally,KarpickeandGrimaldi.34CAREY,HOWWELEARNat84.35CAREY,HOWWELEARNat94;Retrievalisnotjustaread-outofstoredknowledge;theactofretrievingitselfcreateslearning.KarpickeandBlunt,at771-772.Theharderitistoretrievesomethingfrommemory,themoreeffortrequiredtoretrievetheinformation,createsadesirabledifficulty,andmakesthememorystick,.BROWN,ROEDIGER&MCDANIEL,MAKEITSTICKat26-45.

Page 7: Smarter Law Study Habits: An Empirical Analysis of Law ... · Learning Strategies and Relationship with Law GPA Jennifer M. Cooper1 and Regan A. R. Gurung2 Table of Contents PART

Page|7 DRAFT7.15.2017

Thetestingeffectisawell-establishedcognitivescienceprinciplethatengagingintesting(retrievalpractice)enhanceslong-termretentioncomparedtorereadingorotherpassivestudyingactivities.36Retrievalandtestingalsoimprovestransferandknowledgeofnewcontexts.37Usingretrievalpracticesuchaspracticequestionsorself-quizzingevenreducestestanxietyandprotectsourmemoriesfromstress.38Retrievalandthetestingeffectareeffectivelearningtools,dispelillusionsofcompetence,andhelpstudentsaccuratelygaugetheirlearningprogress.Retrievalandtestingarevaluableformativeself-assessmenttoolsthatstudentscanuseontheirowntoprovidefeedbackontheirlearningprogress.

Yet,rereadingisbyfarthemostcommonlyusedstudyandlearningstrategy.39Thevastmajorityofstudentssteadfastlybelievethebestwaytolearnistoreadandrereadandrereadagaininasinglestudysessionuntilmaterialislearned.40Studentsincorrectlybelievethatrereadingcreatesmorelearningandthattestingmerelymeasureswhathasbeenlearnedtoreceiveagrade.41Massedrepetitionandrereadingcreatesillusionsofcompetence,afalsesenseoflearning,whileretrievalandself-testingtestscompetenceandaccuratelygaugeswhathasbeenlearned.42

ii.PeriodicReview

Assoonaswelearnsomethingnew,westarttoforgetit.43Byperiodicallyretrievinglearnedinformation,weslowtheforgettingprocess.Periodicrevieworspacingstudyistheoppositeofcrammingormassingstudy,andmeansretrievingmaterialafteraperiodoftimehaselapsedbetweenretrievalsessions–daysorweeks-toallowforforgettingbeforethenext

36SeeHenryL.RoedigerIIIandBridgidFinn,ThePlusesofGettingItWrong,21:1SCI.AM.MIND38(2010);SeeFranklinM.ZarombandHenryL.RoedigerIII,Thetestingeffectinfreerecallisassociatedwithenhancedorganizationalprocesses,38:8MEMORY&

COGNITION995(2010).Thetestingeffectpromoteslearningratherthanjustassessinglearning.37HenryRoedigerIII,AdamL.Putnam,andMeganA.Smith,TenBenefitsofTestingandTheirApplicationstoEducationalPractice,55PSYCHOL.OFLEARNINGANDMOTIVATION1,14(2011).Repeatedtestingspacedovertimeledtoimprovedtransferofcomplexmaterialtonewquestionsinanewdomaincomparedtorestudyingmaterial.AndrewC.Butler,RepeatedTestingProducesSuperiorTransferofLearningRelativetoRepeatedStudying,36J.EXPERIMENTALPSYCHOL.:LEARNING,MEMORY&COGNITION1118,1128(2010)(finding“test-enhancedlearning”increaseslong-termretentionandpromotestransfertonewinferentialquestionsfromdifferentknowledgedomainsbetterthanrestudying).38AmyM.Smith,VictoriaA.Floerke,AyannaK.Thomas,RetrievalPracticeProtectsMemoryAgainstAcuteStress,354SCIENCE1046,1047(2016)(“Whereaswedidfindmemoryretrievalimpairmentduringthedelayedstressresponsewheninformationwasencodedbyrestudying,thatimpairmentwasabsentwheninformationwasencodedbyretrievalpractice.Thus,wearguethatstressmaynotimpairmemoryretrievalwhenstrongermemoryrepresentationsarecreatedduringencoding.”)39JeffreyD.Karpicke,A.C.Butler,andH.L.Roediger,Metacognitivestudiesinstudentlearning:Dostudentspracticeretrievalwhentheystudyontheirown?17MEMORY471-479(2010);BROWN,ROEDIGER&MCDANIEL,MAKEITSTICKat15.40“Thefindingthatrereadingtextbooksisoftenlaborinvainoughttosendachillupthespinesofeducatorsandlearners,becauseit’sthenumberonestudystrategyofmostpeople–includingmorethan80percentofcollegestudentsinsomesurveys–andiscentralinwhatwetellourselvestododuringthehourswededicatetolearning.”BROWN,ROEDIGER&MCDANIEL,MAKEITSTICKat10.41JeffreyD.Karpicke,Retrieval-BasedLearning:ActiveRetrievalPromotesMeaningfulLearning,21:3CURRENTDIRECTIONSINPSYCHOL.SCI.157(2012).Manystudentsbelievethat“studying”meansrereadingmaterialoverandoverandthat“practicing”or“self-testing”isonlytoassesswhatonehaslearnedthroughrereading.Thechoicetorepeatedlyreadandrereadmaterialislogicaliflearningisonlytheprocessofencodingorinputtinginformationandifretrievalisonlyawaytoassesspriorlearning.Tostudyforanupcomingtest,studentsweregivenachoice-afteryoureadthroughyournotesandthetext,whichwouldyoudonext:(a)gobackandrestudythematerial(allorparts),(b)trytorecallthematerial,or(b)dosomeotherstudyactivity.Themajorityofstudentschosetorereadtheirnotesorthetext,butveryfewstudentsattemptedtorecallthematerial.42BROWN,ROEDIGER&MCDANIEL,MAKEITSTICKat16.Retrievalandself-testinghelpstocalibrateone’slearning.43“Allsortsofideas,iflefttothemselves,aregraduallyforgotten.”HermanEbbinghaus,MEMORY:ACONTRIBUTIONTOEXPERIMENTAL

PSYCHOLOGY(1885)at62.Afteronlyonehour,wehaveforgotten50%ofthematerialwejuststudied;after24hours,wehaveforgotten75%ofthematerial.

Page 8: Smarter Law Study Habits: An Empirical Analysis of Law ... · Learning Strategies and Relationship with Law GPA Jennifer M. Cooper1 and Regan A. R. Gurung2 Table of Contents PART

Page|8 DRAFT7.15.2017

retrievalattempt.44Distributingmultiplestudysessionsspacedovertimeisfarsuperiortomassingofstudyinginanysinglesessionbecauseretrievalpracticespacedovertimestopstheforgettingprocess.45

But,spacingstudyfeelslesseffectiveasstudentshavetoworkhardertoretrieveinformationfromdaysorevenweeksago.46Whenstudentslearnatopicandwaitaweekortwotoreviewthesamematerial,theinformationishardtorecallandstudentsfeelliketheyarerelearningmaterialtheyalreadylearned.47

Likerereading,massingstudycreatesillusionsofcompetencewhenmaterialthatiseasiertorecallisjudgedbetterlearnedthanmaterialthatishardtorecall.48Thisiscounter-intuitivebecausemassingstudyworks,aslongasatestisimmediatelyafterthemassedstudy.But,whatifthetestisgivenaweekormorelater?Spacingstudyrequirestimebetweenstudysessionswhereinformationisforgotten,requiringstudentstoretrieveorrecallthepreviouslystudiedmaterial.49Thelessaccessiblethememory,themorelearningoccurswhenitisrecalledandrestudied.50

Oneofthecriticismsofretrievalisthatitisonlybeneficialformemorizationandotherlower-orderthinkingandlearningtasks.51Successiveretrieval-basedlearningspacedoverperiodsoftimehelpslearnersdevelopcomplexknowledgestructures,connectandintegratenewinformationtopriorknowledgestructures,andbuilddepthandcomplexitywitheachsuccessfulretrievalandconsolidationcycle.52Thisprocessdifferentiatesnovicesfromexpertsinafield.Whenexpertsretrieveinformation,expertsretrieveanentireintegratednetworkofexisting,interconnectedinformationbuiltovermultipleretrievalandconsolidationcyclesspacedoveryears.

iii.OtherhighlyeffectivestudyandlearningbehaviorsMixingup,orinterleaving,differenttopicswhenengaginginretrievalandself-testing

dramaticallyincreasesthestudyingdifficultyandalsothelearningreturns.53Interleavingcreates

44JonathanA.SusserandJenniferMcCabe,Fromthelabtothedormroom:metacognitiveawarenessanduseofspacedstudy,41:2INSTRUCTIONALSCI.345(2013).BROWN,ROEDIGER&MCDANIEL,MAKEITSTICKat203-205.Howmuch“space”orforgettingishelpful?Enoughtimesothatsomeforgettinghasoccurredsothatretrievalwillbemoreeffortful,butnotsomuchspaceorforgettingthatyouhavetorelearnthematerial.Becausetimeperiodsbetweenlearninghelpsmaterialconsolidate,whichincludessleeping,atleastadayinbetweenreviewsessions.BROWN,ROEDIGER&MCDANIEL,MAKEITSTICKat63-64.45Id.46BROWN,ROEDIGER&MCDANIEL,MAKEITSTICKat203-205.47Periodicretrievaloflearnedmaterialalsocreatesadesirabledifficulty.48Id.at47.Studentsmistakenlybelievethatmassingcreatesmorelearningbecauseitcreates“retrievalfluency”-informationiseasiertorecallduringmassedstudysessions,whichisperceivedasbetterlearning.Kornellat1312.Inmassedstudy,studentspaylessattentiontothesecondpresentationofanitem,butpaymoreattentiontothesecondpresentationofaniteminspacedstudy.Inmassedstudy,thematerialisfamiliarthesecondtimeitispresentedandstudentsareoftenmoreaccuratethesecondtime,requiringlesseffortthesecondtimethematerialispresented.49Id.Thespacingeffectandthetestingeffectaresimilarandinterrelatedstudymethodsasspacedstudyinevitablyrequiresretrievalandself-testinginordertorecallpreviouslystudiedinformation.50Id.51HenryRoedigerIII,AdamL.Putnam,andMeganA.Smith,TenBenefitsofTestingandTheirApplicationstoEducationalPractice,55PSYCHOL.OFLEARNINGANDMOTIVATION1,14(2011).Repeatedtestingspacedovertimeledtoimprovedtransferofcomplexmaterialtonewquestionsinanewdomaincomparedtorestudyingmaterial.52JeffreyD.KarpickeandWilliamR.Aue,TheTestingEffectisAliveandWellwithComplexMaterials,27EDUC.PSYCHOL.REV.317(2015).53HenryL.RoedigerIII&AndrewC.Butler,TheCriticalRoleofRetrievalPracticeinLong-TermRetention,15TRENDSINCOG.SCI.20(2011).Mixingupyourretrievalpracticebyinterleavingtwoormoresubjectsisalsoatypeofspacingthathelpsstudentstodiscriminatebetweendifferenttypesofproblemsandselectthecorrectstrategytoapply.BROWN,ROEDIGER&MCDANIEL,MAKEITSTICKat65.SeealsoM.S.Birnbaum,NateKornell,ElizabethL.Bjork,andRobertA.Bjork,Whyinterleavingenhancesinductivelearning:Therolesofdiscriminationandretrieval,41MEMORY392-402(2013).BROWN,ROEDIGER&MCDANIEL,MAKEITSTICKat46-66.Interleavingmeans“mixingrelatedbutdistinctmaterialduringstudy.”Themixingofmaterial,skills,andconceptsduringstudy,

Page 9: Smarter Law Study Habits: An Empirical Analysis of Law ... · Learning Strategies and Relationship with Law GPA Jennifer M. Cooper1 and Regan A. R. Gurung2 Table of Contents PART

Page|9 DRAFT7.15.2017

spacebetweenretrievalattemptsbecauseyouaremixingupthesubjectsandforceslearnerstodistinguishbetweensubjects,creatingdeeperunderstandingwithmaterial.54Again,thisfindingiscounter-intuitivetotheconventionalmethodofblockedpractice-concentrationonthesametopicorskillduringasinglestudyorpracticesession.Learnersalsoresistinterleavingbecauseitismuchmoredifficultandfeelscounter-productive,eventhoughresearchprovesitsefficacy.

Elaborationisalsoaneffectivelearningstrategythatusesretrievaltorelatenewlylearnedinformationtoexistingknowledgebyself-explanation,puttingtheinformationinto“yourownwords,”orexplainingstepsusedduringproblemsolving.55Elaborationrequiresretrievingnewlylearnedmaterialandpriorknowledgeandhelpslearnersdevelopmasterybyfindingadditionallayersofmeaninginnewlylearnedmaterial.56Differentwaystoincorporateelaborationasalearningstrategyaretorelatenewmaterialtowhatyoualreadyknowaboutasubject,summarizeorparaphrasebyputtinginformationinyourownwords,orpersonalizetheinformationbyrelatingittoyourownlife.

Reflectionisacombinationofretrievalandelaborationwherealearnerreflectsorreviewsoninformation,apastevent,oraskill,andasksthemselvesaseriesofquestionstoevaluatewhatwentwellandwhatdidnot.57Manylearnersattributereflectiontodevelopingmasteryofmaterial,developingmentalmodelsandchecklists,developingautomaticity,andaidingintransfer.

Whilethesestudyandlearningstrategiesarehighlyeffectiveforundergraduatestudy,aretheyaseffectiveandcorrelatedwithacademicsuccessforlawstudy?

B:Lawstudentstudy&learningstrategyresearch

Verylittleempirical,datadrivenlegalscholarshiphasanalyzedwhichlawstudentlearningandstudybehaviorsleadtoacademicsuccessinlawschool.58Theearliestempiricalresearchonlawstudentstudybehaviorswaspublishedin1968inTheStudent,TheSituation,andespeciallyoverthelongterm,helpsnotonlytoseedistinctions,butalsohelpstograspindividualconcepts.CAREY,HOWWELEARNat163-164.Interleavingorvaryingpracticeisalsoharder,requiresmoreeffort,andfeelsslower;therefore,unpopularandseldomused.54Id.55MAKEITSTICKat207;JohnDunlosky,KatherineA.Rawson,ElizabethJ.Marsh,MitchellJ.Nathan,andDanielT.Willingham,ImprovingStudents’LearningwithEffectiveLearningTechniques:PromisingDirectionsfromCognitiveandEducationalPsychology,14PSYCHOL.SCI.PUB.INTEREST4,11(2013).56A.S.Donker,H.deBoer,D.Kostons,C.C.DignathvanEwijk,M.P.C.vanderWerf,Effectivenessoflearningstrategyinstructiononacademicperformance:Ameta-analysis,11EducationalResearchReview1,3(2014).Elaborationisacognitivelearningstrategythatbuildconnectionsbetweennotyetlearnedmaterialandpriorknowledge,attachingmeaningtonewinformationbyconnectingtheittowhatisalreadyknown,allowinglearnersstoremoreinformationinlong-termmemory.Summarizingandparaphrasingarecommonelaborativelearningstrategies.Self-explanationisamorecomplexelaborativestrategywherealearnerwillexplaintothemselvestheirthoughtprocessorstepstoworkthroughaproblem.Aneffectiveelaborativestrategyforstudyistosummarizematerialandattempttoreducethenumberofwordsbyonequarter.57MAKEITSTICKat209-210.58DonaldJ.Kochan,“Learning”ResearchandLegalEducation:ABriefOverviewandSelectedBibliographicalSurvey,40SW.L.REV.449(2011).SeegenerallyKennethH.BarryandPatriciaC.Connelly,ResearchonLawStudents:AnAnnotatedBibliography,1978AM.BARFOUND.RES.J.751(1978).In1975,Loftmancommentedthat“verylittleliteraturehasbeendiscovereddirectlyconcernedwithstudyhabiteffectivenessalthoughconsiderableworkhasbeendonewithstudyhabitsasonefactorinpredictingacademicsuccess.”GuyR.Loftman,StudyHabitsandTheirEffectivenessinLegalEducation,27J.LEGALEDUC.418(1975).Thereareveryfewstudiesoflawstudentstudybehaviorsand2ofthe3studiesareover30yearsold:MichaelJ.Patton,TheStudent,TheSituation,andPerformanceDuringtheFirstYearofLawSchool,21J.LEGALEDUC.10(1968);GuyR.Loftman,StudyHabitsandTheirEffectivenessinLegalEducation,27J.LEGALEDUC.418(1975);KarolSchmidt,LearningfromtheLearners:WhatHighPerformingLawStudentsTeachUsAboutAcademicSupportProgramming,4PHOENIXL.REV.287(2010).SeealsoEdwardL.Kimball,LarryC.Farmer,andD.GladeMonson,Ability,Effort,andPerformanceAmongFirst-YearLawStudentsatBrighamYoungUniversity,1981AM.BARFOUND.RES.J.671(1981)(doesnotaddressspecificstudybehaviors,insteadfocusesonoverallstudyeffort).

Page 10: Smarter Law Study Habits: An Empirical Analysis of Law ... · Learning Strategies and Relationship with Law GPA Jennifer M. Cooper1 and Regan A. R. Gurung2 Table of Contents PART

Page|10 DRAFT7.15.2017

PerformanceDuringtheFirstYearofLawSchool,findingthathighperformingstudentshadmoreeffectivereadingtechniques,testedtheirunderstandingofthematerialby“notetaking,outlining,groupdiscussionandperiodicreviewing”andpreparedmoreeffectivelyforexamsbyspacingreviewsandtestingcomprehensionofthematerialratherthanjustmemorizing.59

In1975,GuyLoftman’sStudyHabitsandtheirEffectivenessinLegalEducationnotedthe“surprisinglackofanalysisontheeffectivenessonstudytechniquesinlegaleducation.”60Loftmanfoundthatclassattendanceandreviewwerethemosteffectivestudytechniques,thatreadingandbriefingcases,totalstudyhours,anduseofhornbookstohavelessofanimpact,andthatrelianceonlawsummarieshadanegativeimpact.61

In2010,KarolSchmidt’sLearningfromtheLearners:WhatHigh-PerformingLawStudentsTeachUsAboutAcademicSupportProgrammingfoundthathigh-performingstudentsengagedinamultiplestepprocesswhenoutliningthatincluded“distillingorcondensingoutlines”andconsistentlyengagedinself-testingintheoutliningprocess,whereasunderperformingstudentsdidnotoutlineordidnotfurtherdistilltheiroutlines.62

Thesefindingsaregenerallyconsistentwiththeundergraduateliterature.Effectivereadingstrategies,periodicreview,self-testing,andtimemanagementaremorecommonamonghighperformingstudents.Conversely,over-relianceonpassivestrategieslikecasereadingandbriefing,cramming,andmemorizationwithoutreviewandself-testingaremorecommonamonglowandunderperformingstudents.

Lawschoolshavelongassumedthatstudentscometolawschoolprimedandreadytoreadanddissectcopiousamountsofprimarysourcematerialbyreadingandbriefingjudicialopinions,engageinrigorousSocraticdebate,andabletoputallofthepiecestogetherforthemselves.63Lawschoolshavehistoricallyout-sourcedlawlearningskillstolawschoolsuccessself-helpresourcesusingthenon-empirical,anecdotalapproach:“Ididwellinlawschool,soyoushoulddowhatIdid.”64Eventhelimitedempiricalresearchfrom1968and1975onlawstudent

59MichaelJ.Patton,TheStudent,TheSituation,andPerformanceDuringtheFirstYearofLawSchool,21J.LEGALEDUC.10(1968).Evenin1968,Pattonfoundthatmanyfirstyearlawstudentsenteredlawschoolrelyingonpassivememorizationtechniqueslearnedincollegethatwereinappropriateforthestudyoflaw.60GuyR.Loftman,StudyHabitsandTheirEffectivenessinLegalEducation,27J.LEGALEDUC.418(1975)(citingtoPatton’sarticleastheonlystudyhefoundonthesubject).61Id.at445.Loftmandevelopedaquestionnaireconsistingoffifteenquestionsonthestudents’pre-lawperformance,lawschoolperformance,andstudytechniques.62KarolSchmidt,LearningfromtheLearners:WhatHighPerformingLawStudentsTeachUsAboutAcademicSupportProgramming,4PHOENIXL.REV.287(2010).SchmidtusedtheLearningandStudySkillsInventory(“LASSI”)andtheMultipleIntelligencesDevelopmentalAssessmentScales(“MIDAS”),supplementedbyfollow-upinterviewswithparticipantsaboutoutliningandexamtaking.TheMIDASisa119questionsonactivities,skills,andinterestsonasix-partLeikertscale.TheLASSIwasdevelopedasanundergraduatesurveyinstrument;itsquestionsarenottailoredtothelawschoollearningenvironment.Schmidtfoundpositivecorrelationsbetweenselectingmainideas,timemanagement,andteststrategieswithfirstyearlawGPA.63PeterF.Lake,WhenFearKnocks:TheMythsandRealitiesofLawSchool,29STETSONL.REV.1015(2000)(describingmythsbeginninglawstudentshaveaboutlawschoolandwhatstudentsneedtoknowsuchas“TheReverseCassandraComplex”-wherefirstyearlawstudentsbelievethateveryoneofferinginformationaboutlawschoolknowsthetruthaboutlawschool,butinmostcases,istheoppositeandcomesfromavarietyofdifferentsources–studyaidsandassistancematerials,outlines,wisdomofupperclassmen).64FirstinClass:TheUltimateGuideonHowtoExcelinLawSchoolillustratesthisnon-empirical,anecdotallawschoolsuccessadvice.A“CollectionofEssaysfromTopLawStudentsfromAcrosstheNation,”FirstinClasspromises“cuttingedgetacticsinaninternetagewithprovenstrategiesforsuccess.”CliffP.RileyandSergioPorres,FIRSTINCLASS:THEULTIMATEGUIDEONHOWTOEXCELINLAWSCHOOL(2015).Thisisjustoneofmanynon-empiricallawschoolsuccessresourcesbasedon“triedandtrue”advice,notdata.Seee.g.,AndrewJ.McClurg,1LOFARIDE:AWELL-TRAVELEDPROFESSOR'SROADMAPTOSUCCESSINTHEFIRSTYEAROFLAWSCHOOL(3ded.2017);BarryFriedmanandJohnC.P.Goldberg,OPENBOOK,SUCCEEDINGONEXAMSFROMTHEFIRSTDAYOFLAWSCHOOL(2011);DennisJ.Tonsing,1000DAYSTOTHEBAR:BUTTHEPRACTICEOFLAWBEGINSNOW!(2ded.2010);AlbertJ.MooreandDavidA.Binder,DEMYSTIFYINGTHEFIRSTYEAROFLAWSCHOOL:AGUIDETOTHE1LEXPERIENCE(2010);PeterT.Wendell,DECONSTRUCTINGLEGALANALYSIS(2009);JustinSpizman,THEINSIDER’SGUIDETOYOURFIRSTYEAROFLAWSCHOOL;IanGallacher,COMINGTOLAWSCHOOL(2010);JeremyHorwitz,LAWSCHOOLINSIDER;KimmAlayneWalton&LazarEmanuel,STRATEGIESANDTACTICSFORTHEFIRST-YEARLAWSTUDENT86-87(2004).

Page 11: Smarter Law Study Habits: An Empirical Analysis of Law ... · Learning Strategies and Relationship with Law GPA Jennifer M. Cooper1 and Regan A. R. Gurung2 Table of Contents PART

Page|11 DRAFT7.15.2017

studyhabitsfoundthatreadingandbriefingcaseswasinsufficientandthatstudentsneededto“testtheircomprehension”withpracticeinsteadofrelyingonjustmemorizationandreview.65Legaleducatorsandscholarshaveonlyrecentlystartedtoapplycognitivescienceandeducationalpsychologyresearchtoacademicsuccessandbarprep.66

But,howdowereallyknowwhatworksifthelegalacademyhasnotsuccessfullyexaminedwhichlawlearningbehaviorstrulyrelatetoacademicsuccessinlawschool?Thepolitical,social,andeconomicclimatehaschangeddramaticallyinthepasttenyearsregardingthepresumedvalueofalawdegree.67Manycriticsarguethatlawschoolisnotworththeinvestmentanddemandthelegalacademyjustifytheeffectivenessofteachingandlearningmethodsandoutcomes.68

Byassumingstudentscometolawschoolwithwelldevelopedstudyandlearninghabits,whichweknowfromundergraduateresearchtobeaflawedassumption,thenrelyingonbarpassagetoassessultimatelearningsuccess,lawschoolsareignoringanuglytruth:lawschoolsdonotknowwhichlearningandstudybehaviorsactuallyworkinlawschoolbecausetheyhavenotcloselystudiedacorefunctionoflegaleducation–studentslearningthelaw.69

PartIII:MethodologyoftheLawStudentStudyHabitsSurvey

65Whilethereareveryfewempiricallybasedcomprehensivestudiesonlawstudentlearningbehaviorcorrelatedtoacademicsuccess,otherlegalscholarshaveresearchedotherdiscreteskillsimportanttolawlearning.Seee.g.AnneM.Enquist,UnlockingtheSecretsofHighlySuccessfulLegalWritingStudents,82ST.JOHN’SL.REV.609(2008);LeahM.Christensen,TheParadoxofLegalExpertise:AStudyofExpertsandNovicesReadingtheLaw,2008B.Y.U.EDUC.&L.J.53,70(2008);RuthAnnMcKinney,READINGLIKEALAWYER:TIME-SAVINGSTRATEGIESFORREADINGLAWLIKEANEXPERT(2ded.2012);LaurelCurrieOates,LevelingthePlayingField:HelpingStudentsSucceedbyHelpingThemLearntoReadAsExpertLawyers,80ST.JOHN'SL.REV.227,251-52(2006);StefanH.Krieger,TheDevelopmentofLegalReasoningSkillsinLawStudents:AnEmpiricalStudy,56J.LEGALEDUC.332(2006);AndreaA.Curcio,GregoryToddJones,TanyaM.Washington,DoesPracticeMakePerfect?AnEmpiricalExaminationoftheImpactofPracticeEssaysonEssayExamPerformance,35FLA.ST.U.L.REV.271(2008);MichaelHunterSchwartz,EXPERTLEARNINGFORLAWSTUDENTS61(2005)(emphasizingself-regulatedlearning).66SeegenerallyDonaldJ.Kochan,“Learning”ResearchandLegalEducation:ABriefOverviewandSelectedBibliographicalSurvey,40SW.L.REV.449(2011)(specificallyinthesectionson“ThinkingLikeaLawyer”andtheLawSchoolEnvironment,Experience,andSuccessliterature);JenniferM.Cooper,SmarterLawLearning:UsingCognitiveSciencetoMaximizeLawLearning,44CAP.U.L.REV.551(2016);GabrielH.Teninbaum,SpacedRepetition:AMethodforLearningMoreLawinLessTime,SuffolkUniversityJournalofHighTechnologyLaw,forthcoming(2017)(usingcognitivesciencetoassiststudentsinpassingthebarexam);ElizabethM.Bloom,CreatingDesirableDifficulties:StrategiesforReshapingTeachingandLearningintheLawSchoolClassroom,95U.DetroitMercyL.Rev.(forthcoming),availableathttps://papers.ssrn.com/sol3/papers.cfm?abstract_id=2951961.67DavidSegal,For2ndYear,aSharpDropinLawSchoolEntranceTests,NewYorkTimes,March19,2012,http://www.nytimes.com/2012/03/20/business/for-lsat-sharp-drop-in-popularity-for-second-year.html;DavidSegal,WhatTheyDon’tTeachLawStudents:Lawyering,November19,2011,http://www.nytimes.com/2011/11/20/business/after-law-school-associates-learn-to-be-lawyers.html?pagewanted=all(criticizingthenatureoflawschoolthatrewardsscholarshipandnoteffectiveteaching,creatingnorealincentiveforlawprofessorstobeconcernedaboutteaching,arguingthatstudentsdonotrealizethattheyarepayingforthecostoflegalscholarship,notlegaleducation)68KyleP.McEnteeandPatrickJ.Lynch,AWayForward:TransparencyatAmericanLawSchools,forthcomingPaceLawReview,http://papers.ssrn.com/sol3/papers.cfm?abstract_id=1528862;Blog–LawSchoolTransparency-http://www.lawschooltransparency.com/.Establishedin2009,LawSchoolTransparency,anonprofitlegaleducationpolicyorganization,setouttoimproveconsumerinformationconcerningthevalueoflegaleducationandtousherinconsumer-orientedreformstothecurrentlawschoolmodel.69StevenI.Friedland,HowWeTeach:ASurveyofTeachingTechniquesInAmericanLawSchools,20SEATTLEU.L.REV.1(1996)(discussinggeneralassumptionthateducationoccursinthelawschoolclassroomandthelackofcriticalrevieworresearchontheeffectivenessofthemethodology).

Page 12: Smarter Law Study Habits: An Empirical Analysis of Law ... · Learning Strategies and Relationship with Law GPA Jennifer M. Cooper1 and Regan A. R. Gurung2 Table of Contents PART

Page|12 DRAFT7.15.2017

Empiricallytestedstudyhabitsurveysexist,butaredesignedfortheundergraduatelearningmodel.Significantdifferencesinthelawschoolpedagogy,environment,andassessmentmethodsrequireaspecializedsurveyinstrument.70

First,thelawschoolinstructionmethoddifferssubstantiallyfromundergraduateschool,namelyinstructionthroughtheCaseMethod71andtheSocraticMethodratherthanalectureformat,72andthelackofrightanswers.Second,thelawlearningenvironmentismorecompetitivethanundergraduateprograms:thelargenumberofgraduatestudents(averageof75persectionwithmultiplesectionsperclass)comparedtoothergraduateprogramswithmuchsmallerclasses,73withmandatorycurvesinfirstyearcourses,competitionforgradesandrank,theimportanceoffirstsemestergrades,74andincreasedstressandanxiety.75Third,lawschoolassessmentislessfrequentthaninundergraduateprograms:single,end-of-termwrittenessayexamtoassigngrades,few,ifany,midtermexams,writtenassignments,orevaluationofstudents’skillsindoctrinalcourses,76themandatorygradecurveandrankingofstudents.77Fourth,thedemandsonlawstudents’timearemuchgreaterthaninundergraduateschoolbecauseoftheincreasedworkload78andtheneedtobeaself-regulatedlearnertoteachone’sselfthelaw.79

A.ResearchQuestions&Hypotheses

ThisprojectbeganwhileIwasworkingwithfirstyearlawstudentswhowerestrugglingacademically.Iwasincreasinglyfrustratedanddisappointedbythelackofcredibleresearchoneffectivelawstudentstudybehaviors.Mystudentshadfollowedthe“triedandtrue”advicefromlawschoolsuccessbooksandadvicefromlegaleducators,butwerefacingimminentriskofacademicdismissalbecauseofpooracademicperformanceinthefirstyearoflawschool.Thesestudentsweredesperateandconfused.Theyneededtoknow-whatreallyworks?WhatshouldIbedoingtostudyformyclassesandprepareforexams?WhatshouldIbedoingtoimprovemygradessoIcanstayinlawschool?Ididnothaveanyevidence-basedanswersforthem.

70RutaK.Stropus,MendIt,BendIt,andExtendIt:TheFateofTraditionalLawSchoolMethodologyinthe21stCentury,27LOY.U.CHI.L.J.449(1996).Undergraduatestudentslearnpassivelygenerallythroughalectureformatwhereaslawschoolrequiresactivelearning.JamesJayBrown,ForgingAnAnalyticalMind:TheLawSchoolClassroomExperience,29STET.L.REV.1135,1136(1999).71GrantH.Morris,TeachingwithEmotion:EnrichingtheEducationsExperienceofFirst-YearLawStudents,47SANDIEGOL.REV.465(2010)(citingMichaelPatton’sarticle,thecasemethod,learningtothinklikealawyerandtheuseofthecasemethodinthefirstyearsignificantlycontributingtostudentanxiety–becausestudentshaveneverexperiencedanythinglikethis,nothowtheylearnedinundergraduate,unpreparedfortypeoflearningdemandedimmediatelyinlawschool).72JamesJayBrown,ForginganAnalyticalMind:TheLawSchoolClassroomExperience,29STETSONL.REV.1135(2000)(describinginitialfirstyearstudentreactionstotheSocraticmethodclassroom,comparedwiththe“predominantformofundergraduateeducation.”);RutaK.Stropus,MendIt,BendIt,andExtendIt:TheFateofTraditionalLawSchoolMethodologyinthe21stCentury,27LOY.U.CHI.L.J.449(1996)(deepanalysisoftheLangdellianmethodologyitselfandstrengthsandweaknessesofthemethodology,also“theneedtoteachtheseskillsismoreacutebecauseofthemodernundergraduateexperience.”ChristopherC.Langdell,TeachingLawasaScience,21AM.L.REV.123,123(1887)(“[L]awisascience,and...alltheavailablematerialsofthatsciencearecontainedinprintedbooks.”).73GrantH.Morris,TeachingwithEmotion:EnrichingtheEducationsExperienceofFirst-YearLawStudents,47SANDIEGOL.REV.465(2010);RutaK.Stropus,MendIt,BendIt,andExtendIt:TheFateofTraditionalLawSchoolMethodologyinthe21stCentury,27LOY.U.CHI.L.J.449(1996).74CarolynJ.Nygren,StartingOffRightinLawSchool,29STET.L.REV.1121(2000).75B.A.Glesner,FearandLoathingintheLawSchools,23CONNL.REV.627(1990-1991).76DouglasA.Henderson,UncivilProcedure:RankingLawStudentsAmongTheirPeers,27U.MICH.J.L.REFORM339,403(1993-1994)77Id.78B.A.Glesner,FearandLoathingintheLawSchools,23CONNL.REV.627,655(1990-1991).79CorinneCooper,LettertoaYoungLawStudent,25TULSAL.J.275(2000)(Theundergraduatelearningenvironment,wherestudentslearnpassively,doesnotpreparestudentsforlawschool.Lawisaself-teachingdiscipline.)

Page 13: Smarter Law Study Habits: An Empirical Analysis of Law ... · Learning Strategies and Relationship with Law GPA Jennifer M. Cooper1 and Regan A. R. Gurung2 Table of Contents PART

Page|13 DRAFT7.15.2017

B. DevelopmentoftheLawStudentStudyHabitsSurvey

Myinitialresearchquestionwaswhichlawstudentstudyandlearningbehaviorsarepositivelyandnegativelycorrelatedwithacademicsuccessinlawschool.Oneofmyearlyhypotheseswasthatrelyingtooheavilyonreadingandbriefingcasesandnotleavingtimeforreview,somethingIperceivedasatrendinlawstudentbehaviorbasedonfeedbackfromstudents,wouldbenegativelycorrelatedwithfirstyearlawGPA.Ialsohypothesizedthattheeffectivestudybehaviorsfromundergraduateresearch-retrieval,self-testing,andperiodicreview-wouldbepositivelycorrelatedwithfirstyearlawGPA.

Becauseaspecializedlawstudentstudyhabitssurveydidnotexist,Idevelopedonemyself.80IwasfortunatetopartnerwithDr.ReganA.R.Gurung,chairofthePsychologyDepartmentatUniversityofWisconsin-GreenBay,anexpertinteachingandlearning,whograntedmepermissionmodifyhisundergraduateStudyBehaviorsChecklist81surveyforthelawlearningenvironment.TheStudyBehaviorsChecklistwasselectedforadaptationasithadbeenempiricallytestedandaddressedasimilarresearchquestion–“[w]hatstudybehaviorsareassociatedwithhighergradesonexams?”82Theresearchersintendedtobuildonpreviousresearch,but“provideamorefine-tunedviewofwhatstudentsdotostudybyassessingdifferentbehaviorsinashorterformatthanexistingscales.”83

TheChecklistincludedmanyquestionsdirectlyapplicabletothelawschoolenvironment.84However,notalloftheStudyBehaviors’Checklistquestionswereappropriateforthelawschoollearningenvironment;therefore,itwasnecessarytomodifytheStudyBehaviorsChecklistquestionstothelawschoollearningenvironment.IconductedopeninterviewsoffirstyearlawstudentsusingaStudyHabitsQuestionnaire,85whichledeachstudentthroughtheentirecycleofstudyinginanacademictermandincludedbothclosed-endedandopen-endedquestions.86

80Anideallawschoolsurveyinstrumentwouldbeinexpensiveandeasytoadminister,quicklycompleted,empiricallyvalid,andcapableofbeingusedimmediatelybylearnersandfacilitators.GaryJ.Conti,DevelopmentofaUser-Friendlyinstrumentforidentifyingthelearningstrategypreferencesofadults,25TEACHERANDTEACHEREDUCATION887,889(2009).Ultimately,Ilearnedthatcreatingempiricallyvalidsurveysandresearchinstrumentsisatimeconsumingandexpensiveendeavor.Amoretimeandcosteffectivemethodofcreatinganempiricallyvalidresearchinstrumenttailoredtothelawschoolsettingwastofindasurveywithasimilarresearchquestionandadaptthequestionstotheappropriateenvironment,withthesurveyauthor’spermission.81Gurunget.al.,Focusingonhowstudentsstudy,10JOURNALOFTHESCHOLARSHIPOFTEACHINGANDLEARNING28(2010).AftergivingtheStudyBehaviorsChecklistto120studentsinanintroductorypsychologyclass,Gurung,Weidert,andJeskefoundsupportfortheirhypothesisthatmetacognitivestrategies,suchasself-testing,correlatedpositivelywithacademicsuccess.82Id.TheStudyBehaviorsChecklistisa35-itemsurveydesignedtoassessundergraduatestudents’useofdifferentstudytechniquesandcorrelatewithstudents’coursegrades.Specifically,theChecklistassessesfivetypesofbehaviors:organizational,application,elaboration,metacognitive,andresourceuseonaLikertscalefrom1(Notatalllikeme)to5(Exactlylikeme).83Id.84Forexample:“Afterclass,Ilookedovermynotestocheckforandfillinmissinginformation,”“IcreatedandansweredquestionsaboutthematerialwhileIwasreadinginmynotes,”“Iusedpracticeexamstostudy,”“Ireadthedifficultmaterialslowly,”and“IrelatedwhatIwasreadingtolecturematerialsanddiscussion.”85MoststudentswereAtRiskstudentswhowererequiredtomeetwithme,butmanystudentscameontheirownseekingassistance.86Studyschedules,classpreparation,descriptionofcasereadingprocess,descriptionofcasebriefingprocess,descriptionofnote-takingprocess,descriptionofpost-classreview,useofstudygroups,developmentanduseofcourseoutlines,useofacademicresources,descriptionofexampreparationprocess,useofpastexamstostudyandpractice,descriptionsofsupplementsandstudyaiduse,andaself-assessmentoftheefficacyofthestudent’sstudyhabits.Usingthestudentresponses,IrefinedthequestionsandcreatedanonlineQuestionnaireforstudentstocompleteontheirown.Anonlineversionwouldsaveappointmenttimeandallowmetotargeteachstudent’sweakareasandstudentsmightbemorehonestcompletingthesurveyontheirown.Igathered103completedQuestionnaires.TheStudyHabitsQuestionnairewasnotIRBapproved,hasnotbeenformallyanalyzedfordata,butwasusedtodeveloppatternsandquestionsfortheLawStudentStudyHabitsSurvey.

Page 14: Smarter Law Study Habits: An Empirical Analysis of Law ... · Learning Strategies and Relationship with Law GPA Jennifer M. Cooper1 and Regan A. R. Gurung2 Table of Contents PART

Page|14 DRAFT7.15.2017

UsinginformationfromtheStudyBehaviorsQuestionnaire,wemodifiedDr.Gurung’sStudyBehaviorsChecklistquestionsandcreatedan87-questionpilotLawStudentStudyHabitsSurveytopre-testtheitemsintheresearchinstrument-thequestionsthemselves.87Afterpre-testingthepilotLawStudentStudyHabitsSurvey,werefinedtheSurveytoa37-questionfinalversioncoveringthefollowingtopics:timemanagement,classpreparation(readingandbriefingcases),classattendanceandnote-taking,outlining,review,exampreparation,andtesttaking.

Table1:LawStudentStudyHabitsSurveyQuestions88TimeManagement:

IspreadoutmystudyingsoIdon’thavetocramforexams.IstudythesamewaythatIdidincollege.Ispendmostofmytimepreparingforclassanddonothavetimetoreview.

Classpreparation(Reading&BriefingCases):Ireadalltheassignedcasesinthecasebook.Iattendeveryclass.Ireadeachcasefrombeginningtoend.Idonotunderstandthecasesevenafterreadingthemmorethanonce.IrereadpartsofthecasestomakesureIunderstand.Ireadthe“Notes&Questions”followingthecases.Ihaveahardtimeputtingthematerialintomyownwords.Whenreading,Igetlostinthedetailsandhaveahardtimeunderstandingthemainidea.

IhighlightimportantinformationasIread.Iwritemyowncasebriefs.Ilookatcommercialbriefstohelpmeunderstandthecases.Iusecommercialbriefsinsteadofbriefingthecasesmyself.

Note-taking&In-Class:IwriteortypeonlytheimportantthingstheProfessorsaysinclass.Ireviewmynotesafterclass.Idonotunderstandtheclassdiscussions.Iamafraidofbeingcalledoninclass.

Review: Iwaittoolongtostartreviewing. Iusepracticequestionsandhypostohelpmelearnnewmaterial. IgeneratemyownexampleswhenIreview. Iamabletoexplainconfusingconceptstoclassmates. Ireviewwithastudygroup.Outliningcoursematerial:

Imakemyownoutlineusingmynotes,briefs,etc.Ihaveahardtimecondensingmyoutlinebecauseitallseemsimportant.IuseanoutlinethatIreceivedfromanotherstudent.Istartmyoutlinerightbeforemidtermsorfinals.Idon’tknowhowtomakeanoutline.Myoutlineistoolong.

Self-testing:IunderstandthematerialbetterafterIworkthroughpracticequestionsIusepracticequestionstostudy.

ExamPreparation&Test-Taking:Imemorizealloftherulestoprepareforexams.

87ThePilotLawStudentStudyHabitsSurveywasanonlinesurveybasedona5-pointLikertscalewith87closed-endedquestions.WeadministeredthepilotSurveyonlineusingQualtricsinthe2013-2014academicyear.Wecollected143completedSurveys,representingawiderangeofGPA’s.88Studentswereinstructedtochooseonedescriptionofhoweachskillappliedtothem:Never,Rarely,Sometimes,Often,orAlways.

Page 15: Smarter Law Study Habits: An Empirical Analysis of Law ... · Learning Strategies and Relationship with Law GPA Jennifer M. Cooper1 and Regan A. R. Gurung2 Table of Contents PART

Page|15 DRAFT7.15.2017

IneedtofinishmyoutlinebeforeIcanmemorizetherules. Igetveryanxiouswhiletakingtests. Idon'tknowhowtoorganizemyessayanswers.ResourceUse&OutsideAssistance:

IfIdon’tunderstandthematerial,Iasksomeoneforhelp.ImetwithmyProfessor.

C.AdministrationoftheLawStudentStudyHabitsSurvey

TheLawStudentStudyHabitsSurveywasadministeredtofirstyearlawstudentsfollowingthecompletionoftheirfirstsemesteroflawschoolattwodifferentABAaccreditedlawschools.89Allfirstyearlawstudentsatthetwolawschoolswereinvitedtoparticipate.Participationwasvoluntaryandwassolicitedviaemailcontainingalinktotheonlinesurvey.Lawstudentscompletedthe37-questionLawStudentStudyHabitsSurveyonlineinapproximately5-10minutes.

Table2:CharacteristicsofLawStudentsTakingSurveyDataset Responses LSAT UGPA LGPA

SU 83Range:144-164 Range:2.39-4.03 Range:2.00-3.92Median:154 Median:3.36 Median:3.23

TJSL 135Range:139-162 Range:2.19-3.99 Range:1.00-4.15Median:147 Median:2.88 Median:1.98

First,usingtheStatisticalPackagefortheSocialSciences(SPSS),IconductedaPearson

correlationbetweenalloftheindividualresponsesontheLawStudentStudyHabitsSurveywithlawGPAforeachdataset.IhaveincludedtheresultsofthattestbelowinTable3.

Table3:PearsonCorrelationwithFirstYearLawGPA(LGPA)

LawStudentStudyHabitsSurveyQuestions

SUResults TJSLResultsPearsonCorr.toLGPA

Sig.(2-tailed)

PearsonCorr.toLGPA

Sig.(2-tailed)

IspreadoutmystudyingsoIdon’thavetocramforexams. -.108 .332 .214* .012IstudythesamewaythatIdidincollege -.117 .294 -.277** .001Ispendmostofmytimepreparingforclassanddonothavetimetoreview

.102 .360 -.247** .004

Ireadalltheassignedcasesinthecasebook .047 .674 .182* .033Ireadeachcasefrombeginningtoend -.081 .470 .152 .078Idonotunderstandthecasesevenafterreadingthemmorethanonce

-.217* .049 -.170* .048

Ireadthe“NotesandQuestions”followingthecases .090 .420 .146 .090

89TheLawStudentStudyHabitsSurveywasadministeredtofirstyearlawstudentsatThomasJeffersonSchoolofLawandSeattleUniversitySchoolofLaw.InstitutionalReviewBoard(IRB)approvalwasobtainedthroughtheUniversityofWisconsin-GreenBay,ThomasJeffersonSchoolofLaw,andSeattleUniversity.Demographicinformation(gender,race,etc.)wasnotrequestednoranalyzed.Thepurposeofthisstudyistoanalyzebroadtrendsacross1L’slookingforcorrelationtoasingleobjectiveacademiccriteria-LGPA.Thesamplesdifferbasedonincomingstudentcriteria-TJSLstudentshadamedianLSATof147comparedtoSU’smedianLSATof154.Further,TJSLstudentshadamedianUGPAof2.88comparedtoSU’smedianUGPAof3.36.ThisindicatesthattheTJSLstudentscameintolawschoolwithlowerlevelsofacademicabilityingeneral.

Page 16: Smarter Law Study Habits: An Empirical Analysis of Law ... · Learning Strategies and Relationship with Law GPA Jennifer M. Cooper1 and Regan A. R. Gurung2 Table of Contents PART

Page|16 DRAFT7.15.2017

Ihaveahardtimeputtingthematerialintomyownwords -.130 .243 -.151 .081Whenreading,Igetlostinthedetailsandhaveahardtimeunderstandingthemainidea

-.169 .126 -.271** .001

IhighlightimportantmaterialasIread -.066 .555 -.188* .029Iwritemyowncasebriefs .015 .892 .070 .419Ilookatcommercialbriefstohelpmeunderstandthecases -.165 .137 -.196* .023Iusecommercialbriefsinsteadofbriefingthecasesmyself -.089 .424 -.188* .028IwriteortypeonlytheimportantthingstheProfessorsaysinclass .063 .570 .221* .010Ireviewmynotesafterclass -.147 .184 .020 .814Idonotunderstandtheclassdiscussions -.157 .156 -.183* .033Iamafraidofbeingcalledoninclass -.134 .228 -.146 .093Iunderstandthematerialduringclass,butIgetconfusedwhenIreviewmynotesafterclass

-.119 .285 -.160 .064

Iwaittoolongtostartreviewing .037 .743 -.239** .005Iusepracticequestionsandhypostohelpmelearnnewmaterial .139 .212 .055 .527IgeneratemyownexampleswhenIreview .105 .346 .011 .898Iamabletoexplainconfusingconceptstoclassmates .363** .001 .322** .000Ireviewwithastudygroup .109 .325 .068 .432Imakemyownoutlineusingmynotes,briefs,etc. .110 .321 .287** .001Ihaveahardtimecondensingmyoutlinebecauseitallseemsimportant

-.140 .208 -.276** .001

IuseanoutlinethatIreceivedfromanotherstudent -.019 .863 -.243** .005Istartmyoutlinerightbeforemidtermsorfinals .008 .940 -.174* .045Idon’tknowhowtomakeanoutline -.067 .545 -.228** .008Myoutlineistoolong -.258* .019 -.290** .001IunderstandthematerialbetterafterIworkthroughpracticequestions

.141 .202 .153 .077

Iusepracticequestionstostudy .301** .006 .275** .001Imemorizealloftherulestoprepareforexams .209 .061 .223** .009IneedtofinishmyoutlinebeforeIcanmemorizetherules .074 .505 .124 .149Igetveryanxiouswhiletakingtests -.300** .006 -.175* .042Idon’tknowhowtoorganizemyessayanswers -.294** .007 -.230** .007IhavetroublewritingtherulesonanexambecauseIdidn’tpracticewritingthemout

-.402** .000 -.268** .002

IfIdon’tunderstandthematerial,Iasksomeoneforhelp -.004 .969 .170* .049ImetwithmyProfessor .093 .403 .177* .039*.Correlationissignificantatthe0.05level(2-tailed)**.Correlationissignificantatthe0.01level(2-tailed)

PartIV:ResultsoftheLawStudentStudyHabitsSurveyMymainresearchquestionwaswhichlawstudentstudyandlearningbehaviorsarepositivelyandnegativelycorrelatedwithlawGPA.

Page 17: Smarter Law Study Habits: An Empirical Analysis of Law ... · Learning Strategies and Relationship with Law GPA Jennifer M. Cooper1 and Regan A. R. Gurung2 Table of Contents PART

Page|17 DRAFT7.15.2017

A.PositiveCorrelationwithLawGPA

ThefollowinglawstudyandlearningbehaviorswerepositivelycorrelatedwithlawschoolGPA(LGPA)inbothdatasets:90theabilitytoexplainconfusingconceptstoclassmates,andusingpracticequestionstostudy.

ThereisastatisticallysignificantpositiverelationshipbetweenLGPAandtheabilitytoexplainconcepts.TheabilitytoexplainconfusingconceptstoclassmatesispositivelycorrelatedwithLGPAinbothdatasets:SU,r(83)=.36,p=.001;TJSL,r(135)=.32,p=.000.

Table4:Boxplotsofresponsesto“Iamabletoexplainconfusingconceptstoclassmates”

ThereisastatisticallysignificantrelationshipbetweenLGPAandastudent’suseofpracticequestionstostudy.UsingpracticequestionstostudyispositivelycorrelatedwithLGPAinbothdatasets:SU,r(83)=.30,p=.006;TJSL,r(135)=.27,p=.001.

Table5:Boxplotofresponsesfor“Iusepracticequestionstostudy.”

90Inthefollowingcharts,theY-axisrepresentsthefirstyearlawGPA(LGPA)andtheX-axisrepresentsthestudent’sresponseonthe5-pointLikertscale.

Page 18: Smarter Law Study Habits: An Empirical Analysis of Law ... · Learning Strategies and Relationship with Law GPA Jennifer M. Cooper1 and Regan A. R. Gurung2 Table of Contents PART

Page|18 DRAFT7.15.2017

B.NegativeCorrelationwithLawGPA

ThefollowinglawstudyandlearningbehaviorswerenegativelycorrelatedwithlawschoolGPAinbothdatasets:theinabilitytoorganizeessayanswers,difficultywritingrulesonexamsbecauseoflackofpractice,weakcriticalreadingskills,andweaksynthesisskills.

TherewasastatisticallysignificantnegativerelationshipbetweenLGPAandthedifficultyorganizingessayanswersinbothdatasets.Idon’tknowhowtoorganizemyessayanswersisnegativelycorrelatedwithlawGPAinbothdatasets:SU,r(83)=-.29,p=.007;TJSL,r(135)=-.23,p=.007.

Table6:Responsesfor“Idon’tknowhowtoorganizemyessayanswers.”

Therewasalsoastatisticallysignificantnegativerelationshipwithdifficultywritingrulesonexamsduetolackofpracticewritingtheminbothdatasets.IhavetroublewritingtherulesonexamsbecauseIdidn’tpracticewritingthemoutisnegativelycorrelatedwithlawGPAinbothdatasets:SU,r(83)=-.40,p=.000;TJSL,r(135)=-.27,p=.002.

Table7:Responsesfor“IhavetroublewritingtherulesonexamsbecauseIdidn’tpractice.”

Page 19: Smarter Law Study Habits: An Empirical Analysis of Law ... · Learning Strategies and Relationship with Law GPA Jennifer M. Cooper1 and Regan A. R. Gurung2 Table of Contents PART

Page|19 DRAFT7.15.2017

TherewasalsoastatisticallysignificantnegativerelationshipbetweenLGPAandweakcriticalreadingskillsseenineachdataset,althoughdemonstratedbydifferentprompts.Notunderstandingthecases-eitherfailingtounderstanddespitemultiplereadings91ornotunderstandingthemainpoint92-wasnegativelycorrelatedwithlawGPA.Table8:ResponsesshowingnegativecorrelationbetweenLGPAandweakcriticalreadingskills. TherewasalsoastatisticallysignificantnegativerelationshipbetweenLGPAandweaksynthesisskillsseenineachdataset,althoughdemonstratedbydifferentprompts.Weaksynthesisskillswhenastudent’scourseoutlineistoolong93orthestudentisunabletocondensethecoursematerialbecauseheorshemaybeunabletodistinguishrelevantfromirrelevantinformationwasalsonegativelycorrelatedwithlawGPA.

Table9:ResponsesshowingnegativecorrelationbetweenLGPAandweaksynthesisskills.

C.DiscussionofResults

ThemainresearchquestionoftheLawStudentStudyHabitsSurveywaswhichlawstudentstudyandlearningbehaviorswerepositivelyandnegativelycorrelatedwithfirstyearlaw

91Idonotunderstandthecasesevenafterreadingthemmorethanonce.SU,r(83)=-.22,p=.049.92Whenreading,Igetlostinthedetailsandhaveahardtimeunderstandingthemainpoint.TJSL,r(135)=-.22,p=.001.93Myoutlineistoolong.SU,r(83)=-.26,p=.019;TJSL,r(135)=-.29,p=.001.Ihaveahardtimecondensingmyoutlinebecauseitallseemsimportant.TJSL,r(135)=-.28,p=.001.

Page 20: Smarter Law Study Habits: An Empirical Analysis of Law ... · Learning Strategies and Relationship with Law GPA Jennifer M. Cooper1 and Regan A. R. Gurung2 Table of Contents PART

Page|20 DRAFT7.15.2017

GPA.Inotherwords,whichlawstudentstudyandlearningbehaviorsdemonstratedastatisticallysignificantrelationshipwithacademicsuccessinlawschool.

Mytwokeyhypotheseswerethat:(1)retrieval,self-testing,andperiodicreviewwouldbepositivelycorrelatedwithLGPA,and(2)relyingsolelyonreadingandbriefingcaseswithoutrevieworself-testingwouldbenegativelycorrelatedwithLGPA.Bothhypothesesweresupportedbythesurveyresults,althoughnostatisticallysignificantrelationshipwasdemonstratedbetweenLGPAandperiodicreviewbytheseresults.

Retrievalandself-testingskillswerepositivelycorrelatedwithlawGPA,demonstratingastatisticallysignificantpositiverelationshipwithacademicsuccessinlawschool.Thisfindingissupportedbybothdatasetsexplicitly(“Iusepracticequestionstostudy”)andimplicitlybysurveyresponsesdemonstratingnegativecorrelationoflackofretrievalandself-testingwithfirstyearlawGPA(“IhavetroublewritingtherulesonexamsbecauseIdidn’tpractice”and“Idon’tknowhowtoorganizemyessayexams.”).AsshowninTables5,6,and7above,studentswithhigherLGPAweremorelikelytorespondthattheyalwaysoroftenusedretrievalandpracticetestingtolearnorstudymaterialsandrespondthattheyneverorrarelyhadtroublewritingrulesonexamsordifficultyorganizingessayexams.

BothdatasetsalsodemonstratethatelaborationishighlypositivelycorrelatedwithfirstyearlawGPAexplicitlybysurveyresponses(“Iamabletoexplainconfusingconceptstoclassmates”).Table4showsthatstudentswithhigherLGPAweremorelikelytobeabletoexplainconfusingconceptstoclassmates.Theabilitytoexplainconfusingconceptstoclassmatesillustratesseveraldifferentcognitiveprocessesandeffectivelearningstrategies.Thestudentexplainingtheconfusingconceptmustengageinretrievaltorecallrelevantinformationfrommemoryandelaboratetheinformationinaclearandmeaningfulway.Elaborationistheprocessofputtinginformationintoyourownwordsandconnectingnewinformationtopriorknowledge.Elaboration“improvesyourmasteryofnewmaterialandmultipliesthementalcuesavailabletoyouforlaterrecallandapplication.”94

WhilethispositivecorrelationwithLGPAandelaborationwasnotpartofmyoriginalhypothesis,itislogicalandencouraging.Lawschoolfinalexamsaretypicallyclosed-bookessayexamsthatpresentstudentswithhypotheticalproblemsbasedonmateriallearnedduringthesemester.95Studentsareexpectedtoapplyruleslearnedinthecoursetonewfactualsituations,tospotthelegalissuesraisedbythefacts,andtoexplainhowthelawappliestothefacts.96Tobesuccessfulinthistask,studentsmustnotonlyhavereadandunderstoodthecases,butmusthavedistilledthelegalprinciplesfromthecasesintoacoherentstructureoflegalrules,connectingnewrulestopreviouslylearnedcoursematerial,andmustbeadeptatapplyingthisnewknowledgestructuretonewfactualsituationsinordertoexcelonfinalexams. However,amoretroublingfindingforlawstudentsandlegaleducatorsisthenegativestatisticallysignificantrelationshipbetweenLGPAandrelyingonreading,rereading,andbriefingcaseswithoutretrievalorpracticeapplicationofthelaw.Relyingsolelyonreadingandbriefingcaseswithoutengaginginretrievalandself-testingisnegativelycorrelatedwithlawGPAandacademicsuccessinlawschoolandleadstoalawschoollearningtrap.Becausereadingandbriefingcasesistimeconsuminganddifficult,studentsoftenreportedthattheyonlyhadtimeto

94MAKEITSTICK,at207.95Friedland,at164.SeealsoPhilipC.Kissam,TheIdeologyoftheCaseMethod/FinalExaminationLawSchool,70U.CIN.L.REV.137(2001).96Friedlandat164-165.

Page 21: Smarter Law Study Habits: An Empirical Analysis of Law ... · Learning Strategies and Relationship with Law GPA Jennifer M. Cooper1 and Regan A. R. Gurung2 Table of Contents PART

Page|21 DRAFT7.15.2017

readandbriefcasestokeepupforclass.97Readingandbriefingcasescreatesafalsesenseoffluencywiththematerial,wherestudentsmistakeclasspreparationforstudyingforthecourse.Thislawschoollearningtraptricksstudentsintobelievingthatreadingandbriefingcasestoprepareforclasswithoutengaginginself-testingorretrievalissufficientforlearninginlawschool.98

Relyingonreadingandbriefingcaseswithoutretrievalorself-testingisnegativelycorrelatedwithfirstyearlawGPAandisexplicitlysupportedbyseveralresponsesdemonstratingalackofpracticeapplyingthematerial:“IhavetroublewritingtherulesonexamsbecauseIdidn’tpractice”and“Idon’tknowhowtoorganizemyessayanswers.”Thisfindingisalsoimplicitlysupportedbynegativecorrelationtotheprompt,“Iusepracticequestionstostudy,”whichwashighlystatisticallysignificantforhighlawGPAandacademicsuccess.TheresultsalsoshowstatisticallysignificantnegativerelationshipsbetweenLGPAandweakcriticalreadingandsynthesisskills,alsoverytroublingforlawstudentsandlegaleducators.

Withouttestingtheirowncomprehensionbyusingretrieval,self-testing,orelaborativestudystrategies,studentsdevelopillusionsofcompetenceduetofamiliaritywithmaterial.Studentsalsomissopportunitiestorefine,synthesizeandconsolidatetheirknowledgewhentheyactivelyengageinretrievalandself-testing.Whenlawstudentswaituntilrightbeforethefinalexamtopractice,thepracticeitselfwilllikelyfeelhardleadingsstudentstoinsteadengageineasierpassivelearningtaskslikerereadingoutlines,rotememorization,andothermassedstrategiesthatfeeleasier,butcreateillusionsofcompetence.99

PartV:Recommendations

Lawstudentsneedtoknowwhatmaterialtolearn,whatmaterialtheyhavelearned,andwhattheyhavenotyetlearnedweeksormonths,notdaysorhours,beforeanexam.100TheLawStudentStudyHabitsSurveyresultsalignwithfindingsfromcognitivescienceandquestiontheaccuracyofthenon-empirical“triedandtrue”studyadvicefoundinlawschoolsuccessresources.101Lawstudentsneedtospendlesstimerelyingonpassivelearningstrategiesandmoretimeincorporatingactivelearningstrategiesthatyieldformativeself-assessment.

97ThefirstyearlawstudentsthatIworkedwithinAcademicSuccesswereadamantthattheyreadandbriefedeverycase,outlinedthecourse,memorizedtherulesandunderstoodthematerial.But,whenaskediftheyhadtriedtoapplythenewinformationbyworkingthroughpracticequestionsorhypotheticals,theyreportedthattheybarelyhadenoughtimetoreadandbriefcasesforclassanddidnothavetimetopracticeapplyingthematerial.Thesestudentsdidnotunderstandhowcriticalpracticetestingwasforlearning,developingcomprehension,orcalibratingtheirownunderstandingofthematerial.98Thisillusionisoftendispelledwhenstudentsareofferedcoursemidterms,whethergradedorungraded.Midtermsforcestudentstoengageinmorelearningactivitiesthanjustreadingandbriefingcases,butalsooftenrevealslargeunderstandingandknowledgegapsaswellasexamwritingdeficits.99ManyofthelowperformingstudentsthatIworkedwithinAcademicSupportdescribedtheirlawschoolroutineas:readandbriefcasesforclass,gotoclassandtakenotes,immediatelystartreadingandbriefingcasesforthenextclass,startcourseoutlinerightbeforeexams,readandstudyoutline,useflashcardstomemorizerules,manywouldrewritetheiroutlineorevenrewritetheirnotes,andmanywouldreadthroughtheprofessor’spastessayexamsandmentallyissuespot,butnotwriteoutanswers.100Manylawschoolsuccessguidesincorrectlystresstheimportanceofreadingandbriefingcaseswithoutemphasizingtheimportanceoftestingone’scomprehensionandapplyingtheconceptsextractedfromreadingandbriefing.SomeexplicitlytellstudentsnottolookataProfessor’spastexamsuntilbeginningtestpreparationlateinthesemester.Oneevenwarnslawstudentsthat“[e]arlyinthesemester,whenyouhaven’tcoveredmuchofwhatwillappearonanexam,you’llbecomediscouragedifyoureadanexamthatcoverstheentirecourse.Yourbeliefinyourabilitytosucceedonexamsiscrucial…lookingatoldtestsbeforeyouhavetheknowledgetotacklethemcandeflateyourself-confidence,soit’sbetternottodoittooearly.”See,e.g.KimAlayneWalton&LazarEmanuel,STRATEGIES&TACTICSFORTHEFIRSTYEARLAWSTUDENT:MAXIMIZEYOURGRADES(2004)at21.101Lawschoolsuccessresourcesdevotethevastmajorityoftimeonreading,briefing,andoutlining,andintroducepracticeastestpreparationbeforeexams,notasalearningstrategyduringtheterm.

Page 22: Smarter Law Study Habits: An Empirical Analysis of Law ... · Learning Strategies and Relationship with Law GPA Jennifer M. Cooper1 and Regan A. R. Gurung2 Table of Contents PART

Page|22 DRAFT7.15.2017

A. RecommendationsforLegalEducatorsThisresearchprovesthatformativeassessmentthroughpracticeapplicationofthelawis

criticallawstudentlearningandacademicsuccessinlawschool.Ideally,legaleducatorswouldincorporatefrequentformativeassessmentinthelawschoolcurriculumtoassiststudentsinlearningmaterialandgaugingtheirownunderstandingwithfrequentlowstakesquizzing,includingsuggestedhyposandpracticequestionsinthecoursesyllabus,andgradedmidterms.102

Yet,lawfacultymaybedauntedbyprovidingindividualfeedbacktolargesectionsofstudentsortheprospectsofcritiquingandgradingmultipleessayassignmentsperterm.But,lawfacultydonotneedtoprovideindividualcommentsonstudentpapersinordertoprovideeffectivefeedbacktolargesections.InALawSchoolGameChanger:(Trans)formativeFeedback,ElizabethBloomdiscussesseveraloptionsforprovidingeffectivefeedbackandformativeassessmentinlargegroupsectionswithstructuredcooperativelearningexercisesusingrubricsandsampleanswers(bothweakandstrong),self-assessments,andmultiplelow-stakesassessmentsbeginningearlyinthecourse.103

Formativeassessmentdoesnotneedtobeinessayformtobeeffectiveforstudentlearning.Multiplechoiceandshortanswerquestionsareeffectiveforprovidingformativeassessmentanddoublesstudentlearningoverrelyingonreadingandrereading.104Facultycanleverageteachingandresearchassistantsaswellashyposprovidedinteacher’smanualsofassignedcasebooksforwritinghypotheticalessayormultiplechoicequestionsthatcoversingletopics.

Duetothecriticalnatureofformativeassessmentandpracticeapplicationofthelawtostudentlearning,studentswillrequireresourcesoutsideofassignedcasebooks.Whenlawfacultytellstudentsnottouseanythingexcepttheirassignedcasebookormaterials,theylimitstudents’autonomy,self-regulatedlearning,andabilitytogaugelearningandunderstanding.Instead,lawfacultyshouldrecommendresourcesthatcomplementtheassignedmaterialsandmakemorepracticequestionsandresourcesavailable.

B. RecommendationsforLawStudentsLawstudentsalsoneedtoincorporateearlyandfrequentformativeself-assessmentusing

retrievalandself-testingtocalibratetheirunderstanding,formdeeperconnectionstomaterial,synthesizeinformation,developcomplexknowledgestructures,andbetterprepareforexams.

Readingandbriefingcases,goingtoclassandtakingnotes,andoutliningcoursematerial,arenotsufficientforacademicsuccessinlawschool.Relyingsolelyonreadingandbriefingcasesandgoingtoclasswithouttestingone’sknowledgecreatesthesamefluencyandillusionsofcompetenceasrereading.Withouttestingcomprehensionwithpracticequestionsandhypotheticals,lawstudentsarefallingintothesamelearningtrapasresearchersfoundinundergraduatestudents.102CarolSpringerSargentandAndreaA.Curcio,EmpiricalEvidencethatFormativeAssessmentsImproveFinalExams,61J.LEGALEDUC.379(2012)(SpringerSargentandCurciousedformativeassessmentsbothinclassandoutsideofclass,includingshort-essayandshort-answerungradedquizzes,agradedmidterm,andself-reflectiveexercises.Theauthorsfoundtheseformativeassessmentshelpedlawstudentperformanceonacumulativefinalexam).SeealsoElizabethM.Bloom,ALawSchoolGameChanger:(Trans)formativeFeedback,41OHIONORTHERNU.L.REV.227,231(2015)(encouraginglegaleducatorstohelpstudentstakeresponsibilityfortheirownlearningthroughdevelopmentofself-teachingskillsandprovidingconcretesuggestionstolegaleducatorstocreateformativeassessmentstoenablestudentstobecomeself-regulatedlearners).103ElizabethM.Bloom,ALawSchoolGameChanger:(Trans)formativeFeedback,41OHIONORTHERNU.L.REV.227,250-255(2015)104MeganA.SmithandJeffreyD.Karpicke,Retrievalpracticewithshort-answer,multiple-choice,andhybridtests,22MEMORY784(2014).

Page 23: Smarter Law Study Habits: An Empirical Analysis of Law ... · Learning Strategies and Relationship with Law GPA Jennifer M. Cooper1 and Regan A. R. Gurung2 Table of Contents PART

Page|23 DRAFT7.15.2017

Lawstudentsmustincorporateretrievalandself-testingateverylearningsteptodevelopdeepunderstanding,buildcomplexknowledgestructures,andmostimportantly,tounderstandwhattheyknowandwhattheydon’tknow.Usingpracticequestionstostudyandlearndoublesstudents’performanceoverjustrelyingonreadingandrereading.105Multiple-choicepracticequestionsarejustaseffectiveasshort-answerquestions.106Forretrievalandself-testingtobethemostbeneficialforstudentlearning,feedbackmustalsobeavailableintheformofacorrectanswerorananswerwithexplanationafterthestudentworksthroughthepracticequestionherself.107

Smarterlawlearningisusingempiricallyprovenstudystrategiestolearn,likeretrieval,self-testing,andelaboration.Smarterlawlearningrequiresstudentstoreadandbriefcasestoprepareforclassandimmediatelyengageinretrievalandself-testingtogaugetheirunderstandingofthematerial.Smarterlawlearninginvolveselaboration.Forexample,whenreadingandbriefingcasestoprepareforclass,studentsshouldmaketheefforttoputthecasematerialintotheirownlanguagewithoutlookingatthetextortheirnotes,ratherthanrelyingonpassivecopy&pasteintoone’sbrief.Studentsshouldalsousethesameelaborativestrategiestosynthesizemultiplecaserules,synthesizingmultipleindividualcaserulesintoonesynthesizedrule,anddevelopingtheircourseoutlines.

Lawstudentscanuseseveralcommerciallyavailablestudyaidsforpracticequestionstoself-testtheirknowledgeandcomprehensionastheylearneachtopic.Forexample,theExamples&Explanationsseriesprovidesbothnarrativesummariesofsubstantivelaworganizedbytopicandhypotheticalquestionsaccompaniedwithdetailedexplanationsthatallowstudentstotesttheircomprehension.108TheQuestions&Answers(Q&A)seriesdoesnotincludenarrativesummaries,butfeaturesmanymultiple-choiceandshort-answerquestionsarrangedbytopicaswellaspracticeessayquestionswithexplanationsandcorrectanswers.109Othercommercialseriesprovideoutlinesorchecklistsaswellasmultiple-choice,short-answer,andessaypracticequestions.110

Thesecommercialmaterialsdohavelimitsintheireffectiveness.Theymayfailtoidentifythenuanceshighlightedbythedoctrinalprofessororevencontradicttheprofessor’smaterials.Theymayalsofocusmoreonblackletterlawandfailtocoverpolicyandtheorythatmaybeveryimportanttotheparticularprofessor.Thesecommercialresourcesaresupplements,notreplacements,toin-classmaterials,astudent’sownnotes,andmaterialsprovidedbytheprofessor.Lawstudentsmayfindamoreeffectivesolutionistoblendcommercialmaterialswiththeirprofessor’sassignmentsandmaterialstomaketheirownhypotheticalsthatmoreeffectivelymirrorwhattheyarelearningintheclassroom.

Lawstudentsshouldalsoseekouttheirprofessors’pastexamsearlyintheterm.Theremaybesomelimitationsonusingprofessors’pastexamstostudy.First,theprofessor’spastexammaynotcovereverytopicthestudenthaslearned.Second,theprofessormaynotprovidearubric,gradingcriteria,or“model”answer.Theprofessormayonlyprovideasamplestudent

105MeganA.SmithandJeffreyD.Karpicke,Retrievalpracticewithshort-answer,multiple-choice,andhybridtests,22MEMORY784(2014).106Id.107Id.108TheExamples&ExplanationsseriesispublishedbyWoltersKluwerandfeaturestitlesforeveryfirstyearlawsubject,i.e.,Contracts,CivilProcedure,Torts,Property,CriminalLaw,ConstitutionalLaw,etc.109TheQuestions&Answers(Q&A)seriesispublishedbyLexisNexisandcoversallofthefirstyearsubjects.TheQ&Aseriesdoesnotincludeanarrativesummary,110TheGilbertsandEmmanuelsseriesareblackletterlawoutlinesthatalsocontainsomepracticequestions.TheExamProandAcingseriesarepublishedbyWestAcademicandalsocoverallofthefirstyearsubjects.

Page 24: Smarter Law Study Habits: An Empirical Analysis of Law ... · Learning Strategies and Relationship with Law GPA Jennifer M. Cooper1 and Regan A. R. Gurung2 Table of Contents PART

Page|24 DRAFT7.15.2017

answerthatmaycontainerrorsormaynotprovideanyansweratall.Lawstudentscanstillgetfeedbackwhenusingaprofessor’spastexambyworkingthroughthepastexam(retrievalandself-testing)andaskingtheprofessortoreviewthepracticeinofficehours.Nevertheless,professors’pastexamsareavaluableassettostudentslearningandshouldbeexploitedafterthestudenthascoveredenoughmaterialinthecourse.

Anothersourceofhypotheticalsisthe“Notes&Questions”sectioninmostcasebooksaftercasesortopics.Thesearewrittenbythecasebookauthorstohighlightimportantissuesorinformationinthecasesortopics.SomelawprofessorsgothroughtheNotes&Questionsindetailormayusethemtogeneratequestions.Theseprovideexcellentopportunitiestotestoutyourunderstanding,butstudentswillneedtomeetwiththeirprofessorinofficehourstodiscusstheanswersbecausecorrectanswersandexplanationsarenottypicallyprovidedinthelawstudentversionofthecasebook.

Effectivelearningisdifficultandofteninvolvesmistakesandsetbacks.Thesearepartofthelearningprocessandaresignsofeffort,notfailure.Ifyouaretryingthroughretrievalandself-testingstrategiesandmakemistakes,donotdespair.Eachmistakeisalearningopportunity.Getfeedback,findthecorrectanswer,analyzewhyyoumakethemistakeandcorrectyourmisunderstanding.Stillconfused?Gethelp.Askyourstudypartner,findmoreinformationinatreatiseorstudyaid,asktheT.A.,visityouracademicsuccessdepartment,orvisityourprofessorinofficehours.

C.FutureoftheLawStudentStudyHabitsSurvey

TheLawStudentStudyHabitsSurveyisapreliminarytoolinunderstandingwhichstudyandlearningstrategiesourstudentsactuallyuseandwhichstrategiesarecorrelatedtoacademicsuccessforourstudents.Theresultsabovearebasedononlytwoadministrationsofthesurveyattwolawschools,yieldingasmallsampleofstudentdata.Anextgoalistomakethesurveyavailabletootherlawschoolstoadministertotheirstudents,acrossregionsandtiers.Theultimategoalistocollectdataonlawstudentstudyhabits,tobetterunderstandlawstudentstudyhabits,toidentifystudentsneedingassistance,todevelopmeaningfulinterventions,andtoprovidesound,evidence-basedadvicetolawstudents.

Legaleducatorsneedmorereliabledataoneffectivelawstudentstudyandlearningbehavior,forindividualinstitutionsaswellasacrosstheacademy.ThisisacalltoactiontoanylawschoolinterestedinadministeringtheLawStudentStudyHabitsSurveytoitsstudents.TheLawStudentStudyHabitsSurveyisavailabletointerestedlawschools.Surveyadministrationisonlineandtakesstudents5-10minutestocomplete.LawschoolswouldneedtoprovidetheauthoraletterofinstitutionalsupportandengagementfortheIRBapproval.EachinstitutionwouldberesponsibleforprovidingtherequiredacademicdataforeachstudentsubmittingasurveyresponsethatresearcherswouldthencorrelatewiththeSurveyresponses.111IfinterestedinparticipatingintheLawStudentStudyHabitsSurvey,[email protected].

111Academic&objectivetestscores:LSAT,UGPA,LGPA,coursegrades,etc.