2015-2016EvaluationPlanforENLACECOMUNITARIODecember2015CharlaHenley,MACandidate,LatinAmericanStudiesMelissaDenetdale,BACandidate,CriminologySoniaBettez,PhD,RWJFCenterforHealthPolicyatUNMNMEVALUATIONLABUniversityofNewMexicoOverviewofEnlaceComunitario

EnlaceComunitarioisdevotedtoservingtheLatinoImmigrantcommunityinAlbuquerque,NewMexico.TheorganizationprovidesinterventionservicesforLatinoimmigrantfamilieswhofindthemselvesinabusiverelationships.Inadditiontotheinterventionservices,theorganization’spreventativeservicesworkwiththeLatinoimmigrantcommunityatlarge(pleaseseetheLogicModelinAppendixAformoreinformation).TheYouthLeadershipProgramaimstopreventdomesticviolence(DV)andintimatepartnerviolence(IPV)intheLatinoimmigrantcommunitybysparkingchangeinsocialandsocietalnormsduringachild’sformativeyears.Latinoboysandgirlsbetweentheagesof11and20yearsoldattendtrainingseminarstolearnaboutwhatitmeanstorelateinhealthyways.Aftertheseseminars,thestudentstaketheirknowledgetothecommunity,holdingeventsattheirschoolsandatcommunitycentersforkidstheiragetolearnaboutIPV.Inessence,theprogramcallsonteenstopromotesocialchangeintheircommunities.ThroughtheYouthLeadersprogramEnlaceseekstopreventDV/IPVinBernalilloCountyLatinoimmigrantcommunities,andenvisionsexpansionofprogramslikethisonanationalscale.

ResearchsuggeststhatLatinoyoutharevulnerabletoDV/IPVforavarietyofreasons.Studiesofdomesticviolence(DV)andintimatepartnerviolence(IPV)inLatinocommunitiesreachdifferentconclusionsabouttheprevalenceandriskfactorsassociatedwithDVandIPV(Gonzalez-Guardaetal.2013,Ocampoetal.2007,andKimberetal.2015).Whilethestudiessuggestthatimmigrantgenerationalstatus(IGS)andagearemostassociatedwithIPV,theyvaryindiscussingtheactualdegreeoftherisk.

Kimberetal.(2015)usesdatafromanationallyrepresentativesurveytohighlightthefindingthat1stgenerationimmigrants1arelesslikelytoexperienceIPV(orreportit)thantheir3rdgenerationcounterparts.Thisfindingcontributestothecallformoreeducationandpreventionprogramsinimmigrantcommunities,especiallywhenconsideringthestudylimitationsoflimitedreportingforfearofconsequenceandpotentiallanguagebarriers.Ocampoetal.(2007)focusesonLatinohighschoolstudentsandsurveysthatshowstudentsaremostlikelytotrustandfeelmostcomfortabletalkingtootherstudentsaboutIPVoccurrences,anddon’tfeelcomfortablesharinginformationwithauthorityfigures.Gonzalez-Guardaetal.(2013)takestheopinionsofLatinocommunitymembersintoconsiderationwithregardstohowcurrentIPVpreventionprogramsoverlookculturalnormsandtraditionsthatleadtoIPVand

1ImmigrantsrepresentedinthesurveyidentifiedasWhite,Black,AmericanIndian/AlaskaNative,Asian/NativeHawaiian/otherPacificIslander,orHispanicandthenidentifiedas1st,2nd,or3rdgenerationimmigrants.

EnlaceComunitarioEvaluationPlan2toleranceofIPV.Thisstudy’sfindingsalsocontributetotheideathatspecialIPVpreventionandeducationprogramsshouldbecreatedforLatinoimmigrantcommunitiessothattheprogramsareculturallyappropriateandspecific.Theliterature,reviewedingreaterdetailinAppendixA,thussupportthepremiseoftheYouthLeadershipprogramatEnlaceComunitario,whichcallsuponLatinoyoungadultstoeducatetheirpeersaboutthedangersofIPVandDVinhopesofmotivatingachangeintheculturalnormsthatmarginalizeLatinos.EnlacehasdevelopedtheYouthLeadershipprogramtopromoteeducationabouthealthyrelating,whatitmeanstobeinanabusiverelationshipandtheimportanceofpreventivesteps.Lastly,theYouthLeadersprogramrespondstothesuggestionsmadebythecommunitymembersasinGonzalez-Guardaetal.(2013)andthestudentsinOcampoetal.(2007).CommunityContextAccordingtotheCenterforDiseaseControl(CDC)2011,morethan12millionpeoplearevictimsofIPVeachyear2.Butnotallpeopleareaffectedequally.Infact,thosemostatriskofexperiencingIPVarewomen,youth(age12-24),andthoseidentifyingasnon-white.

Furthermore,Figure1showsthat,inthe2010NationalIntimatePartnerandSexualViolenceSurvey,YoungAdultsreportedahigherprevalenceofIPVNationwidewhenrespondingtothequestion:Inthepast12months,haveyoubeenphysicallyharmed,onpurpose,byanintimatepartner?Figure1illustratestheanswers.Figure1.PrevalenceofIntimatePartnerViolenceinYoungAdults

*NationalIntimatePartnerandSexualViolenceSurvey,2010TheU.S.prevalenceofIPVandSexualViolenceinawoman’slifetimeis35.6%.NewMexicanwomenexperienceIPVat34%3,whichisclosetothenationalrate.Furthermore,non-whitewomenareevenmorelikelytoexperienceIPVintheirlifetimes.Figure2showstherateatwhichwomenresponded“yes”tohavingbeenphysicallyharmedbyanintimatepartnerinthelasttwelvemonths.2CDCViolencePreventionFactSheet3http://www.cdc.gov/violenceprevention/nisvs/state_tables_74.html

1%

4%

7%

8%

14%

55+

45-54

35-44

25-34

18-24

Age

EnlaceComunitarioEvaluationPlan3Figure2.UnitedStatesRateofDomesticPartnerViolenceasReportedbyWomen

*NationalIntimatePartnerandSexualViolenceSurvey,2010Asdisplayedinthefigureabove,therateatwhichLatinasresponded“yes”ismuchhigherthantheirwhitecounterparts.

DatafromtheNewMexicoYouthRiskandResiliencySurvey,asurveyofthehealthriskbehaviorsandresiliency(protective)factorsofNewMexicohighschoolandmiddleschoolstudents,illustratetheriskfacedbyyoungerLatinogirlsinNewMexico.Figure3showsAmericanIndianandLatinoHighSchoolStudentsinBernalilloCountyreportingthehighestratesofIPVbyresponding“yes”tobeinghit,slapped,orphysicallyhurtonpurposebytheirboyfriendorgirlfriendduringthepast12months.Figure3.RatesofintimatepartnerviolenceamongyouthinBernalilloCounty,NM

*NewMexicoYouthRiskandResiliencySurvey,2011.Whereasonly8%ofwhitegirlsreportedthattheyhadbeenphysicallyharmedbytheirboyfriendorgirlfriendonpurposewithinthepast12monthsthatratejumpsto12.9%whenlookingattheresponsesoftheLatinogirls.Stratifiedbygrade,thepercentagegoesfrom10%intenthgradeto13.1%intwelfthgrade,consistentwiththenationaldatafromtheCDCthatshowsIPVmostprominentamongyoungwomenandrisinguntil24yearsofage.

4%

5%

6%

6%

8%

9%

ForeignBorn

White,Non-Hispanic

All

USBorn

Latino

Black

5%

8%

10%

12%

13%

Unknown

White

Asian/PacificIslander

Hispanic/Lamno

AmericanIndian

EnlaceComunitarioEvaluationPlan4

Withspecialconcernforthemostat-riskgroupsmentionedpreviously,itisimportanttonotethat,accordingtotheCensus,47.7%ofNewMexicansidentifyasLatino,with9.8%reportingtheyareforeignborn.IfwelookatBernalilloCountyinparticular,wecanseetheriskofexperiencingIPVgrowing:49%ofBernalilloCountyresidentsidentifyasLatinoand10.9%reporttheyareforeignborn4.Itshouldcomeasnosurprise,then,thatwearesuggestingthatthiscountymayhavemoreofariskforIPVthanpreviouslyrealized.

Ourresearchshowsthat“one-size-fits-all”IPVpreventionprogramsdonotworkintheLatinoimmigrantcommunities.AssuggestedbythecommunitymembersinGonzalez-Guardaetal.(2013),thistypeofviolencehasbeenconsideredaprivatefamilymatterinsomecultures,whichteachesvictimsto“justdealwith”theviolenceinsteadofremovingthemselvesfromitortryingtoalleviateit.EnlaceComunitarioisdoingsomethingtoaddressalloftheaboveconcerns.

EvaluationHistoryEnlacehasperformedevaluationsoftheirpreventionservicesinthepast.In2011,EnlaceproducedacasestudyoftheirPromotorasprogram.Thisevaluationtookplaceoverthreeyearsandassessedtheimpacttheprogramonthesurvivorsthatbecameleadersintheorganization.Initially,theYouthLeadersprogramwasgoingtobeapartofthatevaluationbutthecasestudyshiftedfocustothePromotorasprogramwhentheorganizationrealizedjusthowmuchinformationhadbeencollectedforbothprograms.BecausethePromotorasprogramhadbeeninplaceforlongerthantheYouthLeadersprogramatthattime,thestafffeltconfidentintheirdecision.However,becausethestaffplannedtorevisittheevaluationoftheYouthLeadersprogram,EnlacecollectedanddigitallystoredinformationintheformofaudiencesatisfactionassessmentsaftereveryYouthLeaderpresentationsince2012.WewereabletopullthatdataintoSTATAsoftwareinordertoanalyzeoverallsatisfactionwiththepresentationsbetweentheyears2012and2015.Figure4intheAppendixBshowshowtheyouthansweredthequestionsabouthavingfun,knowledgeandpreparationofpresenters,andlearningaboutabuse.Theresponsestothesequestionswereoverwhelminglypositive.Furtheranalysisshowedthattheonlydistinguishabledifferenceintheresponsesthroughouttheyearswasthattheaudienceseemedtohavemorefunwatchingthepresentationsafter2012(Figure5).Whileitwashelpfultoknowthattheaudiencewassatisfiedwiththepresentations,Enlaceshouldconsidercollectinginformationthatwouldbemoreinformative,suchas:whattheaudiencelearned,whetherthereisadifferenceinwhatislearnedinrelationtowhoispresenting,whetherornotlearningledtobehaviorchanges,etc.).Therefore,werecommendedthattheaudiencesatisfactionassessmentsoftheYouthLeaderpresentationsberevisedinordertogenerategreaterdetail.

EvaluationPlanOurevaluationseekstoanswerthefollowingquestions:HastherebeenanimpactontheYouthLeadersthemselvesasaresultoftheirparticipationintheprogram?Havetheirrelatingbehaviorschanged?Isthereanyindicationthattherehasbeenanylargerimpactonthecommunity,institutions,orstructuresasaresultoftheprogram?ThroughtheexperiencesoftheYouthLeaders,canweidentifyanypatternsthathaveemergedinthecommunitythatsuggestachangeinculturalnorms?

We(theresearchteam)willconductafocusgroupwiththenineyouthleadersinthisyear’scohorttocollectavarietyofideasfromtheYouthLeaders,tobetterunderstandtheimpactoftheprogram.WewillaskstaffatEnlaceandayouthleaderrepresentativetohelpcreatequestionsforthefocusgrouptoensurerelevancy.Weplantouseaninteractiveformatinthefocusgroupsincethestudentsareaccustomedtoworkingtogetherintheirpresentationsandliketomovearound.Wealsoplanvariedconfigurationsofyouth(individually,indyads,twogroups,allinonegroup)tocreateanenvironmentwhereweheareveryone’svoices.Theyouth

4http://quickfacts.census.gov/qfd/states/35/35001.html

EnlaceComunitarioEvaluationPlan5willanswerthequestionsinwritingeitheronindexcardsoronflipchartpageswewillcollectinordertominimizethetimeneededtotranscribealltheinformation.Thelistofquestions(createdinconjunctionwithEnlaceandreviewedbyYouthLeadersforapproval/revisions)canbefoundinAppendixC.

TheCurrent(Tentative)TimelineThissemester,wefinisheddraftingourevaluationplanandfocusgroupquestions(byDecember3rd).Also,weattendedapublicYouthLeaderpresentationtogainabetterunderstandingofhowtheywork(December14th).TheevaluationteamwillcompleteanIRBasnecessarypriortothestartofthenextsemester.Wewillmeetasawhole(EnlaceplustheYouthLeadersthatarehelpingwithquestioncreationandMelissa,Charla,andSonia)onJanuary22ndat11:00amtomakeanylastminuteadjustmentstoquestionsandsetdatesforthefocusgroups.InFebruary,wewillconductthefocusgroupsandbegintranscribingasnecessaryandanalyzingdatacollected.InMarch,wewillcontinuetoanalyzeifnecessary,butthemainfocuswillbeondraftingfindingsintoareportthatanswerstheevaluationquestionstobecompletedbeforeMarch15th.ByApril15th,wewillhaveafinalreportofourfindingswithsuggestionsforfutureevaluationoftheYouthLeadershipprogram.

FutureEvaluationEnlaceComunitarioisacomplexorganizationthathousesmanymoreprogramsthanjusttheoneweareevaluating.AsidefromcontinuingtheevaluationoftheYouthLeadershipprogrambyconductingsurveysofYouthLeaderalumni,EnlacehasexpressedagreatdealofinterestinevaluatingtheirHealthyRelatingcourse(howitisimpactingstudentsinself-confidenceandlifeoutsidejustrelationships)andinevaluatingtheirinterventionservices,particularlytodetermineiftheservicestheyareprovidingaretraumainformedandculturallyappropriate.Sincetheirbiggestevaluationgoalsareto:1.)Beabletotelltheirstorytofundersand2.)BecomereplicableinotherHispanicandLatinoimmigrantcommunitiesacrossthecountry,therewillalwaysbemoreevaluationthatcanbedoneinthecomingyearstoassessEnlace’seffectivenessinreducingDV/IPVcasesinLatinoimmigrantcommunities.TogaingreaterinsightonEnlace’splansforfutureresearch,pleaseseeAppendixD.

EnlaceComunitarioEvaluationPlan6

AppendixAOverviewofEnlaceComunitarioLogicModel

ThislogicmodelwascreatedduringEnlace’sevaluationoftheirPromotorasprogramin2011.ItshowsEnlace’sultimategoalsofcreatingchangesinsocialnormsthatwillleavetheimmigrantcommunityfreefromDomesticViolenceandthevariouswaystheorganizationseekstoachievethatgoal.Withthetwosides—preventionandintervention—EnlaceseekstoalleviatetheDVandIPVthatisbothhappeningcurrentlyandpreventanyfutureincidencesfromoccurring.YouthLeadersarefoundinthemiddleofthelogicmodelandcontributestothepreventionside.Theprogramhelpsfeedintodevelopingleadersandeducatingcommunityandserviceproviders.ThisevaluationseekstoidentifyanyimpacttheYouthLeadersprogramhashadoninfluencingchangeininstitutionsandsocialnorms.ExtendedLiteratureReviewArecentstudythatconsidereddatafromanationallyrepresentativesurveyfoundthat1stgenerationimmigrants5arelesslikelytoexperienceIPV(orreportit)thantheir3rdgenerationcounterparts.ThoughthestudyisnotspecificonlytoHispanics,Kimberetal.(2015)shows“beinga1stor2ndgenerationimmigrantdidnotinfluencetheoddsofperpetratingorbeingthevictimofIPV,”whichiscontrarytowhatpreviousresearchnotbasedonnationallyrepresentativesamplessuggested(1140).Studylimitationscenteredontheretrospectiveself-reportingandthechanceofunder-reportingduetomemoryorfearsofconsequencesthat5ImmigrantsrepresentedinthesurveyidentifiedasWhite,Black,AmericanIndian/AlaskaNative,Asian/NativeHawaiian/otherPacificIslander,orHispanicandthenidentifiedas1st,2nd,or3rdgenerationimmigrants.

EnlaceComunitarioEvaluationPlan7mayfollowreporting.Theauthorscallforfurtherreviewoftheeffectimmigrantgenerationalstatus(IGS)andacculturationhaveonIPVacrosstheUnitedStates,withemphasisonLatinoimmigrants.Because2ndand3rdgenerationimmigrantsarereportingIPVatahigherratethantheir1stgenerationcounterparts,thereisaneedformoreresearchtobeconductedonLatinoyouthinregardstoIPVtodeterminewhenIPVstartssomoreattentioncanbeplacedonpreventativeservicesandinterventionresourcesforthisgroup.

Onesuchreviewconsidersdatafromninefocusgroups(n=76)heldinMiami-DadeCounty,specificallyfocusedonLatinocommunities.Theresultsshowthecommunityismostconcernedfortheimmigrantpopulationforanumberofreasons(mainlythefearofcomingforwardwithIPVcases)withyouthbeingthesecondhighestriskgroup.ThisdocumentdiscussestheimportanceofrecognizingLatinoculturalnorms(“Ourparentstaughtustotolerateit[abuse]”(229))inanytypeofDVorIPVservices.The“blanketprograms6”thathavebeensetinthecommunitytohelpalleviateDVorIPVhavenotseemedtobeparticularlyeffectivefortheLatinocommunities,whichwasdeemedproblematicbecause“mainstreampreventionprogramsdonotsystematicallytakeintoaccountculturalfactorsthatmaybeassociatedwiththeoccurrence,severityandconsequencesofIPVwithin[theLatinoimmigrantcommunity]”(224).Furthermore,Gonzalez-Guardaetal.(2013)suggestthatcommunitymembersweremostconcernedaboutyouthsince“thisgroupwasattheagewherenormsandbehaviorsforintimaterelationshipsbegindeveloping”(232).Withthisinmind,thestudysuggeststhatanattemptatapreventionprogramshouldbeculturallyappropriateandshouldtargettheHispanicyouthinordertotakeanappropriate“firststepinpreventingIPVamongHispanics”(234).

AnotherstudythatwasconductedthroughsurveydatacollectionfromhighschoolteensfoundthatLatinoyouthare,infact,atgreatriskofexperiencingIPV(Ocampoetal.2007).SurveydatacollectiontookplacetwiceintwoacademicyearsinhighschoolslocatedintheLosAngeles,CaliforniavicinitytoresearchtowhomteenswentforadviceorwhatteenswoulddoregardingIPV.Thestudiesconsistedofhighschoolteenswhereamajority(81-99%)oftheschool’spopulationwasHispanic.Ofthispopulation,1,603studentscompletedthesurvey.Theresultsshowthatgreaterresourcesareneededinpublicinstitutions(e.g.,schools)tofacilitate,provideaid,educate,andeventuallypreventIPVinLatinocommunities.Thestudyconcludesthatthereisstrongneedtoteachskillstoteensaboutwhattheycandotohelpthemselvesandotherswhoareinanabusiverelationship.

6A“blanketprogram”isaprogramsaidtoworkforanyindividual,regardlessofethnicity,age,socialstatus,oreducationalbackground.

EnlaceComunitarioEvaluationPlan8

AppendixBEvaluationHistoryYouthLeaderPresentationEvaluationPresenter’sNameLocationofPresentation/EventNameOnascaleofonetofive(fivebeing“stronglyagree),towhatextent:

1. Didyouhavefun?2. Didthepresenterknowhisorhertopic?3. Wasthepresenterprepared?4. Didyoulearnaboutabuse?

Whatdidyouespeciallylikeaboutthepresentation?Whatdidn’tyoulike?Whatwouldyouchangeaboutthepresentation?Othercomments?ResultsFigure4.AudienceAgreesorStronglyAgreeswiththeStatements:

Figure5.AudienceAgreesorStronglyAgreeswithHavingFunduringthePresentation

Youth Had Fun

Presenters Knew Topic

Presenters Were Prepared

Youth Learned About Abuse

90%

96%

95%

93%

EnlaceComunitarioEvaluationPlan9

84%

95%

91%

94%2015

2014

2013

2012

EnlaceComunitarioEvaluationPlan10

AppendixCEvaluationPlanFocusGroupQuestions

• HowlonghaveyoubeenwiththeYLprogram?• Whatdidyoulearnthatyoudidn’tknowbefore?• HowdidyougettoparticipateintheYLprogram?• Haveyourbehaviorschangedinyourrelationships?How?• Giveusanexampleofhowyoudealtwithconflictbeforevs.afteryourtrainingasaYL.• Withyourtrainingasabackground,howwouldyoureacttoseeingconflict/unhealthybehaviorsina

friend,inyourclassroom,inyourschool,inyourownrelationships?• Ifyouwitnessanepisodeofcontrolling/unhealthybehavioramongpeers,howdoyouintervene?• Isthereanythinginyourenvironment(schools,communities,homes)thatreinforcesgood/healthy

relationships?Unhealthyrelationships?• Giveusanexampleofhowyourschool,community,home,doesnotallowunhealthyrelationshipsto

occur.Orhowtheydoallowunhealthyrelationshipstooccur.

EnlaceComunitarioEvaluationPlan11

AppendixDFutureEvaluationFigure6.

BigGoals Objectives BaselineData Activities ShortTermOutcomes

LongTermOutcomes

EvaluateeffectivenessoftheYLProgram(2015-2016)

• createnarrative• determineifit’s

bettertokeepleadersformanyyearsorgraduatethemafterone

• pre-tests• post-tests• evaluationpage• narratives

• createnarrative(March2016)

• phoneinterviews(asnecessaryin2016-2017)

• interviews(asnecessaryin2016-2017)

• onlinesurvey(asnecessaryin2016-2017)

• focusgroups(February2016)

• createnarrative(March2016)

• Tellstorytofunders(CLASP(federal),Kellogg,State,County)(startingMarch2016,continueasnecessaryin2016-2017)

• Becomereplicable(YL)programinotherLatinocommunities(future)

Becomereplicable(YL)programinotherLatinocommunities(potentialfor2016-2017)

• promotehealthyrelationships

• NationalLatinaNetworkwantstoreplicateEnlace’sYLProgramcomparedtootherYLprogramsinthecountry(MinnesotaorGeorgia)

• healthybreakuppresentations

• analyzewhatworksandwhathasn’t,whatchangeshavebeenmade,etc.

• putintowordswhatworksforEC

• createwebinarfornationalexposure

EvaluateeffectivenessofHealthyRelatingCourse(potentialfor2016-2017)

• promotehealthyrelationships

• pre-tests• post-tests• evaluationpage• narratives

• createtemplateforexcelfile(finishedNovember2015)

• digitalizationofdata(2016)

• developevaluationplan

• telldatastory

• Tellstorytofunders(CLASP(federal),Kellogg,State,County)

• Becomereplicable(YL)programinotherLatinocommunities

EnlaceComunitarioEvaluationPlan12

AppendixEReferencesCensusScopeforHispanicpopulationstatistics.Gonzalez-Guarda,R.M.,A.M.Cummings,M.Becerra,M.C.Fernandez,andI.Mesa.2013.“Needsand PreferencesforthePreventionofIntimatePartnerViolenceAmongHispanics:ACommunity’s Perspective.”TheJournalofPrimaryPrevention,Vol.34,Issue4:221-235.Kimber,Melissa,ChristineA.Henriksen,DanielleM.Davidov,AbbyL.Goldstein,NicoleY.Pitre, LilTonmyr,TracieO.Afif.2015.“TheAssociationBetweenImmigrantGenerationalStatus,Child MaltreatmentHistoryandIntimatePartnerViolence(IPV):EvidencefromaNationallyRepresentative Survey.”SocialPsychiatryandPsychiatricEpidemiology,Vol.50,Issue7:1135-1144.NationalIntimatePartnerandSexualViolenceSurvey—IntimatePartnerViolenceintheU.S.2010(provided byCDC)NMCensusdata2014.NewMexicoPregnancyRiskAssessmentMonitoringSystem(PRAMS)SurveyfromtheNewMexico DepartmentofHealth.RetrievedfromNM-IBISandNM-IBIS.Ocampo,BeverlyWeidmer,GeneA.Shelley,andLisaH.Jaycox.2007.“LatinoTeensTalkaboutHelpSeeking andHelpGivinginRelationtoDatingViolence.”ViolenceAgainstWomen,Vol.13,No.2:172-189.YouthRiskandResiliencySurvey(YRRS).RetrievedfromNM-IBIS.