HSSi Philippines Social Impact Evaluation Project, August 2016

SOCIAL IMPACT EVALUATIONLissa Glasgo for Hybrid Social Solutions, Inc. (HSSi) | Funded by Yale University’s Jackson Institute for Global Affairs and the Coca-‐‑Cola World Fund| August 6, 2016

summer project sum-‐‑up:

1.  What We Wanted To Do

2.  What We Accomplished

3.  What We Designed

4.  What We Learned

game plan:

WHAT WE WANTED TO DO: OBJECTIVES

1

ü  Design a system so that HSSi can gather and analyze social impact data regularly.

ü  Test it out (and update what we know about HSSi’s social impact in the process).

two objectives:

Spending on energy

WHAT WE ASSESS

Education & health

Feeling of safety

Experience with light

why do we even care about social impact evaluation?

so…

DATAShows our partners how our products help them reach their goals Helps us improve our technical support systems and marketing Gives us “street cred” with funders and other social enterprises Makes us happy by showing us that what we do matters

WHAT WE ACCOMPLISHED: STATUS UPDATE

2

PREPARATION•  Researched what other solar companies evaluate, what HSSi has evaluated in the past

•  Wrote a new version of the survey •  Developed a field research plan for the summer •  Coordinated with branch managers to find interpreters

field work IN CATARMAN, CALBAYOG, AND BALER AREAS

challenges: •  Timing is tough. To get the pre-purchase interviews, we

have to meet customers after they sign up for a light but before they receive it. Getting to them in that timespan is tricky and requires tight coordination with loan officers.

•  Distance can delay. Because many of our customers live in rural areas, it takes time to get between meeting centers, limiting the number of interviews we can do per day.

•  Absences happen (a lot). While the plan was to meet up with pre-purchase respondents after a month for post-purchase surveys, many were not at group meetings when we went back. We found some of them, but not many.

conducted 103 interviews (37 PRE-PURCHASE + 66 POST-PURCHASE ACROSS REGIONS)

also: Additional deliverables included: -  Final surveys in English, Tagalog, Waray -  Google-based data entry system -  Social impact evaluation manual -  Data collector training module -  Partner interviews in Calbayog, Catarman, Baler -  Partner satisfaction interview guide -  Trained data collector (Region 8) -  HSSi Impact Story Form -  PowerPoint-Ready Photo Bank

WHAT WE DESIGNED: SOCIAL IMPACT

EVALUATION SYSTEM

3

Goal: 100 Matched Interviews Per Hub 50 PRE-PURCHASE � 50 FOLLOW-UP POST-PURCHASE � EVERY SIX MONTHS

4. When all hub data has been entered/checked, RC & data analyst crunch numbers.

5. RC updates PowerPoint slide deck and data summary report, submits all to Jim.

1. Research Coordinator (RC) hires and trains a Data Collector (DC) for each hub.

2. DCs conduct 50 post-purchase surveys (follow-ups from last round) + 50 post-purchase surveys.

3. DC enters data into Google Form system + best stories into HSSi Impact Story form.

If potential error: RC checks data & follows up to fix if needed. the

system DATA COLLECTION & ANALYSIS PROCESS

challenges: •  Timing is tough. à Every afternoon, check in with the next

day’s loan officer to develop a list of customers who have recently started paperwork to purchase one of our products.

•  Distance can delay. à Map barangays at the beginning of the research round and plan shortest distances in an area each day. (This one is tough to mitigate.)

•  Absences happen (a lot). à Cell phone numbers will be critical for reminders the day before post-purchase interviews. If a customer does not have a cell phone, ask for a neighbor’s.

addressed.

WHAT WE LEARNED: STORIES AND DATA

4

DESCRIBING THE SAMPLE:who did we talk to?

PRE-PURCHASE POST-PURCHASE

SAMPLE SIZE 37 surveys 66 surveys

GENDER BREAKDOWN Female: 37 Female: 59, Male: 7

ACQUISITION METHOD Loan: 37 Loan: 58, Cash: 8

AVG HOUSEHOLD INCOME 11,241.38 PHP 10,023.46 PHP

% OF HOUSEHOLD INCOME BY RESPONDENT

24% 42% (Women only: 35.11%)

MODEL OWNED SunKing Pro 2: 17 SunKing Home: 19

SunKing Pro 2: 17 SunKing Home: 19 SunKing Mobile: 9 Other: 14 (Niwa + d.light)

LOCATIONS COVERED Northern Samar, Western Samar, Aurora

TOP OCCUPATIONS Sari-‐‑Sari Store, Housewife, Food Vendor, Laundry, Farmer

DESCRIBING THE SAMPLE:who did we talk to?

PRE-PURCHASE POST-PURCHASE

TIME AFTER PURCHASE -‐‑-‐‑ 0-‐‑1 Months: 16 2-‐‑6 Months: 34 6-‐‑12 Months: 10 1+ Years: 2

FREQUENCY OF PAYMENT -‐‑-‐‑ Weekly: 90.9% Every two weeks: 7.3% Monthly: 1.82%

AVG WEEKLY PAYMENT -‐‑-‐‑ 115.11 PHP

SOLAR LIGHT USE -‐‑-‐‑

Majority: 7+ hours/night Light user (0-‐‑3h): 20.0% Medium user (4-‐‑6h): 23.1% Heavy user (7+h): 56.9%

Spending on energy Education &

health

Feeling of safety


energy savings Customers spent an average of 134.44 PHP less per month on kerosene after solar light purchase.

Before the light, we paid for kerosene, charging large batteries, and charging our cell phones. Now, we save all of that money. After we pay for the solar light, we can buy more food. We have so much more and better food now.

“

”

My 5-year-old granddaughter is so amazed by how bright the light is, and it cut our electricity bill in half. It brought me the luck of money -- my pockets were empty, but now I can fill them again. With the money I save, I can buy lipstick!

“

”


health

Feeling of safety


3.23 HOURS

respondents reported an extra

of study per week after purchasing HSSi solar.

(…and 47.6% of post-purchase respondents reported using only solar for children’s study.)

84.6% of respondents reported an improvement in study time for children

When my child was studying at the university, the only thing that helped her study at night is our solar light. Now, she has graduated.

“

”

blackening on walls from kerosene smoke was

15.1% lower after purchase of a solar light

62.7% of respondents reported better in-home air quality since purchasing HSSi solar

I use my solar light when my baby wakes up at night so that we can see him and so that he feels safe. It also helps me breastfeed him at night.

“

”


health

Feeling of safety


Respondents felt 11.75% safer from fuel-related skin burns after purchase of a

solar light (from 59.5% to 71.2% safer).

When a brownout occurs, my children don't panic because it's not hard for them to look for the light -- the button lights up so that it's easy to switch it on. It's also easy to use when my child needs to go to the comfort room at night-- he can now manage without me.

“

”

I don't like to sleep in bright light or in total darkness, so I'm very happy that this light has a dim setting. I keep it on all night, and it's safe when I fall asleep reading the Bible or praying before bed.

“

”


health

Feeling of safety


Every. Single. One. When asked if they would recommend HSSi’s solar light to friends and family, 100% of customers said yes.

We use the solar light for our piggery -- when the pigs give birth, we use the lamp. With kerosene, the lantern was always tipping over. My husband bought a cheap solar light from the market, but it broke. Our HSSi solar light is much better -- we trust the quality more.

“

”

The light is important to me because it charges my cell phone in brownouts. My husband works in Manila, so having a phone for communication is very important to us, and with solar, I can always talk to him.

“

”

Customers listed the most important advantages of HSSi solar lights:

ü  feeling safer in emergencies

ü  brighter light in their households

ü  lower bills from electricity / other energy sources

ü more reliable light

ü  easier to charge cell phone

TOP BENEFITS

Out of 66 interviews, only two respondents could come up with disadvantages to owning HSSi solar: one wished the light were less yellow, and another wished it would turn off automatically.

TOP DRAWBACKS

On average, HSSI’s solar lights increase the time customers have per week for: MORE HOURS IN THE WEEK

ü  work / job (12.5 h) ü  socializing (9.7 h) ü  chores (8.4 h)

ü  religious activity (2.7 h) ü  cooking (3.7 h) ü  study (3.2 h)

Before when we didn't have it, we had to close our store every time there was a brownout. Now, we're always open. Plus, the air in the store is cleaner because there is no more smoke from lanterns.

“

”

When my husband gets coconuts, we use the solar light to process them at night. We’ve been able to improve our income because of extra working hours at night.

“

”

96.2% of respondents reported

more reliable lighting in their homes

We don't have electricity because my neighbor doesn't want to let us connect to their cable, and before that was a big problem for my family. But now with solar, that same neighbor asks why we have light even in brownouts!

“

”

credits Game Plan by Darren Barone from the Noun Project | Architect by Augusto Zamperlini from the Noun Project | Survey by Brennan Novak from the Noun Project | Philippine Peso by Randolph Novino from the Noun Project | Caution by José Hernandez from the Noun Project | Crowd by Magicon from the Noun Project | Books by Jakub Caja from the Noun Project | JasonDavies.com/wordcloud | philippines by Ted Grajeda from the Noun Project | Pen by Chad Wimberly from the Noun Project | Fire by Carla Dias from the Noun Project | Kerosene Lantern Lamp by Sri Kadimisetty from the Noun Project | study by Bonegolem from the Noun Project | design inspiration, as always, from Sophie Savage

timeeven

open

source

use

instead

every

light

solar Now

electricity

nighthousebrow

noutlot

bills

helps

giveschildren

helpstudy

lower

brighterbrownouts

helpful

kerosene

buy

save

workcharge

emergencies

SunKing

cell

phonemoney

helped

bill

store

easy

good

better

lampsw

itch

alternative

reliable

big

lessfamily

motherhome

Niwa income

cook

safeelectric

typhoonneighbor

happy

household

extra

hours

spend

play

child

baby

sleep

Bible

gain

grades

increased

school

pesos

operate

power

lighten

manicures

pedicures

protective

grandmother

beautiful

lowered

sunlightthankful

coconuts

improve

father

CR

dinner

irritating

eyes

sarisari

mobile

affordable

fish

graduated

lent

communication

Storm

emergency

Pro2

husband

recommend

overnight

granddaughter

homew

ork

everynight

nomoreworry

quality

barangay

solution

bring

working

grandchildren

m

travel

emegency

atease

appreciate

daughter

breastfeed

flashlight

bright

itsafe

pray

generator

Everyday

candles

wonderful

lived

aunt

brother

deskwakes

comes

eat

HSSicharging

batteries

phones

dont

yet

HSSi Philippines Social Impact Evaluation Project, August 2016

Technology

Transcript of HSSi Philippines Social Impact Evaluation Project, August 2016