Impact evaluation in the sector of Social Entrepreneurship: Integrating

GIS with inductive methods

1. Introduction to the Knowledge Transfer Partnership (‘KTP’) project

2. Outline current strategies in impact evaluation

3. The KTP method and progress

4. Summary of conclusions

Aim of the session

Knowledge Transfer Partnership: Designing and implementing a longitudinal impact evaluation strategy

Design and implement a strategyto evaluate the kinds of socialimpact being made by UnLtd

Award Winners

The foundation for Social Entrepreneurs

Department of Geomatic Engineering

The landscape of impact evaluation

Evidence-based research

-use of both qualitative and quantitative methods

Markers of success -used to measure impact

Deductive methods -common practice in impact evaluation

Current impact evaluation strategies: the deductive approach

Hypothesis

Observation

Confirmation/rejection of hypothesis

Deductive approach: An approach to developing or confirming a theory that begins with abstract concepts and theoretical relationships and works toward more empirical evidence (Neuman, 2006, pp.59)

1.

2.

3.

The problem…

Hypothesis

-Reliant on what we understand about Social Entrepreneurs

-Reliant on what we understand about impact

Observation-Methods are designed to gather evidence to support of reject hypothesis

Confirmation/rejection of hypothesis

-Knowledge of social entrepreneurs is specific and limited

Mapping Social Entrepreneurs: an example of deductive approaches to evaluation

Source: UnLtd research, 2005

Inductive approach to impact evaluation

Observation

Pattern/Trend

Tentative hypothesis

Theory

Inductive approach: An approach to developing or confirming a theory that begins with concrete empirical evidence and works toward more abstract concepts and theoretical relationships (Neuman, 2006, pp.60)

Qualitative interviews

Questionnaires/ Surveys

Combining GIS and qualitative methods

Qualitative research: To observe and gather information

about social entrepreneurs’ experience of creating

social impact

Geographic Information Systems/Science:

Provides ‘a tool for representing and visualizing environments

beyond the scope of everyday life’ (McLafferty, 2002, pp.265)

A more comprehensive and more critical view of

social impact

Inductivedirection

The project stages

STAGE 1: Review of literature

STAGE 2: Research tool design

STAGE 3: Field work

STAGE 4: Data analysis

STAGE 5:Results

Pilot Study

In depth interviews, focus groups,

online surveys, mappingATLAS.ti, SPSS, GIS

Introducing GIS

Geographical Information Systems and Science

-Computer systems that can capture, store, analyse and manage any data with a spatial reference-Is recognised for its ability to support qualitative research that that seeks to understand the socio-spatial contexts of individual experiences

-can teach us how to enhance social impact

Data analysis and impact mapping

Coding of qualitative

data

Categories of impact

Further testingon broader population

Impact maps

Impact Maps

Source: UnLtd research, 2005

No’ of jobs created through projects

>10080-9960-7940-5920-3910-19

5-90-4

Projects run by those aged 25-30

Pilot study results

Award Winners identify social

impact as:

Changes to attitude

Change to behaviour

Skill provisionRemoving barriersto social inclusion

Improvingcommunitycohesion

Reducing crime

Providing support

“Impact for me is making people sit up and listen… and about creating a difference”

“think that we’ve given a lot of grooms a little boost, a bit of confidence…”

“If you’re making 50,000 pounds or if

you’re on limited income support…you

should have the benefit of being

treated as a client and not as a service user. And that’s the

whole idea behind wanting to run [this

project]”

“…the BGA can make them feel a bit more inclusive, socially inclusive in the area that they’re in”

Summary of conclusions

• Deductive approaches to impact evaluation provide partial knowledge about social impact

• By adopting an inductive approach we can develop a more comprehensive understanding about social impact

• Incorporating GIS with inductive/qualitative methods encourages a more in-depth and critical approach to understanding impact

Laura FryKnowledge Transfer Associate, UCL, UnLtdl.fry@ucl.ac.uk

Mordechai (Muki) HaklaySenior Lecturer, UCLm.haklay@ucl.ac.uk

Lea EsterhuizenHead of Research, UnLtdleaesterhuizen@unltd.org.uk