European Social Survey Topline Results EUROPEANS AND … › vod › media › canalu › ... ·...

20
European Social Survey Topline Results EUROPEANS AND DEMOCRACY Rory Fitzgerald (ESS Director) PROGEDO Paris 5 November 2014 Centre for Comparative Social Surveys

Transcript of European Social Survey Topline Results EUROPEANS AND … › vod › media › canalu › ... ·...

Page 1: European Social Survey Topline Results EUROPEANS AND … › vod › media › canalu › ... · Survey Quality Predictor Program (SQP) 5. Consultation with ESS National Coordinators

European Social Survey Topline Results EUROPEANS AND DEMOCRACY

Rory Fitzgerald (ESS Director) PROGEDO

Paris 5 November 2014

Centre for

Comparative

Social Surveys

Page 2: European Social Survey Topline Results EUROPEANS AND … › vod › media › canalu › ... · Survey Quality Predictor Program (SQP) 5. Consultation with ESS National Coordinators

www.europeansocialsurvey.org

Aims of ESS

!   chart stability and change & interpret how Europe’s social, political and moral fabric is changing

!   achieve and spread higher standards of rigour in cross-national research

!   introduce soundly-based indicators of national progress

!   undertake and facilitate the training of European social researchers

!   improve the visibility and outreach of data on social change

Page 3: European Social Survey Topline Results EUROPEANS AND … › vod › media › canalu › ... · Survey Quality Predictor Program (SQP) 5. Consultation with ESS National Coordinators

www.europeansocialsurvey.org

Commitment to the ESS

36 Countries have taken part in at least one round of the survey:

27 EU states (not Malta)

+ 9 others:

Norway, Switzerland, Israel, Turkey, Russia, Ukraine, Iceland, Kosovo, Albania

18 countries ESS ERIC Members and Observers

(4 Guests) Austria Spain Belgium Poland

Czech republic Portugal

Estonia Slovenia

France Sweden Germany Switzerland Ireland UK Lithuania Denmark Netherlands Finland Norway Israel Poland Slovakia

Page 4: European Social Survey Topline Results EUROPEANS AND … › vod › media › canalu › ... · Survey Quality Predictor Program (SQP) 5. Consultation with ESS National Coordinators

www.europeansocialsurvey.org

Scope of the ESS !   Established 2001

!   Biennial hour long face-to-face interviews with nationally representative samples of general (residential) population in 36 countries (to date)

!   Core and rotating modules

!   Rotating modules designed by teams following an open competition

!   Now over 350,000 hour long interviews across over 30 countries

!   Rounds 1-6 complete and archived

!   Round 7 now in the field, Round 8 preparations underway

!   Rigorous scientific methodologies

Page 5: European Social Survey Topline Results EUROPEANS AND … › vod › media › canalu › ... · Survey Quality Predictor Program (SQP) 5. Consultation with ESS National Coordinators

www.europeansocialsurvey.org

Methodology !   Equivalent Probability Samples (15+)

!   International specifications – targets and protocols

!   Fieldwork Questionnaire

!   Rigorous questionnaire design and pre-testing

!   TRAPD & SQP

!   Detailed data specifications and checks

!   Post hoc quality control and reports

!   Round on round improvement

!   Data freely available to all

Page 6: European Social Survey Topline Results EUROPEANS AND … › vod › media › canalu › ... · Survey Quality Predictor Program (SQP) 5. Consultation with ESS National Coordinators

www.europeansocialsurvey.org

Core question topics

!   Trust in institutions !   Political engagement !   Socio-political values !   Moral & social values !   Social exclusion !   Immigration !   Security

!   National, ethnic, religious ID !   Well-being, health !   Demographic composition !   Education and occupation !   Financial circumstances !   Household circumstances

Page 7: European Social Survey Topline Results EUROPEANS AND … › vod › media › canalu › ... · Survey Quality Predictor Program (SQP) 5. Consultation with ESS National Coordinators

www.europeansocialsurvey.org

Rotating modules !   Round 1 •  Immigration*

•  Citizenship, involvement and democracy (CID)

!   Round 2 •  Family, work & well-being*

•  Economic morality in Europe •  Health and care seeking

!  Round 3 •  Personal and social wellbeing*

•  Timing of life

!  Round 4 •  Ageism •  Welfare

!   Round 5 •  Trust in the police & courts •  Work, family & well-being*

!  Round 6 •  Understanding / evaluation of

democracy •  Personal and social

wellbeing*

!  Round 7 •  Health inequalities

•  Immigration*

!  Round 8 •  Climate change & energy

•  Welfare*

Page 8: European Social Survey Topline Results EUROPEANS AND … › vod › media › canalu › ... · Survey Quality Predictor Program (SQP) 5. Consultation with ESS National Coordinators

www.europeansocialsurvey.org

Use of the ESS

• Over 3000 publications • 85% substantive, 15% methodological, Over 71,000 registered data users to date • Majority downloaders • Used by academics, students, businesses, governments, think tanks, citizens, international org (e.g. OECD)

Page 9: European Social Survey Topline Results EUROPEANS AND … › vod › media › canalu › ... · Survey Quality Predictor Program (SQP) 5. Consultation with ESS National Coordinators

www.europeansocialsurvey.org

Page 10: European Social Survey Topline Results EUROPEANS AND … › vod › media › canalu › ... · Survey Quality Predictor Program (SQP) 5. Consultation with ESS National Coordinators

www.europeansocialsurvey.org

Page 11: European Social Survey Topline Results EUROPEANS AND … › vod › media › canalu › ... · Survey Quality Predictor Program (SQP) 5. Consultation with ESS National Coordinators

www.europeansocialsurvey.org

4. Revised proposals from question designers

Stages 1, 2 and 4 repeated

2. Expert review of questions

1. Proposals from question designers

18. Mainstage Fieldwork

3. Use of Survey Quality Predictor Program (SQP)

5. Consultation with ESS National Coordinators

9. Split ballot MTMM experiments developed

10. Large-scale two-nation quantitative pilot & Advance Translation

13. Consultation with ESS National Coordinators

11. Pilot analysis & results of advance translation

15. Translation & Translation Verification

12. Expert review & revised proposals from question designers

14. Final source Questionnaires produced

6. Omnibus Testing & Cognitive Interviewing

7. Omnibus Analysis & CI Analysis

8. Revised proposals from question designers

16. SQP coding

17. Country pre-tests

Question design process

Page 12: European Social Survey Topline Results EUROPEANS AND … › vod › media › canalu › ... · Survey Quality Predictor Program (SQP) 5. Consultation with ESS National Coordinators

www.europeansocialsurvey.org

Key Design Features

!   How important is X for democracy in general !   How much each feature applies in specific country

!   List wise VS pair wise administration

!   Developing theory to actual question items

!   Item non response

!   Differences in meaning / context

!   Need for dichotomous question formats

Page 13: European Social Survey Topline Results EUROPEANS AND … › vod › media › canalu › ... · Survey Quality Predictor Program (SQP) 5. Consultation with ESS National Coordinators

www.europeansocialsurvey.org

Now some questions about democracy. Later on I will ask

you about how democracy is working in [country]. First, however, I want you to think instead about how important you think different things are for democracy in general. There are no right or wrong answers so please just tell me what you think.

Page 14: European Social Survey Topline Results EUROPEANS AND … › vod › media › canalu › ... · Survey Quality Predictor Program (SQP) 5. Consultation with ESS National Coordinators

www.europeansocialsurvey.org

CARD 37 Using this card, please tell me how important you think it is for democracy in general...READ OUT... Not at all

important for democracy in general

Extremely important for

democracy in general

(Don’t know)

E1 ...that national elections are free and fair?

00 01 02 03 04 05 06 07 08 09 10 88

Page 15: European Social Survey Topline Results EUROPEANS AND … › vod › media › canalu › ... · Survey Quality Predictor Program (SQP) 5. Consultation with ESS National Coordinators

www.europeansocialsurvey.org

Now some questions about the same topics, but this time about how you think democracy is working in [country] today. Again, there are no right or wrong answers, so please just tell me what you think. CARD 38 Using this card, please tell me to what extent you think each of the following statements applies in [country]. 0 means you think the statement does not apply at all and 10 means you think it applies completely. READ OUT EACH STATEMENT AND CODE IN THE GRID.

Does not apply at all

Applies completely

(Don’t know)

E17 National elections in

[country] are free and fair.

00 01 02 03 04 05 06 07 08 09 10 88

 

Page 16: European Social Survey Topline Results EUROPEANS AND … › vod › media › canalu › ... · Survey Quality Predictor Program (SQP) 5. Consultation with ESS National Coordinators

www.europeansocialsurvey.org

ESS Round 6 Response Rates

Country Resp. rate* Country Resp. rate* Albania 78.6 Kosovo 67.5 Belgium 58.7 Lithuania 49.6 Bulgaria 74.7 Netherlands 55.1 Cyprus 76.8 Norway 54.9 Czech Republic 68.4 Poland 74.9 Denmark 49.1 Portugal 77.1 Estonia 67.8 Russian Federation 67.0 Finland 67.3 Slovakia 74.1 France 52.1 Slovenia 57.7 Germany 33.8 Spain 70.3 Hungary 64.5 Sweden 52.4 Iceland 54.7 Switzerland 51.7 Ireland 67.9 Ukraine 59.1 Israel 78.1 United Kingdom 53.1 Italy 36.0  

Page 17: European Social Survey Topline Results EUROPEANS AND … › vod › media › canalu › ... · Survey Quality Predictor Program (SQP) 5. Consultation with ESS National Coordinators

www.europeansocialsurvey.org

Contact

[email protected]

www.europeansocialsurvey.org @RoryFitzESS #ESSDemocFR

Page 18: European Social Survey Topline Results EUROPEANS AND … › vod › media › canalu › ... · Survey Quality Predictor Program (SQP) 5. Consultation with ESS National Coordinators

European Social Survey Topline Results EUROPEANS AND DEMOCRACY

Monica Ferrin (ESS Question module Design Team) PROGEDO Paris 5 November 2014

Centre for

Comparative

Social Surveys

Page 19: European Social Survey Topline Results EUROPEANS AND … › vod › media › canalu › ... · Survey Quality Predictor Program (SQP) 5. Consultation with ESS National Coordinators

European Social Survey Topline Results EUROPEANS AND DEMOCRACY

Discussion with speakers

Page 20: European Social Survey Topline Results EUROPEANS AND … › vod › media › canalu › ... · Survey Quality Predictor Program (SQP) 5. Consultation with ESS National Coordinators

www.europeansocialsurvey.org

Discussion

! Rory Fitzgerald, Director of the ESS ERIC

!   Monica Ferrin, member of the Questionnaire Design Team !   Jérôme Fourquet, Director of Opinion et Stratégies

d’Entreprise at Ifop, !   Nicolas Sauger, member of ESS-ERIC Scientific Board