Formative Evaluation to Foster Civic Participation Prof. Dr. Peter Mambrey.

Formative Evaluation to Foster Civic Participation

Prof. Dr. Peter Mambrey


Background


The look back

1895

12 telephones in theGerman Reichstag

Today

A complex, socio-technical multi/cross-mediacommunication infrastructurewhich is evolving

Communication sphereswith multi-purpose tools, services and applicationswith rules and conventionsusers, stakeholders andenvironments/arenas


Personal experiences: empirical case studies 1980 - 2000

Participatory Systems Design – Democracy in Working Life

Focus on development of socio-technical systems

Case studies of systems design: (design, implementation, and evaluation)

School Information Systems: Including parents, pupils and teachers in design;

Citizen Office of a Municipality: Supporting access of citizens to services;

ICT to assist members of Parliament;

ICT to assist the responsiveness of ministries to citizens.


Personal experiences: components and modules of Groupware 2000 -

„Democratic technology in use“: Groupware und Community Systems which assist democratic features

Democratic design principles:

1. Self-organization2. Awareness3. Visualization4. Transparency and control5. Accountability, Responsiblity6. Knowledge sharing7. Participation8. Open for unprecedented use, evolving, malleable, usability

oriented


Evaluation methods: formative methods – quantitative measuring means documenting the past

Formative methods feed gathered information back into design and use!

Evolving participatory design and use:

Action research in niche projects,

Participatory observation,

Scenarios, probes

Advocacy planning,

Stakeholder interviews,

Expert and user workshops,

Documentation,

Online questionnaires …..

EvolutionaryCycles

Participation

Re-design

Implementation of the 2. version

Participation

Re-design

Impementation of the n. version

Maintenance

Work practice

Implementationof the1. version

Participation

Re-design

Implementation of the 2. version

Participation

Re-design

Impementation of the n. version

Maintenance

Work practice

Implementationof the1. version

Preparation

Initial start

Adoption and Use

Adoptionand

Use

AdoptionandUsePreparation

Initial start

Adoption and Use

Adoptionand

Use

AdoptionandUse


Conclusions

Beneath the hype?

History of socio-technical systems in the public spheres over 100 years old

Currently the hype is created to attract attention and funding - as usual

Internet as a key opener for change fuels evolution but not revolution

Do not look at applications but on design principles and functionalities

Overcoming barriers?

Change creates a new segmentation of power

Existing systems in use cause reluctance

Capacity and costs

What is in it for me!


Conclusions c‘td

Measuring impact: Why? What? How?

Use a combined approach:

- Statistics of use

- Human-Computer Interaction

- Cooperativity Evaluation

- Critical Success Factors

Quantitative measuring in niche projects produces frustrating results

Quantitative measuring neglects the evolving use caused by social learning, technological development and changing environmental demands

Formative evaluation fosters civic participation to develop and use socio-technical tools


Vision: Socio-technical Infrastructures for Public Spheres according to Habermas


Thank you for your attention

Formative Evaluation to Foster Civic Participation Prof. Dr. Peter Mambrey.

Documents

Transcript of Formative Evaluation to Foster Civic Participation Prof. Dr. Peter Mambrey.