Http:// Use of qualitative software: lessons for instructors from qualitative longitudinal research.

20
http://www.surrey.ac.uk/sociology/research/researchcentr Use of qualitative software: lessons for instructors from qualitative longitudinal research into the acceptance and adoption of technology 6 th NCRM Methods Festival, July 2014 St Catherine’s College, University of Oxford Christina Silver & Christine Rivers CAQDAS Networking Project Department of Sociology, University of Surrey

Transcript of Http:// Use of qualitative software: lessons for instructors from qualitative longitudinal research.

Page 1: Http:// Use of qualitative software: lessons for instructors from qualitative longitudinal research.

http://www.surrey.ac.uk/sociology/research/researchcentres/caqdas/

Use of qualitative software: lessons for instructors from qualitative

longitudinal research into the acceptance and adoption of technology

6th NCRM Methods Festival, July 2014St Catherine’s College, University of Oxford

Christina Silver & Christine RiversCAQDAS Networking Project

Department of Sociology, University of Surrey

Page 2: Http:// Use of qualitative software: lessons for instructors from qualitative longitudinal research.

Overview• Process of developing CAQDAS Postgraduate

Learning Model (CPLM)

• Research design & analytic strategy• Theories of technology acceptance and adoption

• 3 phases of learning• External factors mediating learning and adoption

• Lessons learnt: on-going support for CAQDAS users

Page 3: Http:// Use of qualitative software: lessons for instructors from qualitative longitudinal research.

Starting point

Qualitative Innovations in CAQDAS (QUIC)- Qualitative longitudinal tracking

- Observations- Support sessions

Computer-assisted thematic analysis

Page 4: Http:// Use of qualitative software: lessons for instructors from qualitative longitudinal research.

Training model

Intensive two-day introductory training- Software in the context of qualitative research- Comprehensive product overview- Development of personalised computer-assisted analytic

strategy

- Demonstration- Discussion- Guided learning- Independent experimentation

Training evaluations

Page 5: Http:// Use of qualitative software: lessons for instructors from qualitative longitudinal research.

Main findings• a) training contributes to the consolidation and extension of

learners' prior conceptualisations of the potential of software and positively impacts on their intentions to use software;

• b) post-training enthusiasm is tempered by confusions about and frustrations with software tools encountered during independent software use; and

• c) challenges experienced with using CAQDAS are attributed to lack of software functionality but actually relate to– METHODOLOGICAL AWARENESS– ANALYTIC ADEPTNESS– TECHNOLOGICAL SAVVINESS

Page 6: Http:// Use of qualitative software: lessons for instructors from qualitative longitudinal research.

Analytic need <> technological savviness

Page 7: Http:// Use of qualitative software: lessons for instructors from qualitative longitudinal research.

Methodological awareness <> analytic need

Page 8: Http:// Use of qualitative software: lessons for instructors from qualitative longitudinal research.

Analytic need <>(knowledge of functionality) <> technological savviness

Page 9: Http:// Use of qualitative software: lessons for instructors from qualitative longitudinal research.

the million dollar question

“I’ve done the coding (and created 450 codes)…what do I do next…?”

Page 10: Http:// Use of qualitative software: lessons for instructors from qualitative longitudinal research.
Page 11: Http:// Use of qualitative software: lessons for instructors from qualitative longitudinal research.

Actual use of software• Increased length of use > increased confusion– “Lack of functionality” (incorrectly) blamed

• Tensions– Methodological awareness <>analytic need <>

knowledge about functions

Perceived usefulness tempered by actual use

LiteratureDemand for trainingSoftware development

Page 12: Http:// Use of qualitative software: lessons for instructors from qualitative longitudinal research.

Proliferation of features

…unclear pathways……efficient software use…effective analysis

Ease of useconfusions…inadequacies…criticisms

increased familiarity > decreases confidence> increases frustration

knowledge about functions

Page 13: Http:// Use of qualitative software: lessons for instructors from qualitative longitudinal research.

Confusions……conceptualised in terms of (lack of) software functionality BUT…

…indicative of lack of clarity around analytic need

Coding scheme structuresIdentifying patterns and

relationships

Moving on from coding

Page 14: Http:// Use of qualitative software: lessons for instructors from qualitative longitudinal research.
Page 15: Http:// Use of qualitative software: lessons for instructors from qualitative longitudinal research.
Page 16: Http:// Use of qualitative software: lessons for instructors from qualitative longitudinal research.

Construction of postgraduate learner cohort

>>>Secondary analysis of constructed dataset of cohort of postgraduate

students 26 postgraduate students

5 interviews, 5 support sessions16 complete sets of longitudinal survey data

8 interviews with software trainers

Page 17: Http:// Use of qualitative software: lessons for instructors from qualitative longitudinal research.

TAM and STAM concepts used to develop CPLM

System design featuresPerceived usefulnessPerceived ease of useAttitude towards usingActual system useAdoptionAcceptanceIntention to useFacilitating conditionsExperimentation and explorationConfirmed usefulnessActual useEase of learning

Page 18: Http:// Use of qualitative software: lessons for instructors from qualitative longitudinal research.

CAQDAS Postgraduate Learning Model (CPLM)

Page 19: Http:// Use of qualitative software: lessons for instructors from qualitative longitudinal research.

Implications for learners and instructors

QUESTIONLack of CAQDAS integration into methods training

undergraduate and postgraduate

SOLUTIONS…Curriculum innovation (learning & teaching as a process)Nature of learning (encouragement of creative & independent use rather than ideal use)

Page 20: Http:// Use of qualitative software: lessons for instructors from qualitative longitudinal research.

Thank you• CAQDAS Networking Project

http://www.surrey.ac.uk/sociology/research/researchcentres/caqdas/index.htm • Online QDA http://onlineqda.hud.ac.uk

• Davis, F. (1989) Perceived usefulness, perceived ease of use and user acceptance of information technology, MIS Quarterly,(13, 3), September, 1989, pp. 319-340.

• Silver C & Lewins A (2014) Using Software in Qualitative Research: A Step-by-Step Guide, Sage Publications, London https://study.sagepub.com/using-software-in-qualitative-research

• Silver C & Lewins A “Computer-Assisted Analysis of Qualitative Research”, in Patricia Leavy (ed.) (2014) The Oxford Handbook of Qualitative Research, Oxford University Press. http://global.oup.com/academic/product/the-oxford-handbook-of-qualitative-research-9780199811755

• Renaud, K., & Van Biljon, J. (2008, October). Predicting technology acceptance and adoption by the elderly: a qualitative study. In Proceedings of the 2008 annual research conference of the South African Institute of Computer Scientists and Information Technologists on IT research in developing countries: riding the wave of technology (pp. 210-219).

• Woolf N & Silver C (forthcoming) How to use ATLAS.ti Powerfully, Woolf Publishing, Santa Barbara, US (comparative texts for NVivo and MAXQDA available in 2015)

Twitter : https://twitter.com/Christina_QDAS Qual-software discussion list : http://www.jiscmail.ac.uk/lists/qual-software.html LinkedIn http://www.linkedin.com/pub/christina-silver/24/202/7a1