1 Data Gathering Chapter 7. Overview Five key issues of data gathering Data recording Three main...
-
Upload
rosamund-gilbert -
Category
Documents
-
view
264 -
download
1
Transcript of 1 Data Gathering Chapter 7. Overview Five key issues of data gathering Data recording Three main...
![Page 1: 1 Data Gathering Chapter 7. Overview Five key issues of data gathering Data recording Three main methods for data collection: 1.Interviews 2.Questionnaires.](https://reader035.fdocuments.us/reader035/viewer/2022081417/56649e895503460f94b8e45b/html5/thumbnails/1.jpg)
1
Data Gathering
Chapter 7
![Page 2: 1 Data Gathering Chapter 7. Overview Five key issues of data gathering Data recording Three main methods for data collection: 1.Interviews 2.Questionnaires.](https://reader035.fdocuments.us/reader035/viewer/2022081417/56649e895503460f94b8e45b/html5/thumbnails/2.jpg)
Overview
Five key issues of data gathering
Data recording
Three main methods for data collection:
1. Interviews
2. Questionnaires
3. Observation
Choosing and combining techniques
![Page 3: 1 Data Gathering Chapter 7. Overview Five key issues of data gathering Data recording Three main methods for data collection: 1.Interviews 2.Questionnaires.](https://reader035.fdocuments.us/reader035/viewer/2022081417/56649e895503460f94b8e45b/html5/thumbnails/3.jpg)
Five key issues1. Setting goals
• Decide how to analyze data once collected
2. Identifying participants• Decide who to gather data from
3. Relationship with participants• Clear and professional• Informed consent when appropriate
4. Triangulation• Look at data from more than one perspective
5. Pilot studies• Small trial of main study
![Page 4: 1 Data Gathering Chapter 7. Overview Five key issues of data gathering Data recording Three main methods for data collection: 1.Interviews 2.Questionnaires.](https://reader035.fdocuments.us/reader035/viewer/2022081417/56649e895503460f94b8e45b/html5/thumbnails/4.jpg)
Data recording
• Notes, audio, video, photographs
• Notes plus photographs• Audio plus photographs• Video
![Page 5: 1 Data Gathering Chapter 7. Overview Five key issues of data gathering Data recording Three main methods for data collection: 1.Interviews 2.Questionnaires.](https://reader035.fdocuments.us/reader035/viewer/2022081417/56649e895503460f94b8e45b/html5/thumbnails/5.jpg)
Interviews• Unstructured
- are not directed by a script. Rich but not replicable.
• Structured
- are tightly scripted, often like a questionnaire. Replicable but may lack richness.
• Semi-structured
- guided by a script but interesting issues can be explored in more depth. Can provide a good balance between richness and replicability.
• Focus groups
- 3-10 people led by a trained facilitator. Allows diverse & sensitive issues to be raised. Preset agenda, but flexible. Recorded for analysis.
![Page 6: 1 Data Gathering Chapter 7. Overview Five key issues of data gathering Data recording Three main methods for data collection: 1.Interviews 2.Questionnaires.](https://reader035.fdocuments.us/reader035/viewer/2022081417/56649e895503460f94b8e45b/html5/thumbnails/6.jpg)
Interview questions• Two types:
(a) Closed questions:• have a predetermined answer format, e.g., ‘yes’ or ‘no’• are easier to analyse
(b) Open questions:• do not have a predetermined format
Avoid:
− Long questions− Compound sentences - split them into two− Jargon and language that the interviewee may not
understand − Leading questions that make assumptions e.g., why do you
like …?− Unconscious biases e.g., gender stereotypes
![Page 7: 1 Data Gathering Chapter 7. Overview Five key issues of data gathering Data recording Three main methods for data collection: 1.Interviews 2.Questionnaires.](https://reader035.fdocuments.us/reader035/viewer/2022081417/56649e895503460f94b8e45b/html5/thumbnails/7.jpg)
Planning the interview
• Develop the set of questions
• Check in advance to ensure that recording equipment works
• Know how to use the equipment
• Work out the structure of the interview
• Organise a suitable time & place
![Page 8: 1 Data Gathering Chapter 7. Overview Five key issues of data gathering Data recording Three main methods for data collection: 1.Interviews 2.Questionnaires.](https://reader035.fdocuments.us/reader035/viewer/2022081417/56649e895503460f94b8e45b/html5/thumbnails/8.jpg)
Running the interview
1. Introduction
– introduce yourself, explain the goals of the interview, reassure about the ethical issues, ask to record, present any informed consent form.
2. Warm-up
– make first questions easy and non-threatening.
3. Main body
– present questions in a logical order
4. A cool-off period
– include a few easy questions to defuse tension at the end
5. Closure
– thank interviewee, signal the end, e.g. switch recorder off.
![Page 9: 1 Data Gathering Chapter 7. Overview Five key issues of data gathering Data recording Three main methods for data collection: 1.Interviews 2.Questionnaires.](https://reader035.fdocuments.us/reader035/viewer/2022081417/56649e895503460f94b8e45b/html5/thumbnails/9.jpg)
Face-to-face vs. Telephone
• What are the advantages and disadvantages when comparing interviews conducted:
– In person (face-to-face)
– Via telephone?
• Refer to text book
![Page 10: 1 Data Gathering Chapter 7. Overview Five key issues of data gathering Data recording Three main methods for data collection: 1.Interviews 2.Questionnaires.](https://reader035.fdocuments.us/reader035/viewer/2022081417/56649e895503460f94b8e45b/html5/thumbnails/10.jpg)
Enriching the interview process
• Props - devices for prompting interviewee, e.g., a prototype, scenario
![Page 11: 1 Data Gathering Chapter 7. Overview Five key issues of data gathering Data recording Three main methods for data collection: 1.Interviews 2.Questionnaires.](https://reader035.fdocuments.us/reader035/viewer/2022081417/56649e895503460f94b8e45b/html5/thumbnails/11.jpg)
Questionnaires
• Questions can be closed or open
• Closed questions:
• are easier to analyze, and
• may be done by computer
• Open questions:
• difficult to analyze, and
• need more human intervention
• Questionnaires can be administered to large populations
• Paper, email and the web used for dissemination
• Sampling can be a problem when the size of a population is unknown (as is common online)
![Page 12: 1 Data Gathering Chapter 7. Overview Five key issues of data gathering Data recording Three main methods for data collection: 1.Interviews 2.Questionnaires.](https://reader035.fdocuments.us/reader035/viewer/2022081417/56649e895503460f94b8e45b/html5/thumbnails/12.jpg)
Question and response format• ‘Yes’ and ‘No’ checkboxes
• Checkboxes that offer many options
• Rating scales
– Likert scales1 2 3 4 5
orstrongly agree ok disagree strongly agree
disagree
– Semantic scalesAttractive _ _ _ _ _ _ _ _ _ UglyHelpful _ _ _ _ _ _ _ _ _
Unhelpful
– 3, 5, 7 or more points? See box 7.5 on pp. 315 (2nd edition), box 7.4
on pp.242 (3rd edition)
• Open-ended responses
![Page 13: 1 Data Gathering Chapter 7. Overview Five key issues of data gathering Data recording Three main methods for data collection: 1.Interviews 2.Questionnaires.](https://reader035.fdocuments.us/reader035/viewer/2022081417/56649e895503460f94b8e45b/html5/thumbnails/13.jpg)
Questionnaire design (1)1. Do you need different versions of the questionnaire for
different populations?
2. Do not make the questionnaire too long – people will then not fill it in
3. Appropriate heading – not just ‘Questionnaire’
4. Brief explanation of purpose of questionnaire
5. Provide clear instructions on how to complete the questionnaire (e.g. tick/cross)
![Page 14: 1 Data Gathering Chapter 7. Overview Five key issues of data gathering Data recording Three main methods for data collection: 1.Interviews 2.Questionnaires.](https://reader035.fdocuments.us/reader035/viewer/2022081417/56649e895503460f94b8e45b/html5/thumbnails/14.jpg)
Questionnaire design (2)6. Use a readable font type and font size
7. Structure the questionnaire in meaningful way - the impact of a question can be influenced by question order
8. Don’t overlap ranges, e.g. Age: 20-30
30-4041-5051-60
9. Number the questions, as well as the pages
10. Strike a balance between using white space and keeping the questionnaire compact.
![Page 15: 1 Data Gathering Chapter 7. Overview Five key issues of data gathering Data recording Three main methods for data collection: 1.Interviews 2.Questionnaires.](https://reader035.fdocuments.us/reader035/viewer/2022081417/56649e895503460f94b8e45b/html5/thumbnails/15.jpg)
Questionnaire design (3)
11. Use sub-headings for different sections
12. Decide on whether phrases will all be positive, all negative or mixed.
13. Align questions and answers
14. Provide space for comments
15. Always thank the user for the time and effort to respond
16. Search for ‘QUIS’ on Google for an extensive example of a questionnaire
![Page 16: 1 Data Gathering Chapter 7. Overview Five key issues of data gathering Data recording Three main methods for data collection: 1.Interviews 2.Questionnaires.](https://reader035.fdocuments.us/reader035/viewer/2022081417/56649e895503460f94b8e45b/html5/thumbnails/16.jpg)
Encouraging a good response
• Make sure purpose of study is clear• Promise anonymity• Ensure questionnaire is well designed• Offer a short version for those who do not have time
to complete a long questionnaire• If mailed, include a stamped addressed envelope• Follow-up with emails, phone calls, letters• Provide an incentive• 40% response rate is high, 20% is often acceptable
![Page 17: 1 Data Gathering Chapter 7. Overview Five key issues of data gathering Data recording Three main methods for data collection: 1.Interviews 2.Questionnaires.](https://reader035.fdocuments.us/reader035/viewer/2022081417/56649e895503460f94b8e45b/html5/thumbnails/17.jpg)
Advantages of online questionnaires
Responses are usually received quickly No copying and postage costs Data can be collected in database for analysis Time required for data analysis is reduced Errors can be corrected easily
![Page 18: 1 Data Gathering Chapter 7. Overview Five key issues of data gathering Data recording Three main methods for data collection: 1.Interviews 2.Questionnaires.](https://reader035.fdocuments.us/reader035/viewer/2022081417/56649e895503460f94b8e45b/html5/thumbnails/18.jpg)
Problems with online questionnaires
Sampling is problematic if population size is unknown Preventing individuals from responding more than once Individuals have also been known to change questions in
email questionnaires
![Page 19: 1 Data Gathering Chapter 7. Overview Five key issues of data gathering Data recording Three main methods for data collection: 1.Interviews 2.Questionnaires.](https://reader035.fdocuments.us/reader035/viewer/2022081417/56649e895503460f94b8e45b/html5/thumbnails/19.jpg)
Observation
• Direct observation in the field– Structuring frameworks– Degree of participation (insider or outsider)– Ethnography
• Direct observation in controlled environments– Usability lab– Think-aloud technique?
• Indirect observation: tracking users’ activities– Diaries– Interaction logging
![Page 20: 1 Data Gathering Chapter 7. Overview Five key issues of data gathering Data recording Three main methods for data collection: 1.Interviews 2.Questionnaires.](https://reader035.fdocuments.us/reader035/viewer/2022081417/56649e895503460f94b8e45b/html5/thumbnails/20.jpg)
Structuring frameworks to guide observation
• - The person. Who? - The place. Where?- The thing. What?
• The Goetz and LeCompte (1984) framework:- Who is present? - What is their role? - What is happening? - When does the activity occur?- Where is it happening? - Why is it happening? - How is the activity organized?
![Page 21: 1 Data Gathering Chapter 7. Overview Five key issues of data gathering Data recording Three main methods for data collection: 1.Interviews 2.Questionnaires.](https://reader035.fdocuments.us/reader035/viewer/2022081417/56649e895503460f94b8e45b/html5/thumbnails/21.jpg)
Ethnography (1) Ethnography is a philosophy with a set of techniques that
include participant observation and interviews Debate about differences between participant observation
and ethnography Ethnographers immerse themselves in the culture that they
study A researcher’s degree of participation can vary along a
scale from ‘outside’ to ‘inside’ Analyzing video and data logs can be time-consuming Collections of comments, incidents, and artifacts are made
![Page 22: 1 Data Gathering Chapter 7. Overview Five key issues of data gathering Data recording Three main methods for data collection: 1.Interviews 2.Questionnaires.](https://reader035.fdocuments.us/reader035/viewer/2022081417/56649e895503460f94b8e45b/html5/thumbnails/22.jpg)
Ethnography (2)
• Co-operation of people being observed is required• Informants are useful• Data analysis is continuous• Interpretivist technique
• Questions get refined as understanding grows• Reports usually contain examples
![Page 23: 1 Data Gathering Chapter 7. Overview Five key issues of data gathering Data recording Three main methods for data collection: 1.Interviews 2.Questionnaires.](https://reader035.fdocuments.us/reader035/viewer/2022081417/56649e895503460f94b8e45b/html5/thumbnails/23.jpg)
Online Ethnography
• Virtual, Online, Netnography• Online and offline activity• Interaction online differs from face-to-face• Virtual worlds have a persistence that
physical worlds do not have• Ethical considerations and presentation
issues are different
![Page 24: 1 Data Gathering Chapter 7. Overview Five key issues of data gathering Data recording Three main methods for data collection: 1.Interviews 2.Questionnaires.](https://reader035.fdocuments.us/reader035/viewer/2022081417/56649e895503460f94b8e45b/html5/thumbnails/24.jpg)
An ethnographic project for you …
• Join www.ActiveWorlds.com or go to another chat room of your choice
• ActiveWorlds is a 3-D chatroom environment in which you can visit different environments and chat with the people that you meet there
• To use ActiveWorlds you will need to check the instructions that they provide and download the appropriate software to run on your computer
![Page 25: 1 Data Gathering Chapter 7. Overview Five key issues of data gathering Data recording Three main methods for data collection: 1.Interviews 2.Questionnaires.](https://reader035.fdocuments.us/reader035/viewer/2022081417/56649e895503460f94b8e45b/html5/thumbnails/25.jpg)
• Select one of the worlds to visit and choose an avatar (a graphical personification) to represent you.
• Spend one to two hours doing an ethnographic study.
• Use one of the frameworks discussed in the previous slides to guide you and write a one or two page report about your study.
• Also notice and report on any usability issues you encounter and on user experiences in this environment.
![Page 26: 1 Data Gathering Chapter 7. Overview Five key issues of data gathering Data recording Three main methods for data collection: 1.Interviews 2.Questionnaires.](https://reader035.fdocuments.us/reader035/viewer/2022081417/56649e895503460f94b8e45b/html5/thumbnails/26.jpg)
Direct observation in a controlled environment
• Think-aloud technique
Indirect observation
• Diaries• Interaction logs
• Web analytics
![Page 27: 1 Data Gathering Chapter 7. Overview Five key issues of data gathering Data recording Three main methods for data collection: 1.Interviews 2.Questionnaires.](https://reader035.fdocuments.us/reader035/viewer/2022081417/56649e895503460f94b8e45b/html5/thumbnails/27.jpg)
Choosing and combining techniques
• Depends on– The focus of the study– The participants involved– The nature of the technique– The resources available
![Page 28: 1 Data Gathering Chapter 7. Overview Five key issues of data gathering Data recording Three main methods for data collection: 1.Interviews 2.Questionnaires.](https://reader035.fdocuments.us/reader035/viewer/2022081417/56649e895503460f94b8e45b/html5/thumbnails/28.jpg)
Summary• Three main data gathering methods: interviews,
questionnaires, observation• Five key issues of data gathering: goals, choosing
participants, triangulation, participant relationship, pilot• Interviews may be structured, semi-structured or
unstructured• Questionnaires may be on paper, online or telephone• Observation may be direct or indirect, in the field or in
controlled setting• Techniques can be combined depending on study
focus, participants, nature of technique and available resources