Standards for Qualitative Research in Education Margaret Eisenhart.
-
Upload
eunice-barrett -
Category
Documents
-
view
214 -
download
0
Transcript of Standards for Qualitative Research in Education Margaret Eisenhart.
![Page 1: Standards for Qualitative Research in Education Margaret Eisenhart.](https://reader036.fdocuments.us/reader036/viewer/2022062515/56649d145503460f949e83b6/html5/thumbnails/1.jpg)
Standards for Qualitative Research in Education
Margaret Eisenhart
![Page 2: Standards for Qualitative Research in Education Margaret Eisenhart.](https://reader036.fdocuments.us/reader036/viewer/2022062515/56649d145503460f949e83b6/html5/thumbnails/2.jpg)
A Prolegomenon on Standards
Howe, K. & Eisenhart, M. (1990). Standards for qualitative (and quantitative) research: A prolegomenon. Educational Researcher, 19 (4), 2-9.
![Page 3: Standards for Qualitative Research in Education Margaret Eisenhart.](https://reader036.fdocuments.us/reader036/viewer/2022062515/56649d145503460f949e83b6/html5/thumbnails/3.jpg)
The Trajectory of Debate 1980-90
- Entrenched quantitative methods and standards vs. a highly suspect newcomer
- Two strands:
1. Research methods vs. epistemologies
2. Research methods for different purposes
![Page 4: Standards for Qualitative Research in Education Margaret Eisenhart.](https://reader036.fdocuments.us/reader036/viewer/2022062515/56649d145503460f949e83b6/html5/thumbnails/4.jpg)
Our position:
Side with the second strandDistinguish standards for specific research
designs from standards for the general value of an educational research study
Focus on standards for general value
![Page 5: Standards for Qualitative Research in Education Margaret Eisenhart.](https://reader036.fdocuments.us/reader036/viewer/2022062515/56649d145503460f949e83b6/html5/thumbnails/5.jpg)
The Nature of General Standards
Abstract Refer to the educational value (or value
added) Apply to both quantitative and qualitative
methods
![Page 6: Standards for Qualitative Research in Education Margaret Eisenhart.](https://reader036.fdocuments.us/reader036/viewer/2022062515/56649d145503460f949e83b6/html5/thumbnails/6.jpg)
5 General Standards (guiding principles)
1. Specific data collection and analysis methods must be competently applied.
2. Contributions from previous theories, previous research, other relevant literature and researcher subjectivity (bias) should be made explicit
3. The fit between research questions, data collection and data analysis should be clear.
![Page 7: Standards for Qualitative Research in Education Margaret Eisenhart.](https://reader036.fdocuments.us/reader036/viewer/2022062515/56649d145503460f949e83b6/html5/thumbnails/7.jpg)
4. Overall warrant (validity) must be established by rejecting rival or alternative inferences or explanations.
5. Value constraints must be recognized and met.
--Educational research should be valuable to education (external value).
--Educational research should be ethical (internal value).
![Page 8: Standards for Qualitative Research in Education Margaret Eisenhart.](https://reader036.fdocuments.us/reader036/viewer/2022062515/56649d145503460f949e83b6/html5/thumbnails/8.jpg)
What’s Happened to the Debate about Qualitative Standards since 1990?
Epistemology takes center stage
Internal value constraints receive lots of attention
Other general standards receive little attention
![Page 9: Standards for Qualitative Research in Education Margaret Eisenhart.](https://reader036.fdocuments.us/reader036/viewer/2022062515/56649d145503460f949e83b6/html5/thumbnails/9.jpg)
National Research Council Committee on Scientific Principles in Education Research (est. 2000).
NRC (2000). Scientific research in education. Washington, DC: The National Academies Press.
![Page 10: Standards for Qualitative Research in Education Margaret Eisenhart.](https://reader036.fdocuments.us/reader036/viewer/2022062515/56649d145503460f949e83b6/html5/thumbnails/10.jpg)
SRE’s 6 General Principles for High Quality, Scientific Research in Education
1. Pose significant questions that can be investigated empirically
2. Link research to relevant theory
3. Use methods that permit direct investigation of the question
![Page 11: Standards for Qualitative Research in Education Margaret Eisenhart.](https://reader036.fdocuments.us/reader036/viewer/2022062515/56649d145503460f949e83b6/html5/thumbnails/11.jpg)
4. Provide a coherent and explicit chain of reasoning
5. Replicate and generalize across studies
6. Disclose research to encourage professional scrutiny and debate
![Page 12: Standards for Qualitative Research in Education Margaret Eisenhart.](https://reader036.fdocuments.us/reader036/viewer/2022062515/56649d145503460f949e83b6/html5/thumbnails/12.jpg)
Side-by Side ComparisonHowe & Eisenhart
1. Competent application of methods
2. External contributions made explicit
3. Fit of research questions, data collection and analysis
4. Overall warrant established
5. Internal and external value constraints met
NRC
1. Link research to relevant
theory
2. Use appropriate methods
3. Pose significant questions
4. Provide a chain of reasoning
5. Replicate and generalize
6. Disclose research for scrutiny and debate
![Page 13: Standards for Qualitative Research in Education Margaret Eisenhart.](https://reader036.fdocuments.us/reader036/viewer/2022062515/56649d145503460f949e83b6/html5/thumbnails/13.jpg)
Can We Talk about Shared Standards for the Trustworthiness (Validity and Reliability) of Educational Research?
I think so, but both qualitative and quantitative researchers have to take this effort seriously.
![Page 14: Standards for Qualitative Research in Education Margaret Eisenhart.](https://reader036.fdocuments.us/reader036/viewer/2022062515/56649d145503460f949e83b6/html5/thumbnails/14.jpg)
Necessary First Steps (qualitative and quantitative)
Share a definition of trustworthiness One possibility: When the evidence for the results
reported is sound and when the argument made based on the results is strong
Make strategies for achieving trustworthiness a formal component of all research designs
![Page 15: Standards for Qualitative Research in Education Margaret Eisenhart.](https://reader036.fdocuments.us/reader036/viewer/2022062515/56649d145503460f949e83b6/html5/thumbnails/15.jpg)
Qualitative Strategies for Trustworthiness
Identify threats to understanding (of social context, meanings, a group, etc.) in situ.
Key Q: How could the researcher’s understandings be wrong?
![Page 16: Standards for Qualitative Research in Education Margaret Eisenhart.](https://reader036.fdocuments.us/reader036/viewer/2022062515/56649d145503460f949e83b6/html5/thumbnails/16.jpg)
Key ReferencesMaxwell, J. (1996). Qualitative research
design: An interactive approach. Thousand Oaks, CA: Sage.
Maxwell, J. (2002). Understanding and validity in qualitative research. In A.M. Huberman & M.B. Miles (Eds.) The qualitative researcher’s companion (pp. 37-64). Thousand Oaks, CA: Sage.
![Page 17: Standards for Qualitative Research in Education Margaret Eisenhart.](https://reader036.fdocuments.us/reader036/viewer/2022062515/56649d145503460f949e83b6/html5/thumbnails/17.jpg)
4 Kinds of Understandings that Qualitative Research Provides
Descriptive understanding Interpretive understandingTheoretical understandingGeneralizability
![Page 18: Standards for Qualitative Research in Education Margaret Eisenhart.](https://reader036.fdocuments.us/reader036/viewer/2022062515/56649d145503460f949e83b6/html5/thumbnails/18.jpg)
Descriptive validity: Could the description be wrong?
Descriptive accounts must be factually accurate—where the physical, concrete, or behavioral details are agreed to by both researcher(s) and participants.
![Page 19: Standards for Qualitative Research in Education Margaret Eisenhart.](https://reader036.fdocuments.us/reader036/viewer/2022062515/56649d145503460f949e83b6/html5/thumbnails/19.jpg)
Main threat:
Inaccurate or incomplete evidence
Main strategies to reduce threat:
Detailed evidenceTriangulation of data sources
![Page 20: Standards for Qualitative Research in Education Margaret Eisenhart.](https://reader036.fdocuments.us/reader036/viewer/2022062515/56649d145503460f949e83b6/html5/thumbnails/20.jpg)
Interpretive validity: Could the interpretation be wrong?
Interpretations must be meaningful to study participants, or meaningful from the participants’ perspective.
![Page 21: Standards for Qualitative Research in Education Margaret Eisenhart.](https://reader036.fdocuments.us/reader036/viewer/2022062515/56649d145503460f949e83b6/html5/thumbnails/21.jpg)
Main threat:
Imposing the researcher’s own perspective
Main strategies to reduce threat:
Systematic testing of emergent interpretations against participants’ words and actions
Member checks
![Page 22: Standards for Qualitative Research in Education Margaret Eisenhart.](https://reader036.fdocuments.us/reader036/viewer/2022062515/56649d145503460f949e83b6/html5/thumbnails/22.jpg)
Theoretical validity: Could the theory be wrong?
A theory must provide a good explanation for the phenomena studied. Both the concepts and the relationships among them must be valid.
![Page 23: Standards for Qualitative Research in Education Margaret Eisenhart.](https://reader036.fdocuments.us/reader036/viewer/2022062515/56649d145503460f949e83b6/html5/thumbnails/23.jpg)
Main threat:
Discrepant data, negative cases, or rival explanations not taken seriously
Main strategies to reduce threat:Systematic attempts to find discrepant data and
disprove alternative explanationsConsensus of other researchers
![Page 24: Standards for Qualitative Research in Education Margaret Eisenhart.](https://reader036.fdocuments.us/reader036/viewer/2022062515/56649d145503460f949e83b6/html5/thumbnails/24.jpg)
Qualitative generalization
2 kinds
Internal (within group or site, but beyond those studied directly)
External (to other groups or sites)
![Page 25: Standards for Qualitative Research in Education Margaret Eisenhart.](https://reader036.fdocuments.us/reader036/viewer/2022062515/56649d145503460f949e83b6/html5/thumbnails/25.jpg)
Main threat to internal generalizability:
Those observed and interviewed not typical of whole group
Main strategy to reduce threat:
Purposeful samplingSurveying
![Page 26: Standards for Qualitative Research in Education Margaret Eisenhart.](https://reader036.fdocuments.us/reader036/viewer/2022062515/56649d145503460f949e83b6/html5/thumbnails/26.jpg)
Main threats to external generalizability:
Phenomena studied is a special or idiosyncratic case
Main strategies to reduce threat:
Site selection Assess generalizability of theory or big idea, not findings
![Page 27: Standards for Qualitative Research in Education Margaret Eisenhart.](https://reader036.fdocuments.us/reader036/viewer/2022062515/56649d145503460f949e83b6/html5/thumbnails/27.jpg)
A Note on Reliability
Qualitative research does not attempt to eliminate variance between researchers or the researcher’s influence on the setting.
It does attempt to illuminate how a researcher’s values, expectations, and background influence the study.
![Page 28: Standards for Qualitative Research in Education Margaret Eisenhart.](https://reader036.fdocuments.us/reader036/viewer/2022062515/56649d145503460f949e83b6/html5/thumbnails/28.jpg)
Threat: Researcher’s influence unclear
Strategy: Audit trails
![Page 29: Standards for Qualitative Research in Education Margaret Eisenhart.](https://reader036.fdocuments.us/reader036/viewer/2022062515/56649d145503460f949e83b6/html5/thumbnails/29.jpg)
Conclusion
General standards for qualitative (or quantitative) research in education are within our reach, but to get there, we must get passed epistemological battles and turn our attention squarely to standards for trustworthiness (validity) that are meaningful (relevant) and useful in our field.