Age Ageing 2004 Gibson 422 6

5
 Age and Ageing 2004; 33: 422426 Age and Ageing Vol. 33 No. 4 British Geriatrics Society 2004; all rights reserved DOI: 10.1093/ageing/afh136 422 FOR DEBATE . . . The scope for qualitative methods in research and clinical trials in dementia GRANT GIBSON, ALISON TIMLIN, STEPHEN CURRAN, JOHN WATTIS Ageing and Mental Health Research Group, University of Huddersfield, Queensgate, Huddersfield HD1 3DH, UK Address correspondence to: S. Curran. Fax: (+44) 1484 473248. Email: [email protected] Abstract In the evaluation of drugs, the randomised double-blind placebo controlled trial is the ‘gold standard’. This method, based on a positivist paradigm, answers questions about efficacy and side-effects of treatments that are accepted as valid, reliable and generalisable, provided the study is well designed and properly conducted. In contrast, qualitative research method- ologies, originating from the social sciences, embrace a variety of approaches, including phenomenological and other para- digms. Within clinical and health services research, qualitative approaches view the world more subjectively, acknowledging that the researcher is part of what is researched, focusing on meanings and understanding of experience, rather than on what can be reduced to quantitative measures. They can develop new ideas through induction from data, rather than confirming or refuting hypotheses. Qualitative methods have improved our understanding of the experiences of people with dementia and, if used alongside clinical trials, could be used to improve the relevance of outcomes to patients, compliance and user involve- ment. They could also possibly generate new measures of efficacy and effectiveness in severe dementia. Keywords: qualitative research, dementia, clinical trials, Alzheimer’s Disease, elderly Introduction  The randomised controlled trial is the most commonly used tool within clinical research, and provides a range of benefits in the formulation of scientific knowledge. For studies into pharmacol ogical and other clinical interventions, the random- ised controlled trial is unparalleled. However, to rely solely upon this method restricts the areas that are open to research and narrows access to useful knowledge even in the area of drug efficacy and effectiveness. If used within well-designed research projects, qualitative methods can strengthen clinical trials by enhancing user involvement, and by revealing new areas of research that would remain hidden within wholly quantitative studies. This paper seeks to illustrate some of the differences between the two methodologies, and to show how  within dementia research, including clinical trials, qualitative and quantitative approach es can be complementary. Differences between quantitative and qualitative methods in health services research  The positivist framework enables questions to be answered in a highly specific way by controlling extraneous variables. This framework provides the basis of the double blind placebo controlled clinical trial. Reliability, validity, generalisability and objectivity are the bywords of the clinical trial, deriving a clear answer from a precise question of fact. Through appropriate statistical techniques, results are recognised as generalisable.  That is they can be applied to the wider population from  whom the trial sample was drawn.  Within the context of health services research, quali- tative research has an alternative philosophical underpin- ning, approaching different questions in different ways with different purposes [1]. For example, phenomenological approaches may challenge the ‘independence’ of the observer. They recognise that in research the observer is a participant whose own views and values impinge on out- comes; they explore experience and meaning rather than causality; they inductively look for patterns, themes and meanings; they reject reductionist approaches, claiming that topics must be studied within the complexity of real life. Concepts such as validity and reliability have to be approached in a different way in qualitative research, such as through triangulation [2, 3]. The main differences between the qualitative and quantitative methods, and the philosophical underpinnings upon which they are based  within health services and related research are summa- rised in Table 1 [2]. For many health service professionals qualitative research has been erroneously defined as being ‘what quan- titative research is not’ [4], leading to the creation of a false   a  t   S  a r  d  a r P  a  t   e l   U i  v  e r  s i   t   y  o n A  u  g  u  s  t  2  5  , 2  0 1 1  a  g  e i   g .  o x f   o r  d  j   o  u r n  a l   s  o r  g D  o w n l   o  a  d  e  d f  r  o m  

Transcript of Age Ageing 2004 Gibson 422 6

Page 1: Age Ageing 2004 Gibson 422 6

8/3/2019 Age Ageing 2004 Gibson 422 6

http://slidepdf.com/reader/full/age-ageing-2004-gibson-422-6 1/5

 Age and Ageing 2004; 33: 422–426 Age and Ageing Vol. 33 No. 4 British Geriatrics Society 2004; all rights reservedDOI: 10.1093/ageing/afh136

422

FOR DEBATE . . .

The scope for qualitative methods in research

and clinical trials in dementia

GRANT GIBSON, ALISON TIMLIN, STEPHEN CURRAN, JOHN WATTIS 

Ageing and Mental Health Research Group, University of Huddersfield, Queensgate, Huddersfield HD1 3DH, UK 

Address correspondence to: S. Curran. Fax: (+44) 1484 473248. Email: [email protected] 

Abstract

In the evaluation of drugs, the randomised double-blind placebo controlled trial is the ‘gold standard’. This method, basedon a positivist paradigm, answers questions about efficacy and side-effects of treatments that are accepted as valid, reliableand generalisable, provided the study is well designed and properly conducted. In contrast, qualitative research method-ologies, originating from the social sciences, embrace a variety of approaches, including phenomenological and other para-

digms. Within clinical and health services research, qualitative approaches view the world more subjectively, acknowledging that the researcher is part of what is researched, focusing on meanings and understanding of experience, rather than on what can be reduced to quantitative measures. They can develop new ideas through induction from data, rather than confirming orrefuting hypotheses. Qualitative methods have improved our understanding of the experiences of people with dementia and,if used alongside clinical trials, could be used to improve the relevance of outcomes to patients, compliance and user involve-ment. They could also possibly generate new measures of efficacy and effectiveness in severe dementia.

Keywords: qualitative research, dementia, clinical trials, Alzheimer’s Disease, elderly 

Introduction

 The randomised controlled trial is the most commonly usedtool within clinical research, and provides a range of benefitsin the formulation of scientific knowledge. For studies intopharmacological and other clinical interventions, the random-ised controlled trial is unparalleled. However, to rely solely upon this method restricts the areas that are open to researchand narrows access to useful knowledge even in the area of drug efficacy and effectiveness. If used within well-designedresearch projects, qualitative methods can strengthen clinicaltrials by enhancing user involvement, and by revealing new areas of research that would remain hidden within wholly quantitative studies. This paper seeks to illustrate some of thedifferences between the two methodologies, and to show how  within dementia research, including clinical trials, qualitativeand quantitative approaches can be complementary.

Differences between quantitative and

qualitative methods in health services

research

 The positivist framework enables questions to be answered ina highly specific way by controlling extraneous variables. Thisframework provides the basis of the double blind placebocontrolled clinical trial. Reliability, validity, generalisability and

objectivity are the bywords of the clinical trial, deriving a clearanswer from a precise question of fact. Through appropriate

statistical techniques, results are recognised as generalisable.  That is they can be applied to the wider population from whom the trial sample was drawn.

  Within the context of health services research, quali-tative research has an alternative philosophical underpin-ning, approaching different questions in different ways withdifferent purposes [1]. For example, phenomenologicalapproaches may challenge the ‘independence’ of theobserver. They recognise that in research the observer is aparticipant whose own views and values impinge on out-comes; they explore experience and meaning rather thancausality; they inductively look for patterns, themes andmeanings; they reject reductionist approaches, claiming 

that topics must be studied within the complexity of reallife. Concepts such as validity and reliability have to beapproached in a different way in qualitative research, suchas through triangulation [2, 3]. The main differencesbetween the qualitative and quantitative methods, and thephilosophical underpinnings upon which they are based  within health services and related research are summa-rised in Table 1 [2].

For many health service professionals qualitativeresearch has been erroneously defined as being ‘what quan-titative research is not’ [4], leading to the creation of a false

Page 2: Age Ageing 2004 Gibson 422 6

8/3/2019 Age Ageing 2004 Gibson 422 6

http://slidepdf.com/reader/full/age-ageing-2004-gibson-422-6 2/5

For debate . . .

423

dichotomy between the two methods, with extreme viewson both sides of the divide. Extremes include the claim that qualitative research is not ‘real’ research or, on the otherside of the divide, that dementia should not be considered asa disease, being mainly a social construction [5]. Withinhealth services research this divide has been reinforced by many badly designed and validated qualitative researchdesigns, giving the use of qualitative methods an undeserved

‘bad press’. Similarly, a lack of training for medical staff on theapplication of qualitative methodologies within health serv-ices research has led to a lack of knowledge on the possibili-ties that arise from the use of these methods. However, overrecent years, an increasing number of scientists andresearchers within each ‘camp’ are coming to the view that qualitative and quantitative methods are complementary and that using both approaches enables us to obtain a morecomplete understanding of the issues and outcomes of clin-ical and health services research [6].

Types of qualitative research and their

applications

Generally, three broad categories of qualitative researchexist of interest to health service researchers; observationalstudies, interview studies and documentary/textual analysisof various written records [1, 7]. Rather than robustly con-firming existing hypotheses, qualitative approaches canoften generate new ideas for further research and provideinsights into the experiences of service users and carers not immediately accessible to quantitative methods.

Qualitative methods have a wide scope of use withinclinical trials. They can address issues such as informed con-sent and randomisation [8]. They can allow those under-taking treatments and their carers to share their ownexperiences of the benefits and impacts that drug treatments

bring, perhaps particularly relevant in severe dementia.Beyond the clinical trial, they can explore reasons for ineq-uity of access to treatment [9]. Because of the respect shownto the participants views, qualitative research can be usefulin improving the design of randomised controlled trials, andin improving recruitment [8]. Because they do not have todecide in advance which rating scales to use, qualitativemethods in drug evaluation can increase the likelihood of discovering new kinds of information about the experiencesof patients and those who care for them (including benefitsand impacts that may not be discovered using quantitative

methods). To date qualitative methods have not been widely used in clinical trials to evaluate the use of psycho-tropic drugs in older or younger people, or more specifically in people with dementia. They could help us to understandthe perspective of people with dementia and their carers,and the meanings they attach to treatment and treatment response. When combined with quantitative approaches,this could significantly enhance our understanding of anti-

dementia drugs.

Characteristics of qualitative research

 Within clinical trials specifically and clinical research moregenerally, qualitative methods have the following character-istics and benefits:

i.  Qualitative research as participatory : participants feel valuedas more than subjects/objects.

ii.   Qualitative research as reflexive : reflection is encouraged,opening up new lines of enquiry.

iii. Qualitative research as complementary : the ‘objective’ resultsof quantitative research are complemented by the subject-ive accounts of participants.

Qualitative research as participatory

One of the most significant aspects of much qualitativeresearch work is its participatory nature. Those taking part in research are given value as  participants , rather than being research subjects  [10]. Many forms of qualitative researchhave the ability to create a two-way learning process, within  which knowledge is gained and transferred betweenresearcher and participant. In this respect, for participantsresearch can be an empowering experience [11]. Somepeople, particularly old people and those with dementia,may feel lonely, irrelevant or marginalised. Qualitativeresearch can allow such people to feel that they have a

‘voice’, that others are listening to their concerns and areinterested in their opinions and experiences. Participants inthis type of research may be ‘amazed that someone was tak-ing an interest in their situation’ [12]. Similarly, with suitablelevels of familiarity and trust, detailed sources of data can beaccessed that would remain hidden in quantitative research.Participants may also be able to voice concerns they wouldnot be able to raise within the context of other researchmethods. When combined with a clinical trial, improvedresearcher understanding and user feeling of involvement may enhance compliance.

Table 1. Differences between quantitative and qualitative methodology within health services research (modified from [2])

Positivist ‘quantitative’ paradigm Phenomenological ‘qualitative’ paradigm. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .

Basic beliefs The world is external and objective The world is subjective

Observer is independent Observer is part of what is observed

Science is value free Science is driven by human interests

Researcher should Focus on facts Focus upon meaning/interpretation

Look for causality and fundamental laws Try to understand what is happening 

Reduce phenomena to simplest elements Look at the totality of each situation

Formulation and testing of hypotheses Develop ideas through induction of dataPreferred methods include Operationalising & measuring concepts Using multiple methods & multiple viewpoints

Taking large samples Small in-depth samples

Page 3: Age Ageing 2004 Gibson 422 6

8/3/2019 Age Ageing 2004 Gibson 422 6

http://slidepdf.com/reader/full/age-ageing-2004-gibson-422-6 3/5

G. Gibson et al.

424

Qualitative research as reflexive

 Thoughtful reflection on outcomes can be a powerful tool indeveloping research and clinical practice. Qualitative methodslend themselves to this kind of reflection. This reflexivity isoften identified as a criticism of qualitative methods, in that they lack ‘objectivity’ and external ‘validity’. From the quali-tative viewpoint, researchers, and the act of research, arerooted within the interactions and relationships that occur

 within the social world [12]. Qualitative research cannot exist outside of the social world, and is involved in constructing and negotiating this world. There is no one universal experi-ence for people with dementia, but each person has an indi- vidual account of the illness and its past, current and futureeffects. From these accounts common themes will emergelinking the experiences of different individuals, helping themfeel less isolated, and helping the researcher better understandthese experiences. This can then lead to improved practicethrough a better understanding of the subjective and indi-

 vidual experiences of people with dementia and those whocare for them. Qualitative research allows us to recognise,investigate and challenge how our positions as clinicians and

researchers affect outcomes. Within clinical trials, it canimpact upon the data collected, its subsequent analysis, theresults gained and their interpretation, and their usefulness inclinical practice.

Qualitative methods as complementary

 As noted earlier, a common (mis)conception in research isthe existence of a qualitative–quantitative divide based uponfundamentally different philosophical underpinnings irrevo-cably distanced from each other [2, 13]. However, thisdichotomy, based on ideology rather than theory is com-monly detrimental to the research process [1, 4, 14]. Quali-tative research methods provide a powerful tool incomplementing statistical forms of research. Indeed a good

quality piece of quantitative research is often dependent onthe findings of descriptive studies based upon qualitativetechniques [1]. If utilised correctly, the ability of qualitativemethods to analyse micro-scale phenomena can be perfectly complemented by quantitative methods and their ability toexamine phenomena at larger scales. Furthermore qualita-tive studies can often suggest new ideas that can be furtherevaluated using quantitative techniques with larger samples. This is one example of the ways in which qualitative andquantitative methods, when combined, provide a fuller pic-ture of a population than either method can separately.

Qualitative research and research into

dementia

Qualitative methods are more often used in management research. They are probably under used in clinical research,including dementia research. However, there has been anencouraging growth in the number of qualitative researchstudies in dementia. Qualitative methods have been wellused in investigating the phenomenology of dementia, illus-trating the experiences and perspectives of people withdementia and their carers [15–19]. Phenomenological, psycho-analytical and feminist studies on the notion of selfhood

have led to the development of alternative theories on theimpact of dementia upon individuals’ quality of life [4, 20,21]. Further qualitative work has examined and evaluatedthe healthcare and wider support provided to people withdementia and their carers, often concentrating on evaluating forms of care provision and highlighting new systems forthe benefit of people with dementia and their caregivers[22–24].

However, within clinical trials qualitative methodsremain underused. This can in part be attributed to thedominance of the randomised controlled trial, a highly suc-cessful quantitative design. Here the person with dementiamay have little input or involvement beyond being the sub-ject of various tests, measures and other procedures. Put simply, the person with dementia is little more than a pas-sive vessel of answers [14]. Clearly this is an important and neces-sary part of the research and development process, howeverthe legitimacy of this approach as the only way to conduct research into the effectiveness of drug treatments can bechallenged. The effectiveness of utilising qualitative meth-ods within randomised clinical trials has been demonstrated,for example showing how these methods are useful inimproving recruitment rates by increasing researcher aware-ness of how medical terms may be misinterpreted by patients, and the impact of these misinterpretations [10].

Clinical trials and other clinical research studies do not seek to measure social phenomena; rather they seek tounderstand the impact of drug treatments on clinical condi-tions. However, qualitative methods are not in conflict withtraditional quantitative methods, instead they can widen andcomplement the knowledge generated in such studies andelsewhere in dementia research. The adoption of qualitativemethods within clinical research on dementia drug treat-ments would acknowledge that dementia is not simply abiological process characterised by cognitive and functional

decline, but is also a socially constructed experience negoti-ated and interpreted by those with the disease and their car-ers. In including and further developing qualitative research  within psychopharmacological studies we gain a deeperunderstanding, not only of the psychosocial and experientialconcerns arising for individual patients, but also the rela-tionships and conflicts that may occur when the social worlds of people with dementia meet the clinical world of dementia research. If we broaden our research into theexperiences of people undertaking drug treatments, we must consider their social worlds and how they interact withbeing prescribed anti-dementia medication. By undertaking qualitative research in conjunction with clinical trials, we

may gain an understanding of the effectiveness of thesedrugs through the lived experiences of people with demen-tia, complementary to their psychometric effectiveness.

Specific ethical and methodological issues arise whenconducting research with people suffering from cognitiveimpairment. However, within a relevant and well thought out research design, using well trained and sympatheticresearchers, qualitative methods can be particularly suited toconducting research with people with mild to moderateforms of dementia [14]. Downs [20] describes a study whereethnographic methods such as participant observation were

Page 4: Age Ageing 2004 Gibson 422 6

8/3/2019 Age Ageing 2004 Gibson 422 6

http://slidepdf.com/reader/full/age-ageing-2004-gibson-422-6 4/5

For debate . . .

425

used to good effect in investigating the opinions of people with dementia regarding the quality of home-based day careprovided. Clearly in this respect there is scope for investi-gating the opinions, experiences and practices of peopletaking anti-dementia drugs during trials. The use of quali-tative methods within dementia treatment studies allowsresearchers to more fully investigate issues surrounding thedisease that, because of their nature, may not be picked up

during the use of standardised tests for cognitive ability.Qualitative research is also well suited to investigating ser- vices for the provision of anti-dementia treatments. Qualita-tive methods with service users can be used to illustrate indetail particular strengths and weaknesses that may not be asreadily apparent using statistical and other records. While aclinic may be successful in terms of managerial efficiency, ser- vice users may evaluate services using very different measuresof success. A statistical analysis using sources such as patient records may not be able to differentiate between these differ-ent judgements. Of course a purely qualitative project basedupon patient experiences and opinions can not be relied uponin isolation, but when the two methods are combined, we areable to provide a fuller analysis of services and treatmentsbased upon the experiences and practices of all involved andanalysing a variety of seemingly different trends and datasources.

Conclusion

Interest in qualitative methods in researching dementia anddementia care is growing. However little consideration hasbeen given on how these methods may complement quantit-ative studies into drug treatments for Alzheimer’s and otherforms of dementia. An adoption of qualitative methods withinthis area, when combined effectively with quantitative mea-sures would allow both researchers and practitioners to gain a

fuller understanding of the improvements these drugs pro- vide, and crucially how these improvements are experiencedby people with dementia themselves. Of course, and as withquantitative research, qualitative studies must be well designedand rigorous according to their aims, objectives and outcomes.In this regard, qualitative methods can provide interesting and  valuable case studies or ‘snapshots’ on the effectiveness of drug treatment, rooting the benefits of these treatments withinthe context of patient’s experiences, and providing a powerfultool for encouraging further development for research intodrug treatments in the future [5].

Key pointsQualitative methods:• Can enhance clinical trials in a variety of ways.• Have a different philosophical foundation to the quanti-

tative methods that dominate clinical trials.• Supplement but do not replace quantitative methods.•  Allow patients and carers to share their experiences of 

treatment and its effects on their own terms.• Can allow patients and carers to be more actively 

engaged in research rather than simply being its objects.

• Can be used to generate new areas of enquiry, rather thanto prove or disprove hypotheses.

Conflict of interest

G. Gibson and A. Timlin’s positions were supported by aresearch project grant provided by Pfizer/Eisai.

References

1. Pope C, Mays N. Qualitative methods in health and healthservices research. In Mays N, Pope N eds. QualitativeResearch in Health Care. London: BMJ, 1996.

2. Easterby-Smith M, Thorpe R, Lowe A. Management Research: An Introduction. London: Sage, 1991.

3. May N, Pope C. Rigour and qualitative research. In Mays N,Pope N eds. Qualitative Research in Health Care. London:BMJ, 1996.

4. Brown C, Lloyd K. Qualitative methods in psychiatricresearch. Adv Psychiatric Treat 2001; 7: 350–6.

5. Harding NH, Palfrey C. Confused Professionals: The SocialConstruction of Dementia. London: Jessica Kingsley, 1997.

6.  Weaver T, Renton A, Tyrer P, Ritchie J. Combining qualitativestudies with randomised controlled trials is often useful. BrMed J 1996; 313: 629.

7. Britten, N. Qualitative interviews in medical research. In Mays N,Pope N eds. Qualitative Research in Health Care. London:BMJ, 1996.

8. Featherstone K, Donovan L. Random allocation or allo-cation at random? Patients’ perspectives of participation in arandomised controlled trial. Br Med J 1998; 317: 1177–80.

9. Gardner K, Chapple A, Green J. Barriers to referral inpatients with angina: qualitative study. Commentary: general-isability and validity in qualitative research. Br Med J 1999;319: 418–21.

10. Donovan J, Mills N, Smith M et al . Improving design and con-duct of randomised trials by embedding them in qualitativeresearch: ProtecT (prostate testing for cancer and treatment)study. Br Med J 2002; 325: 766–70.

11. Clarke CL, Keady J. Getting down to brass tacks: a discussionof data collection with people with dementia. In Wilkinson Hed. The Perspectives of People with Dementia. London:

 Jessica Kingsley, 2002.12. Goss JD, Leinbach TR. Focus groups as alternative research

practice: experience with transmigrants in Indonesia. Area1996; 28: 115–23.

13. May T. Social Research: Issues Methods and Process. Oxford:OUP, 2001.

14. Bond J, Corner L. Researching Dementia: are there unique

methodological challenges for health services research? Age-ing Soc 2001; 21: 95–116.15. Sabat S, Harre R. The construction and deconstruction of self 

in Alzheimer’s disease. Ageing Soc 1992; 12: 443–61.16. Small JA, Geldart K, Gutman G, Clarke-Scott MA. The dis-

course of self in dementia. Ageing Soc 1998; 18: 291–316.17. Clare L. We’ll fight it as long as we can: coping with the onset 

of Alzheimer’s disease. Ageing Mental Health 2002; 6: 139–48.18. Innes A. The social and political context of formal dementia

care provision. Ageing Soc 2002; 22: 483–99.19. Phinney A, Chesla CA. The lived body in dementia. J Aging 

Studies 2003; 17: 283–99.

Page 5: Age Ageing 2004 Gibson 422 6

8/3/2019 Age Ageing 2004 Gibson 422 6

http://slidepdf.com/reader/full/age-ageing-2004-gibson-422-6 5/5

G. Gibson et al.

426

20. Downs M. Progress report: the emergence of the person indementia research. Ageing Soc 1997; 17: 597–607.

21. Downs M. Ageing update. Dementia in a socio-cultural con-text: an idea whose time has come. Ageing Soc 2001; 20;369–75.

22. Cooper SA, Coleman PG. Caring for the older person: anexploration of perceptions using personal construct theory.

 Age Ageing 2001; 30: 399–402.

23. Reed J, Cook G, Sullivan A, Burridge C. Making a move: carehome residents’ experiences of relocation. Ageing Soc 2003;23: 225–41.

24. Davies S, Nolan M. Making the best of things: relatives’ experi-ences of decisions about care home entry. Ageing Soc 2003;23: 429–50.

Received 31 October 2003; accepted in revised form 3 February 2004