Design Science Research: Theory Ingrained Artifactand...
Transcript of Design Science Research: Theory Ingrained Artifactand...
![Page 1: Design Science Research: Theory Ingrained Artifactand ...sites.telfer.uottawa.ca/mcdm2017/files/2016/12/MCDM-2017-Keynote... · •Closer to Software Engineering, but with a social](https://reader033.fdocuments.us/reader033/viewer/2022051718/5a7261ed7f8b9aa2538d8962/html5/thumbnails/1.jpg)
Prof. TuureTuunanenFacultyofIT,InformationSystemsUniversityofJyväskylä
DesignScienceResearch:TheoryIngrainedArtifact andDerivingTheoriesfromArtifact
![Page 2: Design Science Research: Theory Ingrained Artifactand ...sites.telfer.uottawa.ca/mcdm2017/files/2016/12/MCDM-2017-Keynote... · •Closer to Software Engineering, but with a social](https://reader033.fdocuments.us/reader033/viewer/2022051718/5a7261ed7f8b9aa2538d8962/html5/thumbnails/2.jpg)
Outline
• DesignScienceResearch(DSR)inIS• TheISArtifact• ConceptsandModels• TheDSRProcess
• Theorizingtheartifactandderivingtheoriesfromtheartifact• DSRStudyExemplar(notpublic):• PopulationTargetedRequirementsAcquisitionMethodology
• PracticalExamples(notpublic)
2
![Page 3: Design Science Research: Theory Ingrained Artifactand ...sites.telfer.uottawa.ca/mcdm2017/files/2016/12/MCDM-2017-Keynote... · •Closer to Software Engineering, but with a social](https://reader033.fdocuments.us/reader033/viewer/2022051718/5a7261ed7f8b9aa2538d8962/html5/thumbnails/3.jpg)
• Herbert Simon: Science of The Artificial• AProblemSolvingParadigm• TheCreationofInnovativeArtifactstoSolveRealProblems
• Design science creates and evaluates IT artifacts intended to solve identified organizational problems.• Closer to Software Engineering, but with a social science twist• TheoryIngrainedArtifact andDerivingTheoriesfromArtifact.
• Return to the Artifact after a “side-tour” to social sciences by business school researchers.
Background
![Page 4: Design Science Research: Theory Ingrained Artifactand ...sites.telfer.uottawa.ca/mcdm2017/files/2016/12/MCDM-2017-Keynote... · •Closer to Software Engineering, but with a social](https://reader033.fdocuments.us/reader033/viewer/2022051718/5a7261ed7f8b9aa2538d8962/html5/thumbnails/4.jpg)
• First papers published by Nunamaker et al. 1991 and Walls et al. 1992 in premier IS journals (Information Systems Research, J. of MIS)• IS development as a way to do research; development of group
support systems in Univ. of Arizona (Nunamaker et al.)• Use of kernel theories from reference disciplines to develop IS design
theories (Walls et al.)• Next influential paper was by March and Smith 1995• Two processes: build and evaluate.• Artifacts: constructs, models, methods, and instantiations.
=
![Page 5: Design Science Research: Theory Ingrained Artifactand ...sites.telfer.uottawa.ca/mcdm2017/files/2016/12/MCDM-2017-Keynote... · •Closer to Software Engineering, but with a social](https://reader033.fdocuments.us/reader033/viewer/2022051718/5a7261ed7f8b9aa2538d8962/html5/thumbnails/5.jpg)
Artifact?What are those?
• Constructs• Vocabularyandconceptualizationsthatenablecommunicationanddescriptionofproblems(phenomena,possiblywithinacausalchain),solutioncomponents,constraints,andobjectivesforthedesignedartifact
• Models• Useconstructstorepresentaproblemanditssolutionspace.
• Methods• Methodsarealgorithmsorguidelinesthatareusedtosearchthesolutionspaceandenabletheconstructionofinstantiations—computer-basedsystemsimplementedwithinanorganization.
• Instantiations• Demonstratethefeasibilityofutilizingtheaboveartifactsforagiventask
(March andStorey 2008)
![Page 6: Design Science Research: Theory Ingrained Artifactand ...sites.telfer.uottawa.ca/mcdm2017/files/2016/12/MCDM-2017-Keynote... · •Closer to Software Engineering, but with a social](https://reader033.fdocuments.us/reader033/viewer/2022051718/5a7261ed7f8b9aa2538d8962/html5/thumbnails/6.jpg)
The Breakthrough by Hevner etal.
• SevenRequirementsforRigorousDSResearch.• 9.200+citationssince2004.• Greatimpacttothefield:• Forming aspecial designscienceconference inIS(DESRIST)in2006.• Special issue inthe flagship journal ofthe field:MISQuartely 2008.• Other journals started recruiting designscienceresearchers tothe editorialsboards.• Tracks emerged inmajor information systems conferences such asInt.Conf.ofIS,EuropeanConf.ofIS,HICSSetc.
![Page 7: Design Science Research: Theory Ingrained Artifactand ...sites.telfer.uottawa.ca/mcdm2017/files/2016/12/MCDM-2017-Keynote... · •Closer to Software Engineering, but with a social](https://reader033.fdocuments.us/reader033/viewer/2022051718/5a7261ed7f8b9aa2538d8962/html5/thumbnails/7.jpg)
• Guideline 1: Design as an Artifact• Design-science research must produce a viable artifact in the form of a
construct, a model, a method, or an instantiation.• Guideline 2: Problem Relevance• The objective of design-science research is to develop technology-
based solutions to important and relevant business problems.• Guideline 3: Design Evaluation• The utility, quality, and efficacy of a design artifact must be rigorously
demonstrated via well-executed evaluation methods.
KeyRequirementsforRigorousDSResearch
![Page 8: Design Science Research: Theory Ingrained Artifactand ...sites.telfer.uottawa.ca/mcdm2017/files/2016/12/MCDM-2017-Keynote... · •Closer to Software Engineering, but with a social](https://reader033.fdocuments.us/reader033/viewer/2022051718/5a7261ed7f8b9aa2538d8962/html5/thumbnails/8.jpg)
Observational Analytical Experimental Testing Descriptive
Case Study: Study artifact in depth in business environment
Static Analysis: Examine structure of artifact for static qualities (e.g., complexity)
Controlled Experiment: Study artifact in controlled environment for qualities (e.g., usability)
Functional (Black Box) Testing: Execute artifact interfaces to discover failures and identify defects
Informed Argument: Use information from the knowledge base (e.g., relevant research) to build a convincing argument for the artifact’s utility
Field Study: Monitor use of artifact in multiple projects
Architecture Analysis: Study fit of artifact into technical IS architecture
Simulation: Execute artifact with artificial data
Structural (White Box) Testing: Perform coverage testing of some metric (e.g., execution paths) in the artifact implementation
Scenarios: Construct detailed scenarios around the artifact to demonstrate its utility
Optimization: Demonstrate inherent optimal properties of artifact or provide optimality bounds on artifact behavior
Dynamic Analysis: Study artifact in use for dynamic qualities (e.g., performance)
EvaluationTechniques
![Page 9: Design Science Research: Theory Ingrained Artifactand ...sites.telfer.uottawa.ca/mcdm2017/files/2016/12/MCDM-2017-Keynote... · •Closer to Software Engineering, but with a social](https://reader033.fdocuments.us/reader033/viewer/2022051718/5a7261ed7f8b9aa2538d8962/html5/thumbnails/9.jpg)
• Guideline 4: Research Contributions• Effective design-science research must provide clear and verifiable
contributions in the areas of the design artifact, design foundations, and/or design methodologies.
• Guideline 5: Research Rigor• Design-science research relies upon the application of rigorous methods in
both the construction and evaluation of the design artifact.• Guideline 6: Design as a Search Process
• The search for an effective artifact requires utilizing available means to reach desired ends while satisfying laws in the problem environment.
• Guideline 7: Communication of Research• Design-science research must be presented effectively both to technology-
oriented as well as management-oriented audiences.
MoreObviousRequirementsforDSResearch
![Page 10: Design Science Research: Theory Ingrained Artifactand ...sites.telfer.uottawa.ca/mcdm2017/files/2016/12/MCDM-2017-Keynote... · •Closer to Software Engineering, but with a social](https://reader033.fdocuments.us/reader033/viewer/2022051718/5a7261ed7f8b9aa2538d8962/html5/thumbnails/10.jpg)
The DesignScienceResearchProcess
![Page 11: Design Science Research: Theory Ingrained Artifactand ...sites.telfer.uottawa.ca/mcdm2017/files/2016/12/MCDM-2017-Keynote... · •Closer to Software Engineering, but with a social](https://reader033.fdocuments.us/reader033/viewer/2022051718/5a7261ed7f8b9aa2538d8962/html5/thumbnails/11.jpg)
ISDevelopment Process Nunamaker etal 1991
![Page 12: Design Science Research: Theory Ingrained Artifactand ...sites.telfer.uottawa.ca/mcdm2017/files/2016/12/MCDM-2017-Keynote... · •Closer to Software Engineering, but with a social](https://reader033.fdocuments.us/reader033/viewer/2022051718/5a7261ed7f8b9aa2538d8962/html5/thumbnails/12.jpg)
The DSRProcess by Hevner etal.2004Hevner et al./Design Science in IS Research
80 MIS Quarterly Vol. 28 No. 1/March 2004
Additions to the Knowledge Base
Environment IS Research Knowledge Base
People
ïRolesïCapabilitiesïCharacteristics
Organizations
ïStrategiesïStructure & CultureïProcesses
Technology
ïInfrastructureïApplicationsïCommunications ArchitectureïDevelopment Capabilities
Foundations
ïTheoriesïFrameworksïInstrumentsïConstructsïModelsïMethodsïInstantiations
Methodologies
ïData Analysis TechniquesïFormalismsïMeasuresïValidation Criteria
Develop/Build
ïTheoriesïArtifacts
Justify/Evaluate
ïAnalyticalïCase StudyïExperimentalïField Study ïSimulation
Assess Refine
Business Needs
Applicable Knowledge
Application in the Appropriate Environment
Relevance Rigor
Additions to the Knowledge Base
Environment IS Research Knowledge Base
People
ïRolesïCapabilitiesïCharacteristics
Organizations
ïStrategiesïStructure & CultureïProcesses
Technology
ïInfrastructureïApplicationsïCommunications ArchitectureïDevelopment Capabilities
Foundations
ïTheoriesïFrameworksïInstrumentsïConstructsïModelsïMethodsïInstantiations
Methodologies
ïData Analysis TechniquesïFormalismsïMeasuresïValidation Criteria
Develop/Build
ïTheoriesïArtifacts
Justify/Evaluate
ïAnalyticalïCase StudyïExperimentalïField Study ïSimulation
Assess Refine
Business Needs
Applicable Knowledge
Application in the Appropriate Environment
Relevance Rigor
Figure 2. Information Systems Research Framework
tified business need. The goal of behavioral-science research is truth.2 The goal of design-science research is utility. As argued above, ourposition is that truth and utility are inseparable.Truth informs design and utility informs theory. Anartifact may have utility because of some as yetundiscovered truth. A theory may yet to be devel-oped to the point where its truth can be incorpor-ated into design. In both cases, research assess-ment via the justify/evaluate activities can result inthe identification of weaknesses in the theory or
artifact and the need to refine and reassess. Therefinement and reassessment process is typicallydescribed in future research directions.
The knowledge base provides the raw materialsfrom and through which IS research is accom-plished. The knowledge base is composed offoundations and methodologies. Prior IS researchand results from reference disciplines providefoundational theories, frameworks, instruments,constructs, models, methods, and instantiationsused in the develop/build phase of a researchstudy. Methodologies provide guidelines used inthe justify/evaluate phase. Rigor is achieved byappropriately applying existing foundations andmethodologies. In behavioral science, methodol-ogies are typically rooted in data collection andempirical analysis techniques. In design science,computational and mathematical methods are
2Theories posed in behavioral science are principledexplanations of phenomena. We recognize that suchtheories are approximations and are subject to numer-ous assumptions and conditions. However, they areevaluated against the norms of truth or explanatorypower and are valued only as the claims they make areborne out in reality.
![Page 13: Design Science Research: Theory Ingrained Artifactand ...sites.telfer.uottawa.ca/mcdm2017/files/2016/12/MCDM-2017-Keynote... · •Closer to Software Engineering, but with a social](https://reader033.fdocuments.us/reader033/viewer/2022051718/5a7261ed7f8b9aa2538d8962/html5/thumbnails/13.jpg)
Peffers,Tuunanenetal.2007-8
![Page 14: Design Science Research: Theory Ingrained Artifactand ...sites.telfer.uottawa.ca/mcdm2017/files/2016/12/MCDM-2017-Keynote... · •Closer to Software Engineering, but with a social](https://reader033.fdocuments.us/reader033/viewer/2022051718/5a7261ed7f8b9aa2538d8962/html5/thumbnails/14.jpg)
Theorizingtheartifact
![Page 15: Design Science Research: Theory Ingrained Artifactand ...sites.telfer.uottawa.ca/mcdm2017/files/2016/12/MCDM-2017-Keynote... · •Closer to Software Engineering, but with a social](https://reader033.fdocuments.us/reader033/viewer/2022051718/5a7261ed7f8b9aa2538d8962/html5/thumbnails/15.jpg)
Abstraction inDSR
Abstract Problem
Abstract Solution
Instance Problem
Instance Solution
Solution search
Registration
AbstractionDe-Abstraction
Heje etal.DESRIST 2012
![Page 16: Design Science Research: Theory Ingrained Artifactand ...sites.telfer.uottawa.ca/mcdm2017/files/2016/12/MCDM-2017-Keynote... · •Closer to Software Engineering, but with a social](https://reader033.fdocuments.us/reader033/viewer/2022051718/5a7261ed7f8b9aa2538d8962/html5/thumbnails/16.jpg)
Theory development process Walls etal.1992
![Page 17: Design Science Research: Theory Ingrained Artifactand ...sites.telfer.uottawa.ca/mcdm2017/files/2016/12/MCDM-2017-Keynote... · •Closer to Software Engineering, but with a social](https://reader033.fdocuments.us/reader033/viewer/2022051718/5a7261ed7f8b9aa2538d8962/html5/thumbnails/17.jpg)
Anatomy ofaDesignTheory Gregor&Jones2007
![Page 18: Design Science Research: Theory Ingrained Artifactand ...sites.telfer.uottawa.ca/mcdm2017/files/2016/12/MCDM-2017-Keynote... · •Closer to Software Engineering, but with a social](https://reader033.fdocuments.us/reader033/viewer/2022051718/5a7261ed7f8b9aa2538d8962/html5/thumbnails/18.jpg)
Examplar ofaDesignTheory:SoftwareThresholdFault Policy Chiang andMookerjee 2004
![Page 19: Design Science Research: Theory Ingrained Artifactand ...sites.telfer.uottawa.ca/mcdm2017/files/2016/12/MCDM-2017-Keynote... · •Closer to Software Engineering, but with a social](https://reader033.fdocuments.us/reader033/viewer/2022051718/5a7261ed7f8b9aa2538d8962/html5/thumbnails/19.jpg)
TheArtifactasKnowledgeGregor andHevner 2013
19
Contributiontype ExamplesMoreabstract,complete,andmatureknowledge
↕↕↕↕
Morespecific,limited,andlessmatureknowledge
Level3.Well-developeddesigntheoryaboutembeddedphenomena
Designtheories(mid-rangeandgrandtheories)
Level2.Nascentdesigntheory– knowledgeasoperationalprinciples/architecture
Constructs,methods,models,designprinciples,technologicalrules.
Level1.Situatedimplementationofartifact
Instantiations(softwareproductsorimplementedmethods)