Objective Knowledge Elicitation Interview Case Study Answers Questions Domain Expert Knowledge...
-
Upload
esteban-elsworth -
Category
Documents
-
view
219 -
download
0
Transcript of Objective Knowledge Elicitation Interview Case Study Answers Questions Domain Expert Knowledge...
Knowledge Acquisition
سورنا ناصر مقدسی
Table of Contents
Difficulties with Knowledge Acquisition
Roles of Elicitation Team Members
Knowledge Elicitation Tasks
Overview
Types of Knowledge
Sources of Knowledge
Time Requirements for Knowledge Acquisition
Case Study Method
Interview Method
Comparison of Elicitation Methods Knowledge
Analysis
Overview
Overview Objective Knowledge Elicitation
Interview Case Study
Answers
QuestionsDomainExpert
Knowledge
EngineerResults
Knowledge
ExpertSystem
Types Of Knowledge
Types of Knowledge
Procedural Knowledge RulesStrategiesAgendaProcedures
Declarative Knowledge ConceptsObjectsFacts
Meta-Knowledge Knowledge about the other types of knowledge and how to use them
Heuristic Knowledge Rules of Thumb
Structural Knowledge Rule SetsConcept Relationships
Sources of Knowledge
Sources of Knowledge
Expert End-User Multiple Experts Literature
Reports Books Regulations Guidelines
Knowledge Elicitation Tasks
Knowledge Elicitation Tasks Collect
Task of acquiring knowledge from the expert Interpret
Review/Identify key pieces of knowledge Analyze
Gain insight into forming theories on the organization of the knowledge and problem-solving strategies
Design Form new understanding of the problem that can aid further
investigation
Time Requirements For Knowledge Acquisition
Time Requirements For Knowledge Acquisition
Hours
ConductingInterpretingAnalyzingDesigning
Difficulties With Knowledge Acquisition
Difficulties With Knowledge Acquisition
Psychological View of Elicitation Problems Unaware of Knowledge Used Unable to Verbalize the Knowledge Provides Irrelevant Knowledge Provides Incomplete Knowledge Provides Incorrect Knowledge Provides Inconsistent Knowledge
Roles of The Elicitation Team Members
Roles of The Elicitation Team Members
End-User Provide Overview Define Interface Requirements Define Explanation Requirements Help Define In-Place Operational Requirements Aid System Development
Expert Provide Knowledge Aid Interpretation Aid Testing
Knowledge Engineer Collect Knowledge Interpret and Analyze Knowledge Design New Session Manage Project
Interviewing Method- Managing the Interview- Unstructured Interview- Structured Interview- Problems With Interviewing
Managing The Interview
The First Team Meeting Remove Fear Remove Skepticism Establish Reasonable Goals Promote Openness To Change Provide Understanding of Expected Effort Convey Importance of Involvement
Guidelines for the First Team Meeting(Preparing The Interview)
Prepare Agenda Scheduling Materials List Tape Recording Video Recording
Managing The Interview(Cont’d) Beginning the Interview
Set Initial Tone Review Agenda
Conducting the Interview Following the Agenda Types of Questions
Direct Indirect
Good Question Design Avoid Multiple Part Questions Avoid Leading Questions Avoid Negative Questions Avoid Universal Questions Avoid the Use of Foreign Terms Avoid Subjective Terms
Managing The Interview(Cont’d)
Question Sequence Funnel Sequence
Active Listening Interruptions
Pros: Clarifying an unknown issue, Requesting more details Cons: disrupt the expert’s train of thought, loss of information Interrupting the expert during a declarative discussion Interrupting the expert during a procedural discussion
Ending the Interview Review the key findings Review any outstanding questions that were raised during the
interview Discuss the unattended agenda items Discuss the future direction of the discussion Extend appreciation to the team members for their time and
information
Unstructured Interview
Overview and Example Ask a general question and see where it goes! The Satellite ES Example
Guidelines Pose an initial prompt or indirect question Interrupt the session with probe questions to explore
significant issues
Be cautious with interruptions Gain an understanding of the important concepts and plan
future interviews
Advantages and Disadvantages Provides a general understanding of the problem Helps identify important concepts and objects Provides insight into general problem solving methods Allows for spontaneity in the interview
Advantages and Disadvantages(Cont’d)
Information collected may be overwhelming, fragmented or shallow
Provides very little factual information Provides few details on concepts or objects Provides few details on procedural information
Structured Interview
Overview and Example Use it when you need specific information The Farm Example
Guidelines choose a specific topic Identify new concepts from the discussion Continue this process until enough details are obtained then
return to one of the new concepts mentioned earlier and ask for further discussion
Gain an understanding of the important concepts and their relationships, rules and strategies from the transcripts
Advantages and Disadvantages Maintains a focus on a given issue provides detailed information on the issue Provides insight into declarative knowledge used Study of one concept can lead to the definition of other
unknown related concepts
Advantages and Disadvantages(Cont’d)
Provides structural relationship of concepts
Concepts unrelated to the interview’s focus may not be found You must be secure in your understanding of the important
issues to direct the interview Provides only weak insight into procedural knowledge such as
rules or problem solving strategies
Problems with Interviewing Recalling Procedural Knowledge Ineffective Long-Term Memory Verbalizing Manual Tasks Verbalizing Compiled Knowledge Lacks Context
Case Study- Retrospective Case Study Method- Observational Case Study Method
Retrospective Case Study Method
Directions to Expert Forming the Protocol
The Ventilation System Example Guidelines for a Retrospective Case Study
Choose a Typical Case Ask the expert to explain how he solved the problem Record the expert’s discussion Highlight important issues Be careful of interruptions
Advantages and Disadvantages
Observational Case Study Method
Directions to Expert Concurrent Protocol Thinking Aloud
Example Guidelines for a Retrospective Case Study Advantages and Disadvantages
Observational Study of the Familiar Case Example Guidelines Advantages and Disadvantages
Observational Study of the Unfamiliar Case Example Guidelines Advantages and Disadvantages
Comparison of Elicitation Methods
- Knowledge Analysis
Capability of Elicitation Technique for Obtaining Knowledge
Interviewing Case Study
Retrospective Observational
Knowledge Type
Unstructured
Structured
Familiar Unfamiliar Familiar Unfamiliar
Facts Poor Good Fair Average Good Excellent
Concepts Excellent Excellent Average Average Good Good
Objects Good Excellent Average Average Good Good
Rules Fair Average Average Average Good Excellent
Strategies Average Average Good Good Excellent Excellent
Heuristics Fair Average Excellent Good Good Poor
Structures Fair Excellent Average Average Average Average
Capability of Elicitation Technique for Obtaining Knowledge
Interviewing Case Study
Retrospective Observational
Problem Type
Unstructured
Structured
Familiar Unfamiliar Familiar Unfamiliar
Unaware of Knowledge
Poor Fair Average Average Good Excellent
Unable to Verbalize
Knowledge
Fair Fair Average Average Average Good
Irrelevant Knowledge
Poor Average Average Average Average Good
Incomplete Knowledge
Average Average Poor Average Average Excellent
Incorrect Knowledge
Average Average Poor Average Average Excellent
Inconsistent Knowledge
Average Average Poor Fair Fair Excellent
Knowledge Analysis
Producing the Transcript Interpreting the Transcript Analyzing the Transcript Recording the Knowledge Relating the Knowledge Reviewing the Knowledge Structuring the Knowledge Graphically
Cognitive Maps Inference Networks Flowcharts Decision Trees
Cognitive Maps
Employees
Managers
Bob
Engineers
JaneMary
Age
Salary
Unknown
10K – 100K
Job
Salary
Bonus
Salary
Age
Age
Age
Salary
Salar
y
Sal
ary
Job
Job
Job
Yes, No Research, Design
30K – 60K50K – 80K
45
65K
Yes24
32KDesign
27
40K Research
Inference Networks
Weather Prediction is Rain
Barometric Pressure Falling
Wind Conditions Indicates Rain
Wind Gusty
Wind Speed > 5
Knots
Wind Direction From East
Temperature Moderate
60 < Temp < 80
Rule 7
Rule 8Rule 10
Rule 9 OR
AND
FlowchartsBlood
Disease Diagnosis
Obtain Initial Data
Can Form Hypothesis
Consult Specialist
Ask Questions Related to Hypothesis
Hypothesis Right
Run Tests to Confirm
Hypothesis
Prescribe Remedy
Tests Confirm Hypoth
esis
N
Y
N
YN
Y
Decision Tree
Terminals
Battery Voltage
ChargerDistributer
Not Loose Loose
Tighten Terminals
>12 <12
OKBADBADOKReplace BatteryReplace charger
Replace DistributerCheck Starter
سوال؟