SYSTEM TESTING AND DEPLOYMENT Lecture Seven (Chapter 7, Notes; Chapter 8, Textbook)

SYSTEM TESTING AND DEPLOYMENT

Lecture Seven

(Chapter 7, Notes;

Chapter 8, Textbook)

7-2

Chapter 7: System Testing and Deployment

System Testing & Deployment after Knowledge Codification

KNOWLEDGE CAPTURE(Creation)

KNOWLEDGE TRANSFER

KNOWLEDGESHARING

TESTING AND DEPLOYMENT

KNOWLEDGE CODIFICATION

KNOWLEDGE BASE

DATABASES

Shells, tables,tools, framesmaps, rules

Capture ToolsPrograms,

books, articles, experts

Intelligence gathering

Explicit Knowledge

7-3


Stages of KMSLCEvaluate Existing

Infrastructure

Knowledge Capture

Design KM Blueprint

Verify and validate the KM System

Implement the KM System

Manage Change and Rewards Structure

Form the KM Team

Post-system evaluation

Iterative Rapid Prototyping

7-4


Quality Assurance KM system should meet expectations of

members represented in the KM team. Performance depend highly on quality of

explicit/tacit knowledge stored in KB. For expert, quality relates to reasoning

process that produces reliable and accurate solutions.

For user, quality relates to system’s ease of use and efficiency.

For knowledge developer, quality relates to how valid the knowledge sources are and how well they are codified into KB.

7-5


KMS TestingTo control quality, performance

and efficiency of both KB and KMS.

Types of Testing Logical Testing, make sure that

the system produces correct results.

User Acceptance Testing, follows logical testing and check system’s behaviour in a realistic environment.

7-6


Hurdles in KMS TestingSubjective nature of tacit

knowledge. Lack of reliable specifications to

guide testingHow to decide whether

knowledge is completeHuman errorsLack of timeUser interface un-friendly

7-7


Logical Testing ApproachesKnowledge base formation

Structure of knowledge as it relates to circular or redundant errors

Consistency, correctness, and completeness of knowledge base rules

Knowledge base functionality Confidence Reliability of knowledge base

7-8


Logical Errors Circular errors - contradictory in

meaning or logic Redundancy errors - offer different

approaches to the same problem Unusable knowledge - comes up no

matter conditions succeed or fail Subsumption errors - if one rule is

true, one knows the second rule is always true

Inconsistent knowledge - the same inputs yield different results

7-9


User Acceptance Testing ApproachSelect a person or a team for testingDecide on user acceptance test criteriaDevelop a set of test cases unique to

the systemMaintain a log on various versions of

the tests and test resultsField-test the system

7-10


Requirements for Test Team Independent of the design or

codification of the system Understand the knowledge

problem and computer technology

Well versed in the organization’s goals

Know how the system being tested will fit into the designated area of operation

7-11


Content of Test Plan Items of KM system that

require testingSchedule of user

acceptance testingDescription of test methods

that are approved by user and company

Guidelines for documenting test results

7-12


User Acceptance CriteriaAccuracy and correctness of

outcome for test itemsAdequacy of the solutionsAdaptability to novel inputEase of useFace validity or credibilityRobustnessTechnical/operational test

7-13


User Acceptance Test Techniques

Face validation

Test Cases

Sub-systems validation

7-14


Factors affecting System DeploymentTechnical

Organizational

Procedural

Behavioural

Political

Economical

7-15


Steps in KMS Deployment

Transfer of KM System from knowledge developer to the organization’s operating unit.

Transfer of KM’s skills from knowledge developer to the organization’s operators.

7-16


Successful KM System Deployment User has prior experience with

computer applications User has been involved in the

building of the KM system Benefits of the KM system is

immediate and measurable First impression Management support the

system from start Adequate user training

7-17


Factors affecting User TrainingPrimary

The user’s knowledge of knowledge-based system

Complexity of KM system and user interface’s ease of use

Secondary Trainer’s technical experience/

communication skills Environment of training venue

7-18


Pre User Training Session Define how the KM system agrees

with organizational mission Demonstrate how the system can

support organizational goals Allocate adequate resources for the

training project Advocate positive effects of the

system Explain cost-benefit analysis of the

KM system

7-19


Overcome Resistances to Change

User attitude survey

Communication sessions

Role negotiation

7-20


Post-Implementation Review How KM System has

changed accuracy/timeliness of decision making

How KM System has affected attitude of end users

Whether the system has caused constructive organizational changes?

Whether the system has benefited the operation cost?

7-21


Security IssuesThe new system should

provide password / protocol protection.

Security procedures should be consistently observed.

Access should be restricted regarding update of the KB.

7-22


Circular ErrorsRule 1:

IF John and Rob are co-owners of company A

THEN John and Rob own the same company

Rule 2: IF John and Rob own the same

company

THEN John and Rob are co-owners

7-23


Redundancy ErrorsRule 1:

IF (Salary > 50,000 OR HOME > 100,000)

THEN Loan = ‘yes’

Rule 2: IF (Salary > 60,000)

THEN Loan = ‘yes’

7-24


Unusable Knowledge

IF humidity is 5% AND heavy_rain = ‘yes’

THEN some actionssome actions

7-25


Subsumption ErrorsRule 1:

IF A AND B, THEN D

Rule 2: IF A AND B AND C, THEN D

SYSTEM TESTING AND DEPLOYMENT Lecture Seven (Chapter 7, Notes; Chapter 8, Textbook)

Documents

Transcript of SYSTEM TESTING AND DEPLOYMENT Lecture Seven (Chapter 7, Notes; Chapter 8, Textbook)