COLLEGE3PD2005 1

20-9-2004 M & S I-BA1- psychologie 1

DEEL II FORMELE BENADERING: Wat is diagnostiek; diagnostisch proces? Hoofdstuk 4 en 5.

COLLEGE3PD2005 2

Reminding Part I: History, Controversy, Current situation

Review book: I and II 3 x3 and III; Chapter 10: QualityIntroduction: Assessment as “phenomenon”

-Who is the client?-Who is the diagnostician/assessor?

Chapter 1: Historical Review of Testing Movement Chapter 2: Controversy: Clinical vs Statistical predictionChapter 3: Present: Assessment in theory and practice in the

Netherlands

Assessment: Part IIFormal approach 21-9-05

COLLEGE3PD2005 3

What is Psychological Assessment?

• Page 29 (Ch. 1): preliminary definition

Inquiry, judgment of a client’s behaviors

In order to describe, diagnose, predict, explain (problematic) behaviors

• Chapter 4: A formal systematic definition, I.e., including all elements and relations of assessment a comprehensive definition.

COLLEGE3PD2005 4

What is Psychological Assessment? 1. Assessment: No “own” formal and material object! No separate

psychological discipline!2. Current definitions stress a salient element, I.e.,

-individual differences and selection-decision process; problem solving-hypothesis testing model (HTM)

3. A comprehensive definition includes all elements and their relations!

COLLEGE3PD2005 5

PsychologicalAssessmentThree inevitable elements, components:

1. Behavioral theories / constructs: e.g., intelligence, personality characteristics,

deviant behavior 2. Models to depict these constructs:

e.g., unidimensional scales to depict individual differences

3. Instruments: Tests, questionnaires

COLLEGE3PD2005 6

Relations between three components

• Six possible paths; • Three familiar and important:

1. Theoretical / conceptual path: Conceptual analysis of behavior measurement model instrument/test

2. Practical path:Instrument measurement model theory/construct

3. Psychometric theory path:IRT modelinstrument behavioral construct.

COLLEGE3PD2005 7

COMPONENTs PERSPECTIVES

DOMEINEN

Folk

Theories

or

Implicit

Theories/

Concepts

Or even

“Theodicees”(Swheder)

Historical

Philosophical

Background

Theory of science

THEORY/

CONSTRUCT

IND.DIFFERENCES

TYPICAL -

MAX.PERFORMANCE

SITUATION

ALTER-

NATIVES

DEVELOPMENT

TYPICAL-

MAX.PERFORMANCE

SITUATION

ALTER-

NATIVES

CONTEXT/

ENVIRONMENT

TYPICAL-

MAX.PERFORMANCE

SITUATION

ALTER-

NATIVES

MODEL/

MEASUREMENT

INDIVIDUAL DIFFERENCES

TYPICAL-

MAX.PERFORMANCE

SITUATION

ALTER-

NATIVES

DEVELOPMENT

TYPICAL- MAX.PERFORMANCE

SITUATION

ALTER-

NATIVES

CONTEXT/

ENVIRONMENT

TYPICAL-

MAXIPERFORMANCE

SITUATION

ALTER-

NATIVES

INSTRUMENTS:

TESTS, SCALES, QUESTIONNAIRES

INDIVIDUAL DIFFERENCES

TYPICAL-

MAX.PERFORMANCE

SITUATION

ALTER-

NATIVES

DEVELOPMENT

ALTER-

NATIVES

CONTEXT/

ENVIRONMENT

TYPICAL-

MAXIMUM PERFORMANCE

SITUATIONERSOON

PRESTATIE

PLEK

ALTER-

NATIVES

COLLEGE3PD2005 8

Component 1: Theories /constructs

• Three perspectives to describe/explain “behaviors” (i.e., cognition, motivation, feeling, behavior):

• 1. Individual differences• 2. Development• 3. Context / adaptationMost theories/constructs in handbooks can be

ordered in 1,2, 3. Try to order some familiar psychological constructs

in 1, 2 ,3

COLLEGE3PD2005 9

Component 2: Models

• Depicting behaviors using measurement models:• Specific role in assessment of :

a. Classical Test Theory: model for estimating random errors in measurements.

b. Item Response Theory: collection of IRF’s specifying the probability of an answer as a function of a latent “trait”.a. model for errors: no contentb. (small) model for (tiny) content

COLLEGE3PD2005 10

Component 3: Tests, questionnaires

• Typical performance• Maximum performance• Paper and pencil tests• Multiple choice / open questions• Objective • Subjective /projective• Observation/ talking with a client?• Definition (Drenth & Sijtsma)

COLLEGE3PD2005 11

Inleiding op diagnostisch proces: Video persoonlijkheidsonderzoek: Let op:

• Psychologische constructen

• Instrumenten

• Informatie integratie

• Betrokken subdisciplines

• Hoe , welke vorm zullen de adviezen hebben?

COLLEGE3PD2005 12

• What is the question? (See video “Personality Investigation” for the court)

• Not theory/construct per se; not CTT, or IRT or test or questionnaire, but

• Answering the question of a client• The assessing professional needs knowledge of

three components; moreover • Assessment is a judgment process using

information about the behaviors of a client and his/her environment.

Chapter 5 the assessment process

COLLEGE3PD2005 13

Assessment Process: • Judges are fallible

• Defining failure implies criteria:– Rules of logic– Statistical rules: Cfr. clinical vs statistical

prediction.

Solution:

Assessment is scientific research; sort of; resembles the empirical cycle

COLLEGE3PD2005 14

Assessment Process• The process is conducted according to the hypotheses

testing model (HTM).• The steps are described on page 155 and 156.• One step is hypothesis testing.• This model rules now (in Belgium and the

Netherlands). • Every judgment can be modeled as an information

processing task• Due to the work of Tversky and Kahneman we know

failures in information processing

COLLEGE3PD2005 15

Alternatives to the HTM

• Stressing the dialogue

• Rhetoric and argumentation

• A story with a plot: a good story– The experiment can also be modeled as a

“romantic” story, let’s try.

COLLEGE3PD2005 16

Modeling the assessment process

• Brunswik’s model • Regression models• Decision aids: MAUT en Bayes rule

• The assessment process is the core of assessment.• Complex: three components; the process of

information integration; probabilistic nature; information processing failures