About people.tamu.edupeople.tamu.edu/~w-arthur/353/11C/PSYC 353 11C...Jan 11, 2011 · Author:...
Transcript of About people.tamu.edupeople.tamu.edu/~w-arthur/353/11C/PSYC 353 11C...Jan 11, 2011 · Author:...
-
PERSONNEL DECISIONSPERSONNEL DECISIONS
PSYC 353 11C personnel decisions 11/01/11 [Arthur] 1
-
Personnel Psychology subfield of I/O psychologyPersonnel Psychology – subfield of I/O psychology focusing on the management of human resources
Recruitment Selection
Training and developmentTeam selection andPlacement
Psychometrics Individual differences
Team selection and trainingLegal issues - Equal Emplo mentIndividual differences
Criterion developmentPerformance appraisal
Employment Opportunity, Title VII, CRA 1991
Performance appraisal
PSYC 353 11C personnel decisions 11/01/11 [Arthur] 2
-
A li t/ l fl th h d i t tiApplicant/employee flow through and interactions with various PERSONNEL systems
PSYC 353 11C personnel decisions 11/01/11 [Arthur] 3
-
• what to do with predictor or test scores now that we have them?that we have them?
• how do we decide who to select or hire?
PSYC 353 11C personnel decisions 11/01/11 [Arthur] 4
-
Overview of selection process
• Several stakeholders in selection processp– I/O psychologists– HR professionalsHR professionals– applicants– legal system (potentially)legal system (potentially)
PSYC 353 11C personnel decisions 11/01/11 [Arthur] 5
-
Overview of selection process
• I/O Psychologists– determine KSAOs needed
• job analysis
– develop assessment tools• validation studies
d t ff• recommend cutoff scores
– aware of . . .legal context• legal context
• applicant reactions
PSYC 353 11C personnel decisions 11/01/11 [Arthur] 6
-
Overview of selection process
• HR Professionals– application of assessment tools– make personnel selection decisionsa p o o d o
• social context– organizational image/culture– nepotism
• may deviate from recommendations and best practicespractices
PSYC 353 11C personnel decisions 11/01/11 [Arthur] 7
-
Overview of selection process
• ApplicantsApplicants– concerned with fairness and outcomes
• face validityface validity• procedural justice
• Legal systemLegal system– enforces Title VII, CRA, ADA/ADAA, ADEA
PSYC 353 11C personnel decisions 11/01/11 [Arthur] 8
-
Selection decisions
Job analysis
Development of predictors
y
predictors
Validate [& set cutoff]
Assess utility
Examine results
PSYC 353 11C personnel decisions 11/01/11 [Arthur] 9
Assess utility
-
Development of predictors
• Determine the KSAOs to be assessed and method of assessmentand method of assessment
• Conduct validation studycontent related validation study– content-related validation study• focus on extent to which test samples or
represents the domain of interestrepresents the domain of interest
– criterion-related validation study• focus on empirical relationship between p p
predictor and criterion– requires incumbent predictor and criterion data
t t l t d lid ti t dPSYC 353 11C personnel decisions 11/01/11 [Arthur] 10
– construct-related validation study
-
Multiple regression
• one predictor– Y = a + bX
Y = predicted criterion scorea = intercept; a constanta = intercept; a constantb = slope; weight associated with the predictor score based on the correlation with the criterion
– examplea = 50; b = .50
( )Y = 50 + .50 (X)
PSYC 353 11C personnel decisions 11/01/11 [Arthur] 11
-
Multiple regression
Y = job performance
X1 = programming skills
PSYC 353 11C personnel decisions 11/01/11 [Arthur] 12
-
Multiple regression
Y = job performance
X1 = cognitive abilityX2 = agreeableness
PSYC 353 11C personnel decisions 11/01/11 [Arthur] 13
-
Multiple regression
• Y = a + b1X1 + b2X2 + . . . bnXn• use multiple predictors in test battery touse multiple predictors in test battery to
account for more variance• predictors that correlate with criterion but p
NOT with each other• incremental validityy
PSYC 353 11C personnel decisions 11/01/11 [Arthur] 14
-
Multiple regression
Example of Hypothetical Predictor/Criterion Correlation Matrix
Measure Mean SD 1. 2. 3. 4. 5. 6. 7. 8.
1. Verbal Ability 43.57 9.84 .85
2. Math Ability 22.36 4.98 .22* .89
3. GMA 65.93 11.97 .91* .60* .91
4. Conscientiousness 5.36 0.79 .31* .33* .39* .91
5. Extraversion 37.20 6.88 -.02 .06 .01 .02 .77
6. Interpersonal skills 8.27 1.20 .08 .02 .07 .17* .09* .87
7. Leadership 17.48 3.16 .12* .16* .17* .08 .22* -.01 .86
8 Performance 4 91 0 98 10* 14* 14* 25* 21* 15* 32* 888. Performance 4.91 0.98 .10 .14 .14 .25 .21 .15 .32 .88
PSYC 353 11C personnel decisions 11/01/11 [Arthur] 15
-
Cross-validation
• Because of changes due to time, people, situations, and criteria, it is essential to make an independent check on the validity of measures used for predictivecheck on the validity of measures used for predictive purposes.
empiricalp– derivation sample– cross-validation sample
statistical estimationstatistical estimation
PSYC 353 11C personnel decisions 11/01/11 [Arthur] 16
-
Cutoff scores
• Type of cutoff score depends on . . .– validation study type
• content- versus criterion-related validation studystudy
– frame-of-reference• norm referenced• norm-referenced
– cutoff score is dependent on sample
• criterion-referenced– cutoff score is independent of sample
PSYC 353 11C personnel decisions 11/01/11 [Arthur] 17
-
Cutoff scores
Classification of Major Cutoff Score Methods
PSYC 353 11C personnel decisions 11/01/11 [Arthur] 18
-
Cutoff scores
• norm-referencednorm referencedmeanstandard deviationpercentilebase-rate
• criterion-referencedregression [ X = (Y – a) ÷ b ]70%Angoff procedure
PSYC 353 11C personnel decisions 11/01/11 [Arthur] 19
-
Cutoff scores
• Base rate: proportion of employees who are successfully performingy p gthe job
• Regression: X = (Y – a) ÷ b
• Angoff: average item probability that a minimally competent g g p y y pperson would answer the item correctly
PSYC 353 11C personnel decisions 11/01/11 [Arthur] 20
-
Cutoff scores
• bandinga group of scores are considered equivalent and not g p qdifferentiated between when making a selection decisionbased on the premise that reliability of test scores is NOT perfectpcalculated from the standard error of measurement (which is based on the reliability of the test scores)can be fixed or slidingcan be fixed or sliding
PSYC 353 11C personnel decisions 11/01/11 [Arthur] 21
-
Cutoff scores
• once cutoff scores have been set, then what?
rank and select top downrandom
th ?any others?
PSYC 353 11C personnel decisions 11/01/11 [Arthur] 22
-
Selection Decisions Outcomes and SomeSelection decision outcomes
Selection Decisions, Outcomes, and Some Factors That Influence Them
PSYC 353 11C personnel decisions 11/01/11 [Arthur] 23
-
Selection decisions
• classification outcomesA = true positivesB = true negativesC = false negativesgD = false positives
• costs associated with classification• costs associated with classification errors?
PSYC 353 11C personnel decisions 11/01/11 [Arthur] 24
-
Selection decisions
• classification decisions are influenced by:y
selection ratio (# openings ÷ # applicants)cutoff score (predictor)cutoff score (predictor)base rate (criterion “cutoff”)test validitytest validity
PSYC 353 11C personnel decisions 11/01/11 [Arthur] 25
-
Selection Decisions Outcomes and SomeSelection decisions – predictor cutoff
Selection Decisions, Outcomes, and Some Factors That Influence Them
PSYC 353 11C personnel decisions 11/01/11 [Arthur] 26
-
Selection decisions – predictor cutoff
P1
PSYC 353 11C personnel decisions 11/01/11 [Arthur] 27
-
Selection decisions – predictor cutoff
P2
PSYC 353 11C personnel decisions 11/01/11 [Arthur] 28
-
Selection decisions – base rate
C1
PSYC 353 11C personnel decisions 11/01/11 [Arthur] 29
-
Selection decisions – base rate
C2
PSYC 353 11C personnel decisions 11/01/11 [Arthur] 30
-
Selection decisions – test validity
10
7 5
10
ce
2 5
7.5
perf
orm
anc
0
2.5
Job
060 65 70 75
Cognitive ability
PSYC 353 11C personnel decisions 11/01/11 [Arthur] 31
-
Selection decisions – test validity
PSYC 353 11C personnel decisions 11/01/11 [Arthur] 32
-
Selection decisions – test validity
PSYC 353 11C personnel decisions 11/01/11 [Arthur] 33
-
Selection decisions – test validity
PSYC 353 11C personnel decisions 11/01/11 [Arthur] 34
-
Selection decisions – test validity
PSYC 353 11C personnel decisions 11/01/11 [Arthur] 35
-
Selection decisions
Strategies for Making Selection Decisions
• multiple regression approach• multiple regression approach• multiple cutoff approach
lti l h dl h• multiple hurdle approach
• characteristics?
PSYC 353 11C personnel decisions 11/01/11 [Arthur] 36
-
Utility AnalysisUtility Analysis
• value of personnel decisions to the organizationorganization
• determined by:lidit f th di tvalidity of the predictor
cost to administer the predictor# of people who do the job# of people who do the job# of people hired each yeartypical tenure in the jobtypical tenure in the job
PSYC 353 11C personnel decisions 11/01/11 [Arthur] 37
-
Utility analysis
∆U = (NS × T × SDy × rxy × Zx) – (NA × C)
• ∆U = increase in average dollar-valued payoff resultingfrom use of selection procedure over randomselection
• T = expected tenure of selected group• rxy = correlation between selection procedure scores and
criterion scores (validity of test)criterion scores (validity of test)• SDy= standard deviation of dollar-valued job performance• Zx = average standard predictor score of selected groupx g p g p• NS = number of applicants selected• NA = number of applicants testedC t f t ti li t
PSYC 353 11C personnel decisions 11/01/11 [Arthur] 38
• C = cost of testing one applicant
-
Utility analysis
• High Performance Work Systemsselective staffingselective staffingcomprehensive trainingdevelopmental performance appraisaldevelopmental performance appraisalequitable reward systemsperformance based payperformance-based pay
PSYC 353 11C personnel decisions 11/01/11 [Arthur] 39
-
Legal Issues
Legal issues
Legal Issues
1964 Civil Rights Act (Title VII) and CRA 1991g ( )• cannot make employment-related decisions on basis of
protected class status/variable• protected classes race sex religion color and national• protected classes race, sex, religion, color, and national
origin• “employment-related decisions” covers all personnel
decisions such as selection training promotion retentiondecisions such as selection, training, promotion, retention, and performance appraisal
PSYC 353 11C personnel decisions 11/01/11 [Arthur] 40
-
Legal issues
• CRA 1991 explicitly prohibits test score adjustments
• Equal Employment Opportunity Commission (EEOC)
PSYC 353 11C personnel decisions 11/01/11 [Arthur] 41
-
Legal issues
Theories of discrimination• disparate treatmentp• disparate impact (adverse impact)
4/5th or 80% rulesignificance testssignificance tests
PSYC 353 11C personnel decisions 11/01/11 [Arthur] 42
-
Legal issues — disparate impact
S
• 80% rule
Sex
Male FemaleApply 100 200Apply 100 200
Hire 20 180
Selection rate 20% 90%Selection rate 20% 90%
d i t 20 90 22%• adverse impact = 20 ÷ 90 = 22%
• < 80% so have adverse impact
PSYC 353 11C personnel decisions 11/01/11 [Arthur] 43
-
Legal issues — disparate impact
Legal defenses to adverse impact• job-relatedness (i.e., validity)j ( , y)• bona fide occupational qualification (BFOQ)• business necessity
PSYC 353 11C personnel decisions 11/01/11 [Arthur] 44
-
Legal issues
Major Court Cases• Griggs v Duke Power Company (1971)• Griggs v. Duke Power Company (1971)
– burden of proof on defendant not plaintiff• Albemarle Paper Company v. Moody (1975)
– job analysis– job analysis• Bakke v. University of California (1978)
– “reverse” discrimination• Watson v Fort Worth Bank & Trust (1988)• Watson v. Fort Worth Bank & Trust (1988)
– what is a “test” interviews– cost of alternative predictors can be a consideration
• Wards Cove Packing Company v Antonio (1989)• Wards Cove Packing Company v. Antonio (1989)– modified burden of proof guidelines; served as impetus for
CRA 1991
PSYC 353 11C personnel decisions 11/01/11 [Arthur] 45
-
Legal issues
1967 Age Discrimination in Employment Act (ADEA)Act (ADEA)• employees 40 yrs of age and older• prevent older employees from being singledprevent older employees from being singled
out during cutbacks• 1990 Older Workers Benefit Protection Act
PSYC 353 11C personnel decisions 11/01/11 [Arthur] 46
-
1990 A i ith Di biliti A t (ADA
Legal issues
1990 Americans with Disabilities Act (ADA; ADAAA)• 43 million Americans have a disability• 43 million Americans have a disability• disability physical or mental impairment
that limits one or more “major life activity”• prohibits discriminating against “qualified
individuals” (can perform “essential” functions)functions)
• provide reasonable accommodations• employers with 15 or more employees• up to $300,000 in compensatory & punitive
damages
PSYC 353 11C personnel decisions 11/01/11 [Arthur] 47
-
Legal issues
Affirmative Action• NOT a psychometric issuep y• social policy aimed at reducing the effects of prior
discrimination• although EEOC guidelines stipulate that only govt• although EEOC guidelines stipulate that only govt
employers and govt contractors must have written affirmative action policies, many private sector employers do so as wellemployers do so as well
believe it makes good business sense• 3 Goals
correct past inequitiescompensate past inequities [court ordered and supervised]promote diversity
PSYC 353 11C personnel decisions 11/01/11 [Arthur] 48
• NOT quotas
-
Legal issues
Types or levels of affirmative action• recruitment• removing discriminatory obstacles• soft preferential treatment
h d f i l (ill l)• hard preferential treatment (illegal)• diversity [targeted recruitment]
PSYC 353 11C personnel decisions 11/01/11 [Arthur] 49