Department of Organizational and Social Psychology Institute of Psychology, Humboldt University
description
Transcript of Department of Organizational and Social Psychology Institute of Psychology, Humboldt University
![Page 1: Department of Organizational and Social Psychology Institute of Psychology, Humboldt University](https://reader035.fdocuments.us/reader035/viewer/2022062520/568161d0550346895dd1c5ea/html5/thumbnails/1.jpg)
1
Perceptive Agile Measurement:New Instruments for Quantitative Studies
in thePursuit of the Social-Psychological Effect of
Agile Practices
Department of Organizational and Social PsychologyInstitute of Psychology, Humboldt University
Rudower Chaussee 18, 12489 Berlin, Germany
XP (May, 2009)
2010/05/19
![Page 2: Department of Organizational and Social Psychology Institute of Psychology, Humboldt University](https://reader035.fdocuments.us/reader035/viewer/2022062520/568161d0550346895dd1c5ea/html5/thumbnails/2.jpg)
2
Outline
• Introduction
• Theoretical Framework
• Method
• Results
2010/05/19
![Page 3: Department of Organizational and Social Psychology Institute of Psychology, Humboldt University](https://reader035.fdocuments.us/reader035/viewer/2022062520/568161d0550346895dd1c5ea/html5/thumbnails/3.jpg)
3
Introduction
• Growing interest in psychological aspects within the agile software domain
• Many studies have applied qualitative research methods and found positive results of specific agile practices
• Future research must therefore corroborate these qualitative findings using quantitative methods
2010/05/19
![Page 4: Department of Organizational and Social Psychology Institute of Psychology, Humboldt University](https://reader035.fdocuments.us/reader035/viewer/2022062520/568161d0550346895dd1c5ea/html5/thumbnails/4.jpg)
4
Introduction (Conti.)
• Many claims about positive effects on social phenomena
• Question: Whether these claims can be substantiated in quantitative studies?
• This study aimed to develop appropriate measurement instruments
2010/05/19
![Page 5: Department of Organizational and Social Psychology Institute of Psychology, Humboldt University](https://reader035.fdocuments.us/reader035/viewer/2022062520/568161d0550346895dd1c5ea/html5/thumbnails/5.jpg)
5
Outline
• Introduction
• Theoretical Framework
• Method
• Results
2010/05/19
![Page 6: Department of Organizational and Social Psychology Institute of Psychology, Humboldt University](https://reader035.fdocuments.us/reader035/viewer/2022062520/568161d0550346895dd1c5ea/html5/thumbnails/6.jpg)
6
Theoretical Framework
First:• The measurement of agile practices is effected
by the angle of perception
• The theoretical underpinning derive from the fundamental psychological mechanism– individuals’ behavior and choices are more
influenced by their perceptions of situations and contexts than by the objective factual situation
2010/05/19
![Page 7: Department of Organizational and Social Psychology Institute of Psychology, Humboldt University](https://reader035.fdocuments.us/reader035/viewer/2022062520/568161d0550346895dd1c5ea/html5/thumbnails/7.jpg)
7
Theoretical Framework (Conti.)
Second:• Selection of agile practices:– establish a representative set of agile practices
commonly used in the field
• This set was intended to provide a solid basis for the process of scale construction and validation of agile practices
2010/05/19
![Page 8: Department of Organizational and Social Psychology Institute of Psychology, Humboldt University](https://reader035.fdocuments.us/reader035/viewer/2022062520/568161d0550346895dd1c5ea/html5/thumbnails/8.jpg)
8
Theoretical Framework (Conti.)
• Pursue the following agile practices– Iteration planning– iterative development– continuous integration & testing– stand-up meetings– customer acceptance tests– customer access– retrospectives– co-location
2010/05/19
![Page 9: Department of Organizational and Social Psychology Institute of Psychology, Humboldt University](https://reader035.fdocuments.us/reader035/viewer/2022062520/568161d0550346895dd1c5ea/html5/thumbnails/9.jpg)
9
Outline
• Introduction
• Theoretical Framework
• Method
• Results
2010/05/19
![Page 10: Department of Organizational and Social Psychology Institute of Psychology, Humboldt University](https://reader035.fdocuments.us/reader035/viewer/2022062520/568161d0550346895dd1c5ea/html5/thumbnails/10.jpg)
10
Method
• This framework to develop measurement instruments for agile practices in this study is derived from the methodology of scale construction
• Psychological scale construction follows several qualitative methods for item generation and quantitative methods for the validation of established scales
2010/05/19
![Page 11: Department of Organizational and Social Psychology Institute of Psychology, Humboldt University](https://reader035.fdocuments.us/reader035/viewer/2022062520/568161d0550346895dd1c5ea/html5/thumbnails/11.jpg)
11
Method (Conti.)
• Choose internal consistency as the main measure for reliability and analyzed convergent validity and discriminant validity (often summarized as construct validity) by explorative factor analyses
2010/05/19
![Page 12: Department of Organizational and Social Psychology Institute of Psychology, Humboldt University](https://reader035.fdocuments.us/reader035/viewer/2022062520/568161d0550346895dd1c5ea/html5/thumbnails/12.jpg)
12
Method (Conti.)
Sample:• Team members (N = 227) of 55 software
development teams applying agile practices across industries were tested
• The sample consisted of project and product release teams, spread over 15 countries
• Work experience
2010/05/19
![Page 13: Department of Organizational and Social Psychology Institute of Psychology, Humboldt University](https://reader035.fdocuments.us/reader035/viewer/2022062520/568161d0550346895dd1c5ea/html5/thumbnails/13.jpg)
13
Method (Conti.)
Procedure:• The field study was conducted through a web-
based questionnaire• The agile practices’ part of the main
questionnaire in three subsequent phases, followed by the final study:– Item Generation– Pretest 1– Pretest 2
2010/05/19
![Page 14: Department of Organizational and Social Psychology Institute of Psychology, Humboldt University](https://reader035.fdocuments.us/reader035/viewer/2022062520/568161d0550346895dd1c5ea/html5/thumbnails/14.jpg)
14
Method (Conti.)
Procedure:
2010/05/19
![Page 15: Department of Organizational and Social Psychology Institute of Psychology, Humboldt University](https://reader035.fdocuments.us/reader035/viewer/2022062520/568161d0550346895dd1c5ea/html5/thumbnails/15.jpg)
15
Method (Conti.)
Procedure:• Final Study– The final study was conducted between 26
October 2008 and 31 January 2009. From the pool of 260 formally invited persons, a total of 87.3% (N=227) in 55 software development teams completed the main questionnaire containing 43 items about agile practices
2010/05/19
![Page 16: Department of Organizational and Social Psychology Institute of Psychology, Humboldt University](https://reader035.fdocuments.us/reader035/viewer/2022062520/568161d0550346895dd1c5ea/html5/thumbnails/16.jpg)
16
Method (Conti.)
Optimizing Variance Explained:• In pretest 1, a 5-point Likert scale format
ranging from1 (not at all) to 5 (totally) was used.
• To increase variance explained in the final study according to Lozano [11], the number of response categories was extended by two additional points to a 7-point Likert scale
2010/05/19
![Page 17: Department of Organizational and Social Psychology Institute of Psychology, Humboldt University](https://reader035.fdocuments.us/reader035/viewer/2022062520/568161d0550346895dd1c5ea/html5/thumbnails/17.jpg)
17
Method (Conti.)
Content Validity:• The experts were asked for each agile practice
scale to comment on a number of aspects including:– do the question correctly reflect the main
characteristics of this agile practice?– would you add any question?
2010/05/19
![Page 18: Department of Organizational and Social Psychology Institute of Psychology, Humboldt University](https://reader035.fdocuments.us/reader035/viewer/2022062520/568161d0550346895dd1c5ea/html5/thumbnails/18.jpg)
18
Method (Conti.)
Content Validity:• Solicited open feedback by means of a comment
functionality in the used survey tool– This feedback was collected and systematically
compared with prior feedback, merged and integrated into the next questionnaire version
– This whole process was repeated several times during each stage until feedback from all involved experts converged to satisfaction with content validity
2010/05/19
![Page 19: Department of Organizational and Social Psychology Institute of Psychology, Humboldt University](https://reader035.fdocuments.us/reader035/viewer/2022062520/568161d0550346895dd1c5ea/html5/thumbnails/19.jpg)
19
Method (Conti.)
Reliability:• A scale is regarded to be reliable if there is little
variance that is specific to particular items• The most wide-spread measure used in psychological
research for reliability is internal consistency• The most commonly used statistic for internal
consistency is Cronbach α• Acceptable values of α coefficients are generally
regarded in the range of 0.75 and above
2010/05/19
![Page 20: Department of Organizational and Social Psychology Institute of Psychology, Humboldt University](https://reader035.fdocuments.us/reader035/viewer/2022062520/568161d0550346895dd1c5ea/html5/thumbnails/20.jpg)
20
Method (Conti.)
Factor Structure:• The according standard validation method
during scale construction is explorative factor analysis
• The goal of this method is to test for a clear factor structure which is defined by convergent validity and discriminant validity
2010/05/19
![Page 21: Department of Organizational and Social Psychology Institute of Psychology, Humboldt University](https://reader035.fdocuments.us/reader035/viewer/2022062520/568161d0550346895dd1c5ea/html5/thumbnails/21.jpg)
21
Method (Conti.)
Factor Structure:• Agile practices are mostly applied at the same
time– applying the oblique rotation technique direct
quartimin which allows maximum possible correlation in the solution as described by Gorsuch
– choose to apply principal factor analysis (PFA) in favor of principal components analysis (PCA)
2010/05/19
![Page 22: Department of Organizational and Social Psychology Institute of Psychology, Humboldt University](https://reader035.fdocuments.us/reader035/viewer/2022062520/568161d0550346895dd1c5ea/html5/thumbnails/22.jpg)
22
Outline
• Introduction
• Theoretical Framework
• Method
• Results
2010/05/19
![Page 23: Department of Organizational and Social Psychology Institute of Psychology, Humboldt University](https://reader035.fdocuments.us/reader035/viewer/2022062520/568161d0550346895dd1c5ea/html5/thumbnails/23.jpg)
23
Result
• The results of the statistical analysis methods applied– reliability analysis and explorative factor analysis
employing principal factor extraction and direct oblimin rotation
2010/05/19
![Page 24: Department of Organizational and Social Psychology Institute of Psychology, Humboldt University](https://reader035.fdocuments.us/reader035/viewer/2022062520/568161d0550346895dd1c5ea/html5/thumbnails/24.jpg)
24
Result (conti.)
• Reliable Analysis
2010/05/19
![Page 25: Department of Organizational and Social Psychology Institute of Psychology, Humboldt University](https://reader035.fdocuments.us/reader035/viewer/2022062520/568161d0550346895dd1c5ea/html5/thumbnails/25.jpg)
25
Result (conti.)
• Principle Factor Analysis
2010/05/19
![Page 26: Department of Organizational and Social Psychology Institute of Psychology, Humboldt University](https://reader035.fdocuments.us/reader035/viewer/2022062520/568161d0550346895dd1c5ea/html5/thumbnails/26.jpg)
26
Thank you
2010/05/19