Educational Research: Instruments (“caveat emptor”) EDU 8603 Educational Research Richard M....
-
Upload
lisa-stewart -
Category
Documents
-
view
221 -
download
7
Transcript of Educational Research: Instruments (“caveat emptor”) EDU 8603 Educational Research Richard M....
![Page 1: Educational Research: Instruments (“caveat emptor”) EDU 8603 Educational Research Richard M. Jacobs, OSA, Ph.D.](https://reader037.fdocuments.us/reader037/viewer/2022110323/56649d8b5503460f94a718a1/html5/thumbnails/1.jpg)
Educational Research: Educational Research: Instruments (“Instruments (“caveat emptorcaveat emptor”)”)
EDU 8603
Educational Research
Richard M. Jacobs, OSA, Ph.D.
![Page 2: Educational Research: Instruments (“caveat emptor”) EDU 8603 Educational Research Richard M. Jacobs, OSA, Ph.D.](https://reader037.fdocuments.us/reader037/viewer/2022110323/56649d8b5503460f94a718a1/html5/thumbnails/2.jpg)
Instruments…Instruments…
tools researchers use to collect data for research studies (alternatively called “tests”)
![Page 3: Educational Research: Instruments (“caveat emptor”) EDU 8603 Educational Research Richard M. Jacobs, OSA, Ph.D.](https://reader037.fdocuments.us/reader037/viewer/2022110323/56649d8b5503460f94a718a1/html5/thumbnails/3.jpg)
The types of instruments…The types of instruments…
2. Affective Instruments3. Projective Instruments
1. Cognitive Instruments
![Page 4: Educational Research: Instruments (“caveat emptor”) EDU 8603 Educational Research Richard M. Jacobs, OSA, Ph.D.](https://reader037.fdocuments.us/reader037/viewer/2022110323/56649d8b5503460f94a718a1/html5/thumbnails/4.jpg)
1. Cognitive instruments...1. Cognitive instruments...
Measure an individual’s attainment in academic areas typically used to diagnose strengths and weaknesses
![Page 5: Educational Research: Instruments (“caveat emptor”) EDU 8603 Educational Research Richard M. Jacobs, OSA, Ph.D.](https://reader037.fdocuments.us/reader037/viewer/2022110323/56649d8b5503460f94a718a1/html5/thumbnails/5.jpg)
Types of cognitive instruments...Types of cognitive instruments...
achievement tests…provide information about how well
the test takers have learned what they have been taught in school
…achievement is determined by comparing it to the normnorm, the performance of a national group of similar students who have taken the same test
![Page 6: Educational Research: Instruments (“caveat emptor”) EDU 8603 Educational Research Richard M. Jacobs, OSA, Ph.D.](https://reader037.fdocuments.us/reader037/viewer/2022110323/56649d8b5503460f94a718a1/html5/thumbnails/6.jpg)
aptitude tests…measure the intellect and abilities
not normally taught and often are used to predict future performance
…typically provide an overall score, a verbal score, and a quantitative score
![Page 7: Educational Research: Instruments (“caveat emptor”) EDU 8603 Educational Research Richard M. Jacobs, OSA, Ph.D.](https://reader037.fdocuments.us/reader037/viewer/2022110323/56649d8b5503460f94a718a1/html5/thumbnails/7.jpg)
2. Affective instruments...2. Affective instruments...
Measure characteristics of individuals along a number of dimensions and to assess feelings, values, and attitudes toward self, others, and a variety of other activities, institutions, and situations
![Page 8: Educational Research: Instruments (“caveat emptor”) EDU 8603 Educational Research Richard M. Jacobs, OSA, Ph.D.](https://reader037.fdocuments.us/reader037/viewer/2022110323/56649d8b5503460f94a718a1/html5/thumbnails/8.jpg)
Types of affective instruments...Types of affective instruments...
attitude scales…self-reports of an individual’s beliefs,
perceptions, or feelings about self, others, and a variety of activities, institutions, and situations
…frequently use Likert, semantic differential, Thurstone , or Guttman scales
![Page 9: Educational Research: Instruments (“caveat emptor”) EDU 8603 Educational Research Richard M. Jacobs, OSA, Ph.D.](https://reader037.fdocuments.us/reader037/viewer/2022110323/56649d8b5503460f94a718a1/html5/thumbnails/9.jpg)
values tests…measure the relative strength of an
individual’s valuing of theoretical, economic, aesthetic, social, political, and religious values
![Page 10: Educational Research: Instruments (“caveat emptor”) EDU 8603 Educational Research Richard M. Jacobs, OSA, Ph.D.](https://reader037.fdocuments.us/reader037/viewer/2022110323/56649d8b5503460f94a718a1/html5/thumbnails/10.jpg)
personality inventories…an individual’s self-report measuring
how behaviors characteristic of defined personality traits describe that individual
![Page 11: Educational Research: Instruments (“caveat emptor”) EDU 8603 Educational Research Richard M. Jacobs, OSA, Ph.D.](https://reader037.fdocuments.us/reader037/viewer/2022110323/56649d8b5503460f94a718a1/html5/thumbnails/11.jpg)
3. Projective instruments...3. Projective instruments...
Measure a respondent’s feelings or thoughts to an ambiguous stimulus
![Page 12: Educational Research: Instruments (“caveat emptor”) EDU 8603 Educational Research Richard M. Jacobs, OSA, Ph.D.](https://reader037.fdocuments.us/reader037/viewer/2022110323/56649d8b5503460f94a718a1/html5/thumbnails/12.jpg)
Primary type of projective test...Primary type of projective test...
associational tests…participants react to a stimulus
such as a picture, inkblot or word onto which they project a description
![Page 13: Educational Research: Instruments (“caveat emptor”) EDU 8603 Educational Research Richard M. Jacobs, OSA, Ph.D.](https://reader037.fdocuments.us/reader037/viewer/2022110323/56649d8b5503460f94a718a1/html5/thumbnails/13.jpg)
Selecting an instrument...Selecting an instrument...
2. identify and locate appropriate instruments
1. determine precisely the type of instrument needed
3. compare and analyze instruments
4. select best instrument
![Page 14: Educational Research: Instruments (“caveat emptor”) EDU 8603 Educational Research Richard M. Jacobs, OSA, Ph.D.](https://reader037.fdocuments.us/reader037/viewer/2022110323/56649d8b5503460f94a718a1/html5/thumbnails/14.jpg)
Instrument sources…Instrument sources…
Tests in Print
Burros’ Mental Measurements Yearbook
PRO-ED Publications Test Critiques Compendium
ETS Test Collection Database
ERIC/AE Test Review Locator
ERIC/Burros Test Publisher Directory
![Page 15: Educational Research: Instruments (“caveat emptor”) EDU 8603 Educational Research Richard M. Jacobs, OSA, Ph.D.](https://reader037.fdocuments.us/reader037/viewer/2022110323/56649d8b5503460f94a718a1/html5/thumbnails/15.jpg)
Rules governing the selection Rules governing the selection instruments...instruments...
2. the highest reliabilityreliability
1. the highest validityvalidity
3. the greatest ease of administration, scoring, and interpretation
4. test takers’ lack of familiarity with instrument
5. avoids potentially controversial matters
![Page 16: Educational Research: Instruments (“caveat emptor”) EDU 8603 Educational Research Richard M. Jacobs, OSA, Ph.D.](https://reader037.fdocuments.us/reader037/viewer/2022110323/56649d8b5503460f94a718a1/html5/thumbnails/16.jpg)
Administering the instrument...Administering the instrument...
2. ensure ideal testing environment
1. make arrangements in advance
3. be prepared for all probable contingencies
![Page 17: Educational Research: Instruments (“caveat emptor”) EDU 8603 Educational Research Richard M. Jacobs, OSA, Ph.D.](https://reader037.fdocuments.us/reader037/viewer/2022110323/56649d8b5503460f94a718a1/html5/thumbnails/17.jpg)
Two issues in using instruments...Two issues in using instruments...
2. ReliabilityReliability: the degree to which the instrument consistently measures what it purports to measure
1. ValidityValidity: the degree to which the instrument measures what it purports to measure
![Page 18: Educational Research: Instruments (“caveat emptor”) EDU 8603 Educational Research Richard M. Jacobs, OSA, Ph.D.](https://reader037.fdocuments.us/reader037/viewer/2022110323/56649d8b5503460f94a718a1/html5/thumbnails/18.jpg)
Types of validity...Types of validity...
2. Criterion-related validity3. Construct validity
1. Content validity
![Page 19: Educational Research: Instruments (“caveat emptor”) EDU 8603 Educational Research Richard M. Jacobs, OSA, Ph.D.](https://reader037.fdocuments.us/reader037/viewer/2022110323/56649d8b5503460f94a718a1/html5/thumbnails/19.jpg)
1. Content validityContent validity: the degree to which an instrument measures an intended content area
![Page 20: Educational Research: Instruments (“caveat emptor”) EDU 8603 Educational Research Richard M. Jacobs, OSA, Ph.D.](https://reader037.fdocuments.us/reader037/viewer/2022110323/56649d8b5503460f94a718a1/html5/thumbnails/20.jpg)
forms of content validityforms of content validity……sampling validitysampling validity: does the instrument
reflect the total content area?…item validityitem validity: are the items included on
the instrument relevant to the measurement of the intended content area?
![Page 21: Educational Research: Instruments (“caveat emptor”) EDU 8603 Educational Research Richard M. Jacobs, OSA, Ph.D.](https://reader037.fdocuments.us/reader037/viewer/2022110323/56649d8b5503460f94a718a1/html5/thumbnails/21.jpg)
2. Criterion-related validityCriterion-related validity: an individual takes two forms of an instrument which are then correlated to discriminate between those individuals who possess a certain characteristic from those who do not
![Page 22: Educational Research: Instruments (“caveat emptor”) EDU 8603 Educational Research Richard M. Jacobs, OSA, Ph.D.](https://reader037.fdocuments.us/reader037/viewer/2022110323/56649d8b5503460f94a718a1/html5/thumbnails/22.jpg)
forms of criterion-related validityforms of criterion-related validity……concurrent validity: the degree to which
scores on one test correlate to scores on another test when both tests are administered in the same time frame
…predictive validitypredictive validity: the degree to which a test can predict how well individual will do in a future situation
![Page 23: Educational Research: Instruments (“caveat emptor”) EDU 8603 Educational Research Richard M. Jacobs, OSA, Ph.D.](https://reader037.fdocuments.us/reader037/viewer/2022110323/56649d8b5503460f94a718a1/html5/thumbnails/23.jpg)
3. Construct validityConstruct validity: a series of studies validate that the instrument really measures what it purports to measure
![Page 24: Educational Research: Instruments (“caveat emptor”) EDU 8603 Educational Research Richard M. Jacobs, OSA, Ph.D.](https://reader037.fdocuments.us/reader037/viewer/2022110323/56649d8b5503460f94a718a1/html5/thumbnails/24.jpg)
Types of reliability...Types of reliability...
2. Equivalence
1. Stability
3. Internal consistency
![Page 25: Educational Research: Instruments (“caveat emptor”) EDU 8603 Educational Research Richard M. Jacobs, OSA, Ph.D.](https://reader037.fdocuments.us/reader037/viewer/2022110323/56649d8b5503460f94a718a1/html5/thumbnails/25.jpg)
1. StabilityStability (“test-retest”): the degree to which two scores on the same instrument are consistent over time
![Page 26: Educational Research: Instruments (“caveat emptor”) EDU 8603 Educational Research Richard M. Jacobs, OSA, Ph.D.](https://reader037.fdocuments.us/reader037/viewer/2022110323/56649d8b5503460f94a718a1/html5/thumbnails/26.jpg)
2. EquivalenceEquivalence (“equivalent forms”): the degree to which identical instruments (except for the actual items included) yield identical scores
![Page 27: Educational Research: Instruments (“caveat emptor”) EDU 8603 Educational Research Richard M. Jacobs, OSA, Ph.D.](https://reader037.fdocuments.us/reader037/viewer/2022110323/56649d8b5503460f94a718a1/html5/thumbnails/27.jpg)
3. Internal consistencyInternal consistency (“split-half” reliability with Spearman-Brown correction formula , Kuder-Richardson and Cronback’s Alpha reliabilities, scorer/rater reliability): the degree to which one instrument yields consistent results
![Page 28: Educational Research: Instruments (“caveat emptor”) EDU 8603 Educational Research Richard M. Jacobs, OSA, Ph.D.](https://reader037.fdocuments.us/reader037/viewer/2022110323/56649d8b5503460f94a718a1/html5/thumbnails/28.jpg)
Terms associated with instruments...Terms associated with instruments...
![Page 29: Educational Research: Instruments (“caveat emptor”) EDU 8603 Educational Research Richard M. Jacobs, OSA, Ph.D.](https://reader037.fdocuments.us/reader037/viewer/2022110323/56649d8b5503460f94a718a1/html5/thumbnails/29.jpg)
DataData……the pieces of information researchers
collect through instruments to examine a topic or hypothesis
![Page 30: Educational Research: Instruments (“caveat emptor”) EDU 8603 Educational Research Richard M. Jacobs, OSA, Ph.D.](https://reader037.fdocuments.us/reader037/viewer/2022110323/56649d8b5503460f94a718a1/html5/thumbnails/30.jpg)
ConstructsConstructs……abstractions of behavioral factors
that cannot be observed directly and which researchers invent to explain behavior
![Page 31: Educational Research: Instruments (“caveat emptor”) EDU 8603 Educational Research Richard M. Jacobs, OSA, Ph.D.](https://reader037.fdocuments.us/reader037/viewer/2022110323/56649d8b5503460f94a718a1/html5/thumbnails/31.jpg)
VariableVariable……a construct that can take on two or
more values or scores
![Page 32: Educational Research: Instruments (“caveat emptor”) EDU 8603 Educational Research Richard M. Jacobs, OSA, Ph.D.](https://reader037.fdocuments.us/reader037/viewer/2022110323/56649d8b5503460f94a718a1/html5/thumbnails/32.jpg)
Raw scoresRaw scores……the number of items an individual
scored on an instrument
![Page 33: Educational Research: Instruments (“caveat emptor”) EDU 8603 Educational Research Richard M. Jacobs, OSA, Ph.D.](https://reader037.fdocuments.us/reader037/viewer/2022110323/56649d8b5503460f94a718a1/html5/thumbnails/33.jpg)
Measurement scalesMeasurement scales……the representation of variables so
that they can be quantified
![Page 34: Educational Research: Instruments (“caveat emptor”) EDU 8603 Educational Research Richard M. Jacobs, OSA, Ph.D.](https://reader037.fdocuments.us/reader037/viewer/2022110323/56649d8b5503460f94a718a1/html5/thumbnails/34.jpg)
Measurement scales...Measurement scales...
1. nominal variablesQualitativeQualitative (categorical)
QuantitativeQuantitative (continuous)
2. ordinal variables
3. interval variables
4. ratio variables
![Page 35: Educational Research: Instruments (“caveat emptor”) EDU 8603 Educational Research Richard M. Jacobs, OSA, Ph.D.](https://reader037.fdocuments.us/reader037/viewer/2022110323/56649d8b5503460f94a718a1/html5/thumbnails/35.jpg)
1. nominalnominal (“categorical”): classifies persons or objects into two or more categories
![Page 36: Educational Research: Instruments (“caveat emptor”) EDU 8603 Educational Research Richard M. Jacobs, OSA, Ph.D.](https://reader037.fdocuments.us/reader037/viewer/2022110323/56649d8b5503460f94a718a1/html5/thumbnails/36.jpg)
2. ordinalordinal (“order”): classifies persons or objects and ranks them in terms of the degree to which those persons or objects possess a characteristic of interest
![Page 37: Educational Research: Instruments (“caveat emptor”) EDU 8603 Educational Research Richard M. Jacobs, OSA, Ph.D.](https://reader037.fdocuments.us/reader037/viewer/2022110323/56649d8b5503460f94a718a1/html5/thumbnails/37.jpg)
3. intervalinterval: ranks, orders, and classifies persons or objects according to equal differences with no true zero point
![Page 38: Educational Research: Instruments (“caveat emptor”) EDU 8603 Educational Research Richard M. Jacobs, OSA, Ph.D.](https://reader037.fdocuments.us/reader037/viewer/2022110323/56649d8b5503460f94a718a1/html5/thumbnails/38.jpg)
4. ratioratio: ranks, orders, classifies persons or objects according to equal differences with a true zero point
![Page 39: Educational Research: Instruments (“caveat emptor”) EDU 8603 Educational Research Richard M. Jacobs, OSA, Ph.D.](https://reader037.fdocuments.us/reader037/viewer/2022110323/56649d8b5503460f94a718a1/html5/thumbnails/39.jpg)
Norm referenceNorm reference……provides an indication about how one
individual performed on an instrument compared to the other students performing on the same instrument
![Page 40: Educational Research: Instruments (“caveat emptor”) EDU 8603 Educational Research Richard M. Jacobs, OSA, Ph.D.](https://reader037.fdocuments.us/reader037/viewer/2022110323/56649d8b5503460f94a718a1/html5/thumbnails/40.jpg)
Criterion referenceCriterion reference……involves a comparison against
predetermined levels of performance
![Page 41: Educational Research: Instruments (“caveat emptor”) EDU 8603 Educational Research Richard M. Jacobs, OSA, Ph.D.](https://reader037.fdocuments.us/reader037/viewer/2022110323/56649d8b5503460f94a718a1/html5/thumbnails/41.jpg)
Self referenceSelf reference……involves measuring how an
individual’s performance changes over time
![Page 42: Educational Research: Instruments (“caveat emptor”) EDU 8603 Educational Research Richard M. Jacobs, OSA, Ph.D.](https://reader037.fdocuments.us/reader037/viewer/2022110323/56649d8b5503460f94a718a1/html5/thumbnails/42.jpg)
OperationalizeOperationalize……the process of defining behavioral
processes that can be observed
![Page 43: Educational Research: Instruments (“caveat emptor”) EDU 8603 Educational Research Richard M. Jacobs, OSA, Ph.D.](https://reader037.fdocuments.us/reader037/viewer/2022110323/56649d8b5503460f94a718a1/html5/thumbnails/43.jpg)
Standard error of measurementStandard error of measurement……an estimate of how often a researcher
can expect errors of a given size on an instrument
![Page 44: Educational Research: Instruments (“caveat emptor”) EDU 8603 Educational Research Richard M. Jacobs, OSA, Ph.D.](https://reader037.fdocuments.us/reader037/viewer/2022110323/56649d8b5503460f94a718a1/html5/thumbnails/44.jpg)
Mini-Quiz…Mini-Quiz…
True or false…
…a large standard error of measurement indicates a high degree of reliability
false
![Page 45: Educational Research: Instruments (“caveat emptor”) EDU 8603 Educational Research Richard M. Jacobs, OSA, Ph.D.](https://reader037.fdocuments.us/reader037/viewer/2022110323/56649d8b5503460f94a718a1/html5/thumbnails/45.jpg)
True or false……a large standard error of
measurement indicates low reliability
true
![Page 46: Educational Research: Instruments (“caveat emptor”) EDU 8603 Educational Research Richard M. Jacobs, OSA, Ph.D.](https://reader037.fdocuments.us/reader037/viewer/2022110323/56649d8b5503460f94a718a1/html5/thumbnails/46.jpg)
True or false…
…most affective tests are projective
false
![Page 47: Educational Research: Instruments (“caveat emptor”) EDU 8603 Educational Research Richard M. Jacobs, OSA, Ph.D.](https://reader037.fdocuments.us/reader037/viewer/2022110323/56649d8b5503460f94a718a1/html5/thumbnails/47.jpg)
True or false……the primary source of test information for
educational researchers is the Burros Mental Measurements Yearbook
true
![Page 48: Educational Research: Instruments (“caveat emptor”) EDU 8603 Educational Research Richard M. Jacobs, OSA, Ph.D.](https://reader037.fdocuments.us/reader037/viewer/2022110323/56649d8b5503460f94a718a1/html5/thumbnails/48.jpg)
True or false……research hypotheses are usually
stated in terms of variables
true
![Page 49: Educational Research: Instruments (“caveat emptor”) EDU 8603 Educational Research Richard M. Jacobs, OSA, Ph.D.](https://reader037.fdocuments.us/reader037/viewer/2022110323/56649d8b5503460f94a718a1/html5/thumbnails/49.jpg)
True or false……similar to a Thurstone scale, a Guttman
scale attempts to determine whether an attitude is unidimensional
true
![Page 50: Educational Research: Instruments (“caveat emptor”) EDU 8603 Educational Research Richard M. Jacobs, OSA, Ph.D.](https://reader037.fdocuments.us/reader037/viewer/2022110323/56649d8b5503460f94a718a1/html5/thumbnails/50.jpg)
True or false……validity requires the collection of
evidence to support the desired interpretation
true
![Page 51: Educational Research: Instruments (“caveat emptor”) EDU 8603 Educational Research Richard M. Jacobs, OSA, Ph.D.](https://reader037.fdocuments.us/reader037/viewer/2022110323/56649d8b5503460f94a718a1/html5/thumbnails/51.jpg)
True or false……researchers should first consider
developing an instrument rather than utilizing a published instrument
false
![Page 52: Educational Research: Instruments (“caveat emptor”) EDU 8603 Educational Research Richard M. Jacobs, OSA, Ph.D.](https://reader037.fdocuments.us/reader037/viewer/2022110323/56649d8b5503460f94a718a1/html5/thumbnails/52.jpg)
True or false……a researcher’s goal is to achieve
perfect predictive validity
false
![Page 53: Educational Research: Instruments (“caveat emptor”) EDU 8603 Educational Research Richard M. Jacobs, OSA, Ph.D.](https://reader037.fdocuments.us/reader037/viewer/2022110323/56649d8b5503460f94a718a1/html5/thumbnails/53.jpg)
True or false……predictive validity is extremely
important for instruments that are used to classify or select individuals
true
![Page 54: Educational Research: Instruments (“caveat emptor”) EDU 8603 Educational Research Richard M. Jacobs, OSA, Ph.D.](https://reader037.fdocuments.us/reader037/viewer/2022110323/56649d8b5503460f94a718a1/html5/thumbnails/54.jpg)
True or false……a high validity coefficient is closer
to 1.00 than 0.00
true
![Page 55: Educational Research: Instruments (“caveat emptor”) EDU 8603 Educational Research Richard M. Jacobs, OSA, Ph.D.](https://reader037.fdocuments.us/reader037/viewer/2022110323/56649d8b5503460f94a718a1/html5/thumbnails/55.jpg)
True or false……norm reference and criterion
reference are synonymous terms
false
![Page 56: Educational Research: Instruments (“caveat emptor”) EDU 8603 Educational Research Richard M. Jacobs, OSA, Ph.D.](https://reader037.fdocuments.us/reader037/viewer/2022110323/56649d8b5503460f94a718a1/html5/thumbnails/56.jpg)
True or false……“criterion related” refers to correlating one
instrument with a second instrument; the second instrument is the criterion against with the validity of the second instrument is judged
false
![Page 57: Educational Research: Instruments (“caveat emptor”) EDU 8603 Educational Research Richard M. Jacobs, OSA, Ph.D.](https://reader037.fdocuments.us/reader037/viewer/2022110323/56649d8b5503460f94a718a1/html5/thumbnails/57.jpg)
True or false……a valid test is always reliable but a
reliable test is not always valid
true
![Page 58: Educational Research: Instruments (“caveat emptor”) EDU 8603 Educational Research Richard M. Jacobs, OSA, Ph.D.](https://reader037.fdocuments.us/reader037/viewer/2022110323/56649d8b5503460f94a718a1/html5/thumbnails/58.jpg)
True or false……it is difficult to state appropriate reliability coefficients
because reliability, like validity, is dependent upon the group being tested, i.e., groups with different characteristics will produce different reliabilities
true
![Page 59: Educational Research: Instruments (“caveat emptor”) EDU 8603 Educational Research Richard M. Jacobs, OSA, Ph.D.](https://reader037.fdocuments.us/reader037/viewer/2022110323/56649d8b5503460f94a718a1/html5/thumbnails/59.jpg)
True or false……content validity is not compromised
if the instrument covers topics not taught
false
![Page 60: Educational Research: Instruments (“caveat emptor”) EDU 8603 Educational Research Richard M. Jacobs, OSA, Ph.D.](https://reader037.fdocuments.us/reader037/viewer/2022110323/56649d8b5503460f94a718a1/html5/thumbnails/60.jpg)
Fill in the blank…
…the tendency of an individual to respond continually in a particular way
response set
![Page 61: Educational Research: Instruments (“caveat emptor”) EDU 8603 Educational Research Richard M. Jacobs, OSA, Ph.D.](https://reader037.fdocuments.us/reader037/viewer/2022110323/56649d8b5503460f94a718a1/html5/thumbnails/61.jpg)
Fill in the blank…
…a study which consists of two quantitative variables
correlational
![Page 62: Educational Research: Instruments (“caveat emptor”) EDU 8603 Educational Research Richard M. Jacobs, OSA, Ph.D.](https://reader037.fdocuments.us/reader037/viewer/2022110323/56649d8b5503460f94a718a1/html5/thumbnails/62.jpg)
Fill in the blank…
…a study which consists of one categorical and one quantitative variable
experimental or causal-comparative
![Page 63: Educational Research: Instruments (“caveat emptor”) EDU 8603 Educational Research Richard M. Jacobs, OSA, Ph.D.](https://reader037.fdocuments.us/reader037/viewer/2022110323/56649d8b5503460f94a718a1/html5/thumbnails/63.jpg)
Fill in the blank…
…a study which consists of two or more categorical variables
correlational or descriptive
![Page 64: Educational Research: Instruments (“caveat emptor”) EDU 8603 Educational Research Richard M. Jacobs, OSA, Ph.D.](https://reader037.fdocuments.us/reader037/viewer/2022110323/56649d8b5503460f94a718a1/html5/thumbnails/64.jpg)
Fill in the blank…
…data collection methods which emphasize student processes or products
performance
![Page 65: Educational Research: Instruments (“caveat emptor”) EDU 8603 Educational Research Richard M. Jacobs, OSA, Ph.D.](https://reader037.fdocuments.us/reader037/viewer/2022110323/56649d8b5503460f94a718a1/html5/thumbnails/65.jpg)
Fill in the blank…
…data collection methods including multiple-choice, true-false, and matching
selection
![Page 66: Educational Research: Instruments (“caveat emptor”) EDU 8603 Educational Research Richard M. Jacobs, OSA, Ph.D.](https://reader037.fdocuments.us/reader037/viewer/2022110323/56649d8b5503460f94a718a1/html5/thumbnails/66.jpg)
Fill in the blank……data collection methods in which
students fill in the blank, provide a short answer, or write an essay
supply
![Page 67: Educational Research: Instruments (“caveat emptor”) EDU 8603 Educational Research Richard M. Jacobs, OSA, Ph.D.](https://reader037.fdocuments.us/reader037/viewer/2022110323/56649d8b5503460f94a718a1/html5/thumbnails/67.jpg)
Fill in the blank…
…an instrument administered, scored, and interpreted in the same way no matter where or when it is administered
standardized
![Page 68: Educational Research: Instruments (“caveat emptor”) EDU 8603 Educational Research Richard M. Jacobs, OSA, Ph.D.](https://reader037.fdocuments.us/reader037/viewer/2022110323/56649d8b5503460f94a718a1/html5/thumbnails/68.jpg)
Fill in the blank…
…the term that includes the general process of collecting, synthesizing, and interpreting information, whether formal or informal
assessment
![Page 69: Educational Research: Instruments (“caveat emptor”) EDU 8603 Educational Research Richard M. Jacobs, OSA, Ph.D.](https://reader037.fdocuments.us/reader037/viewer/2022110323/56649d8b5503460f94a718a1/html5/thumbnails/69.jpg)
Fill in the blank……a formal, systematic, usually paper-and-
pencil procedure for gathering information about peoples’ cognitive and affective characteristics
test
![Page 70: Educational Research: Instruments (“caveat emptor”) EDU 8603 Educational Research Richard M. Jacobs, OSA, Ph.D.](https://reader037.fdocuments.us/reader037/viewer/2022110323/56649d8b5503460f94a718a1/html5/thumbnails/70.jpg)
Fill in the blank…
…the degree to which individuals seek out or participate in particular activities, objects, and ideas
interests
![Page 71: Educational Research: Instruments (“caveat emptor”) EDU 8603 Educational Research Richard M. Jacobs, OSA, Ph.D.](https://reader037.fdocuments.us/reader037/viewer/2022110323/56649d8b5503460f94a718a1/html5/thumbnails/71.jpg)
Fill in the blank……also called “temperament,” the characteristics
representing an individual’s typical behaviors and describes what individual do in their natural life circumstances
personality
![Page 72: Educational Research: Instruments (“caveat emptor”) EDU 8603 Educational Research Richard M. Jacobs, OSA, Ph.D.](https://reader037.fdocuments.us/reader037/viewer/2022110323/56649d8b5503460f94a718a1/html5/thumbnails/72.jpg)
Fill in the blank…
…things individuals feel favorable or unfavorable about; the tendency to accept or reject groups, ideas, or objects
attitudes
![Page 73: Educational Research: Instruments (“caveat emptor”) EDU 8603 Educational Research Richard M. Jacobs, OSA, Ph.D.](https://reader037.fdocuments.us/reader037/viewer/2022110323/56649d8b5503460f94a718a1/html5/thumbnails/73.jpg)
Fill in the blank…
…deeply held beliefs about ideas, persons, or objects
values
![Page 74: Educational Research: Instruments (“caveat emptor”) EDU 8603 Educational Research Richard M. Jacobs, OSA, Ph.D.](https://reader037.fdocuments.us/reader037/viewer/2022110323/56649d8b5503460f94a718a1/html5/thumbnails/74.jpg)
Fill in the blank…
…requires administering the predictor instruments to a different sample from the same population and developing a new equation
cross-validation
![Page 75: Educational Research: Instruments (“caveat emptor”) EDU 8603 Educational Research Richard M. Jacobs, OSA, Ph.D.](https://reader037.fdocuments.us/reader037/viewer/2022110323/56649d8b5503460f94a718a1/html5/thumbnails/75.jpg)
Which type of test…
personality inventory
…Minnesota Multiphasic Personality Inventory
![Page 76: Educational Research: Instruments (“caveat emptor”) EDU 8603 Educational Research Richard M. Jacobs, OSA, Ph.D.](https://reader037.fdocuments.us/reader037/viewer/2022110323/56649d8b5503460f94a718a1/html5/thumbnails/76.jpg)
Which type of test…
achievement test
…Stanford-Binet
![Page 77: Educational Research: Instruments (“caveat emptor”) EDU 8603 Educational Research Richard M. Jacobs, OSA, Ph.D.](https://reader037.fdocuments.us/reader037/viewer/2022110323/56649d8b5503460f94a718a1/html5/thumbnails/77.jpg)
Which type of test…
interest inventory
…Strong Campbell
![Page 78: Educational Research: Instruments (“caveat emptor”) EDU 8603 Educational Research Richard M. Jacobs, OSA, Ph.D.](https://reader037.fdocuments.us/reader037/viewer/2022110323/56649d8b5503460f94a718a1/html5/thumbnails/78.jpg)
Which type of test…
achievement test
…SRA Survey of Basic Skills
![Page 79: Educational Research: Instruments (“caveat emptor”) EDU 8603 Educational Research Richard M. Jacobs, OSA, Ph.D.](https://reader037.fdocuments.us/reader037/viewer/2022110323/56649d8b5503460f94a718a1/html5/thumbnails/79.jpg)
Which type of test…
aptitude test
…Weschler Intelligence Scales
![Page 80: Educational Research: Instruments (“caveat emptor”) EDU 8603 Educational Research Richard M. Jacobs, OSA, Ph.D.](https://reader037.fdocuments.us/reader037/viewer/2022110323/56649d8b5503460f94a718a1/html5/thumbnails/80.jpg)
Which type of test…
achievement test
…Gates-McGinitie Reading Test
![Page 81: Educational Research: Instruments (“caveat emptor”) EDU 8603 Educational Research Richard M. Jacobs, OSA, Ph.D.](https://reader037.fdocuments.us/reader037/viewer/2022110323/56649d8b5503460f94a718a1/html5/thumbnails/81.jpg)
Which type of test…
aptitude test
…Otis-Lennon School Ability Test
![Page 82: Educational Research: Instruments (“caveat emptor”) EDU 8603 Educational Research Richard M. Jacobs, OSA, Ph.D.](https://reader037.fdocuments.us/reader037/viewer/2022110323/56649d8b5503460f94a718a1/html5/thumbnails/82.jpg)
Which type of test…
interest inventory
…Kuder Occupational
![Page 83: Educational Research: Instruments (“caveat emptor”) EDU 8603 Educational Research Richard M. Jacobs, OSA, Ph.D.](https://reader037.fdocuments.us/reader037/viewer/2022110323/56649d8b5503460f94a718a1/html5/thumbnails/83.jpg)
Which type of test…
projective
…Rorschach Inkblot Test
![Page 84: Educational Research: Instruments (“caveat emptor”) EDU 8603 Educational Research Richard M. Jacobs, OSA, Ph.D.](https://reader037.fdocuments.us/reader037/viewer/2022110323/56649d8b5503460f94a718a1/html5/thumbnails/84.jpg)
Which type of test…
personality inventory
…Meyers-Briggs Type Indicator
![Page 85: Educational Research: Instruments (“caveat emptor”) EDU 8603 Educational Research Richard M. Jacobs, OSA, Ph.D.](https://reader037.fdocuments.us/reader037/viewer/2022110323/56649d8b5503460f94a718a1/html5/thumbnails/85.jpg)
Which type of test…
achievement test
…Iowa Test of Basic Skills
![Page 86: Educational Research: Instruments (“caveat emptor”) EDU 8603 Educational Research Richard M. Jacobs, OSA, Ph.D.](https://reader037.fdocuments.us/reader037/viewer/2022110323/56649d8b5503460f94a718a1/html5/thumbnails/86.jpg)
Which type of test…
projective
…Thematic Apperception Test
![Page 87: Educational Research: Instruments (“caveat emptor”) EDU 8603 Educational Research Richard M. Jacobs, OSA, Ph.D.](https://reader037.fdocuments.us/reader037/viewer/2022110323/56649d8b5503460f94a718a1/html5/thumbnails/87.jpg)
Which type of validity…
content
…compares the content of the test to the domain being measured
![Page 88: Educational Research: Instruments (“caveat emptor”) EDU 8603 Educational Research Richard M. Jacobs, OSA, Ph.D.](https://reader037.fdocuments.us/reader037/viewer/2022110323/56649d8b5503460f94a718a1/html5/thumbnails/88.jpg)
Which type of validity…
predictive
…Graduate Record Examination
![Page 89: Educational Research: Instruments (“caveat emptor”) EDU 8603 Educational Research Richard M. Jacobs, OSA, Ph.D.](https://reader037.fdocuments.us/reader037/viewer/2022110323/56649d8b5503460f94a718a1/html5/thumbnails/89.jpg)
Which type of validity…
criterion-related
…correlates scores from one instrument to scores on a criterion measure, either at the same or different time
![Page 90: Educational Research: Instruments (“caveat emptor”) EDU 8603 Educational Research Richard M. Jacobs, OSA, Ph.D.](https://reader037.fdocuments.us/reader037/viewer/2022110323/56649d8b5503460f94a718a1/html5/thumbnails/90.jpg)
Which type of validity…
construct
…amasses convergent, divergent, and content-related evidence to determine that the presumed construct is what is being measured
![Page 91: Educational Research: Instruments (“caveat emptor”) EDU 8603 Educational Research Richard M. Jacobs, OSA, Ph.D.](https://reader037.fdocuments.us/reader037/viewer/2022110323/56649d8b5503460f94a718a1/html5/thumbnails/91.jpg)
Which type of reliability…
stability (test-retest)
…scores on one instrument are consistent over time
![Page 92: Educational Research: Instruments (“caveat emptor”) EDU 8603 Educational Research Richard M. Jacobs, OSA, Ph.D.](https://reader037.fdocuments.us/reader037/viewer/2022110323/56649d8b5503460f94a718a1/html5/thumbnails/92.jpg)
Which type of reliability…
scorer/rater
…the extent to which independent scorers or a single scorer over time agree on the scoring of an open-ended instrument
![Page 93: Educational Research: Instruments (“caveat emptor”) EDU 8603 Educational Research Richard M. Jacobs, OSA, Ph.D.](https://reader037.fdocuments.us/reader037/viewer/2022110323/56649d8b5503460f94a718a1/html5/thumbnails/93.jpg)
Which type of reliability…
equivalence and stability
…scores correlate between similar version of an instrument given at different times
![Page 94: Educational Research: Instruments (“caveat emptor”) EDU 8603 Educational Research Richard M. Jacobs, OSA, Ph.D.](https://reader037.fdocuments.us/reader037/viewer/2022110323/56649d8b5503460f94a718a1/html5/thumbnails/94.jpg)
Which type of reliability…
equivalence (alternate forms)
…scores correlate between two versions of a test that are intended to be equivalent
![Page 95: Educational Research: Instruments (“caveat emptor”) EDU 8603 Educational Research Richard M. Jacobs, OSA, Ph.D.](https://reader037.fdocuments.us/reader037/viewer/2022110323/56649d8b5503460f94a718a1/html5/thumbnails/95.jpg)
Which type of reliability…
internal consistency
…the extent to which items included on an instrument are similar to one another in content
![Page 96: Educational Research: Instruments (“caveat emptor”) EDU 8603 Educational Research Richard M. Jacobs, OSA, Ph.D.](https://reader037.fdocuments.us/reader037/viewer/2022110323/56649d8b5503460f94a718a1/html5/thumbnails/96.jpg)
Which type of response scale…
semantic differential
…an individual gives a quantitative rating to a topic where each position on the continuum has an associated score value
![Page 97: Educational Research: Instruments (“caveat emptor”) EDU 8603 Educational Research Richard M. Jacobs, OSA, Ph.D.](https://reader037.fdocuments.us/reader037/viewer/2022110323/56649d8b5503460f94a718a1/html5/thumbnails/97.jpg)
Which type of response scale…
Likert
…value points are assigned to a participant’s responses to a series of statements
![Page 98: Educational Research: Instruments (“caveat emptor”) EDU 8603 Educational Research Richard M. Jacobs, OSA, Ph.D.](https://reader037.fdocuments.us/reader037/viewer/2022110323/56649d8b5503460f94a718a1/html5/thumbnails/98.jpg)
Which type of response scale…
Thurstone
…participants select from a list of statements that represent differing points of view from those which participations agree
![Page 99: Educational Research: Instruments (“caveat emptor”) EDU 8603 Educational Research Richard M. Jacobs, OSA, Ph.D.](https://reader037.fdocuments.us/reader037/viewer/2022110323/56649d8b5503460f94a718a1/html5/thumbnails/99.jpg)
This module has focused on...This module has focused on...
…which describes the procedures researchers use to select individuals to participate in a study
instruments
![Page 100: Educational Research: Instruments (“caveat emptor”) EDU 8603 Educational Research Richard M. Jacobs, OSA, Ph.D.](https://reader037.fdocuments.us/reader037/viewer/2022110323/56649d8b5503460f94a718a1/html5/thumbnails/100.jpg)
The next module will focus on...The next module will focus on...
...the tools researchers use to gather data for a study
qualitative research