Introduction to Introduction to Measurement and Measurement and

EvaluationEvaluation

PE 254PE 254

Test and DataTest and Data

Test: An instrument or activity used to Test: An instrument or activity used to accumulate data on a person’s ability to accumulate data on a person’s ability to perform a specified task. In kinesiology the perform a specified task. In kinesiology the content of these tests are usually either content of these tests are usually either cognitive, skill, or fitness.cognitive, skill, or fitness.

Data: The translation of behavior into a Data: The translation of behavior into a numerical or verbal descriptor which is numerical or verbal descriptor which is then recorded in written form. then recorded in written form.

Why Administer Tests?Why Administer Tests?

To measure individual differences on To measure individual differences on a specific trait (behavior).a specific trait (behavior).

Discussion: Is a test “good” if Discussion: Is a test “good” if everyone/anyone scores 100%? Or, is everyone/anyone scores 100%? Or, is a test “good” if everyone/anyone a test “good” if everyone/anyone scores 0%? scores 0%?

Use of TestsUse of Tests

MotivationMotivation AchievementAchievement ImprovementImprovement DiagnosisDiagnosis PrescriptionPrescription GradingGrading ClassificationClassification PredictionPrediction

Administrative Concerns in Test SelectionAdministrative Concerns in Test Selection

RelevanceRelevance Education valueEducation value Economic valueEconomic value TimeTime NormsNorms BiasBias SafetySafety

MeasurementMeasurement

A measurement takes place when a A measurement takes place when a “test” is given and a “score” is “test” is given and a “score” is obtained . obtained .

If the test collects quantitative data, If the test collects quantitative data, the score is a number.the score is a number.

If the test collects qualitative data, If the test collects qualitative data, the score may be a phrase or word the score may be a phrase or word such as “excellent.”such as “excellent.”

Definitions of MeasurementDefinitions of Measurement

The systematic assignment of The systematic assignment of numerical values (quantitative) numerical values (quantitative) or verbal descriptors (qualitative) or verbal descriptors (qualitative) to the characteristics of objects to the characteristics of objects or individuals; designation of the or individuals; designation of the status of such characteristics. status of such characteristics.

Measurement Process Involves Four StepsMeasurement Process Involves Four Steps

1.1. Define the characteristics that you want Define the characteristics that you want to measure.to measure.

2.2. Select the appropriate test. This may Select the appropriate test. This may also mean to select the appropriate also mean to select the appropriate testing instrument. testing instrument.

3.3. Administer the test. If an instrument is Administer the test. If an instrument is involved in the testing, this also means involved in the testing, this also means to use the instrument correctly. to use the instrument correctly.

4.4. Collect and record the measurement Collect and record the measurement from the test. from the test.

Considerations When Taking MeasurementsConsiderations When Taking Measurements

Remember that you are measuring a Remember that you are measuring a characteristic of the person—you are characteristic of the person—you are not measuring the person not measuring the person themselves; thus, make no themselves; thus, make no judgments about the person.judgments about the person.

Make no comical remarks regarding Make no comical remarks regarding the collected data.the collected data.

Have a high ethical standards when Have a high ethical standards when collecting the data.collecting the data.

Be professional. Be professional.

Subjective vs. Objective MeasurementSubjective vs. Objective Measurement

A subjective measurement is one A subjective measurement is one that can possibly be interrupted that can possibly be interrupted differently. differently.

An objective measurement is one An objective measurement is one that cannot be interpreted differently that cannot be interpreted differently because of numerical values. because of numerical values.

DiscussionDiscussion

Every time you go to a doctor’s Every time you go to a doctor’s office, they weigh you. Let’s say you office, they weigh you. Let’s say you weigh 140 pounds. weigh 140 pounds.

Did your measurement of 140 Did your measurement of 140 pounds come from a test? Why or pounds come from a test? Why or why not?why not?

EvaluationEvaluation

Definition 1: The process of making Definition 1: The process of making judgments about the results of judgments about the results of measurement in terms of the measurement in terms of the purpose of the measurement. purpose of the measurement.

Definition 2: The process of obtaining Definition 2: The process of obtaining information (data) and using it to information (data) and using it to form judgments, which in turn are form judgments, which in turn are used in decision making. used in decision making.

Steps Involved in Making an EvaluationSteps Involved in Making an Evaluation

1.1. Define the objective or the purpose of Define the objective or the purpose of the test.the test.

2.2. Measure the performance or administer Measure the performance or administer the test.the test.

3.3. Find or develop a standard.Find or develop a standard.4.4. Compare a person’s performance on the Compare a person’s performance on the

test to a standard.test to a standard.5.5. Make the evaluation then discuss and Make the evaluation then discuss and

distribute the results in the most distribute the results in the most appropriate manner.appropriate manner.

Formative & Summative EvaluationFormative & Summative Evaluation

Formative evaluationFormative evaluation: If the : If the evaluation is at the beginning or evaluation is at the beginning or during.during.

Summative evaluationSummative evaluation: If the : If the evaluation is at the end. evaluation is at the end.

NormsNorms

Evaluations are often based on norms:Evaluations are often based on norms:

Local norm: Norms based on a relatively small Local norm: Norms based on a relatively small group of subjects. Ex: Pull-up norms for 7group of subjects. Ex: Pull-up norms for 7thth grade grade boys at one school.boys at one school.

State norms: Norms that are representative of all State norms: Norms that are representative of all similar subjects in the state. Ex: CAHPERD fitness similar subjects in the state. Ex: CAHPERD fitness norms for 7norms for 7thth grade boys. grade boys.

National norms: Norms that are representative of National norms: Norms that are representative of all similar subjects in the United States. Ex: all similar subjects in the United States. Ex: AAHPERD fitness norms for 7AAHPERD fitness norms for 7thth grade girls. grade girls.

ReliabilityReliability

Reliability defined as the consistency of an Reliability defined as the consistency of an individual when repeatedly performing the individual when repeatedly performing the same test. same test.

Example: If a group of people take the Example: If a group of people take the same test on two different days, the same test on two different days, the scores obtained should be approximately scores obtained should be approximately the same. the same.

A reliable test will yield data that are A reliable test will yield data that are stable, repeatable, and precise. stable, repeatable, and precise.

Reliability of a test refers to the Reliability of a test refers to the dependability of test scores. dependability of test scores.

ValidityValidity

The American Psychological Association The American Psychological Association (APA) reported that validity is the most (APA) reported that validity is the most important characteristic to a test or important characteristic to a test or measuring instrument.measuring instrument.

The validity of each test can only be The validity of each test can only be evaluated in terms of a particular purpose evaluated in terms of a particular purpose and for a particular group. and for a particular group.

Example: A strength test that is valid for Example: A strength test that is valid for college-aged students is not necessarily college-aged students is not necessarily valid for sedentary adults. valid for sedentary adults.

Group ActivitiesGroup Activities

Identify the reliability and validity for Identify the reliability and validity for administering the 1.5-mile run in administering the 1.5-mile run in college-aged students.college-aged students.

Identify the reliability and validity for Identify the reliability and validity for administering a standing broad jump administering a standing broad jump in elementary school students.in elementary school students.