I Can Distinguish the types of validity Distinguish the types of reliability Identify if an example...

8
I Can I Can Distinguish the types of validity Distinguish the types of reliability Identify if an example is objective or subjective Copyright © Allyn & Bacon 2007

Transcript of I Can Distinguish the types of validity Distinguish the types of reliability Identify if an example...

I Can I Can

• Distinguish the types of validity

• Distinguish the types of reliability

• Identify if an example is objective or subjective

Copyright © Allyn & Bacon 2007

Copyright © Allyn & Bacon 2007

Validity

When a test measures what it claims to Face Validity

A basic form of validity which determines if a measure appears (on the face of it) to measure what it is supposed to measure.

Content Validity

Each test item is representative of the subject that the test covers

Does a test measure your knowledge or mastery of a topic?

Criterion Validity

The performance of the test taker is measured against a specific learning goal.Does it meet the criteria?

If we find out there is a high correlation between student grades in high-school and their success in college we would say there is high criterion-related validity

Item Analysis

This is done to examine how a test is related to learning objectives

For example…Creating the MCAS test

This is done to examine how a test is related to learning objectives

Copyright © Allyn & Bacon 2007

Reliability A test that yields

the same results over time

Test-Retest ReliabilityPeople get the same score when

they take the test more than once

Split-Half Reliability A measure of the reliability in

which a test is split into two parts and an individual’s score on both parts are compared

Inter-Rater ReliabilityMeasures how similarly two

different test scorers would score the same

test

The administration of the test and the scoring guidelines are the same for each student

The results can then be used to draw conclusions about the test takers with respect to the test objectives.

Copyright © Allyn & Bacon 2007

The Normal Distribution of IQ ScoresThe Normal Distribution of IQ Scores

0 10 20 30 40 50 60 70 80 90 110 120 130 140 150 160 170 180 190 200100

Few

Many

Num

ber

of P

erso

ns

IQ

Nor

mal

Ran

ge

Normal Range : Scores falling near the middle of a normal distribution

Copyright © Allyn & Bacon 2007Copyright © Allyn & Bacon 2007

Types of TestsTypes of Tests1. Objective Tests1. Objective Tests Can be scored easily by Can be scored easily by

a machinea machine

true/false, multiple true/false, multiple choice, anything you choice, anything you can scantroncan scantron

2. Subjective Tests2. Subjective Tests

IndividualsIndividuals are asked to write answers rather are asked to write answers rather than choose from a set of possible answersthan choose from a set of possible answers

Subjective tests are more challenging and

expensive to prepare, administer and evaluate correctly, but they can be more valid.

Copyright © Allyn & Bacon 2007

Ethics and Standards in TestingEthics and Standards in Testing

Ethical concerns related to testing involve:--The confidentiality of the test results

--How to report the results

--How to use the test to compare individuals

--The impact of tests on society as a whole

Can I?Can I?

• Distinguish the types of validity

• Distinguish the types of reliability

• Identify if an example is objective or subjective

Copyright © Allyn & Bacon 2007