Fighting Back Against

Fraud in the Academic Space

Michelle Hampton, Educational Testing Service

Margit Schatzman, Educational Credential Evaluators, Inc.

John J. Wood, University at Buffalo (SUNY)

Session Outline

Introductions

Examine Fraud in the following Academic

Spaces:

- Standardized Testing

- Credentials Evaluation

- Institutional

- Group discussion of Best Practices

Testing Fraud Has Changed Over

TimeTHEN

• Low tech

• Individual misconduct

• Localized action

NOW

• High tech

• Global scale, across time zones

• Organized rings and individual misconduct

• Big business

New challenges require new tools and

processes

The TOEFL® Test Approach to

Security

ETS takes test security extremely seriously

and uses a three-pronged approach to protect

test integrity

Prevention

DetectionCommunication

Security - Prevention

1. Test design – reduce item memorization

2. Encrypted test delivery/return of results

3. Training and certification of test center staff

4. Digital test day photo provided on score report

5. Test taker photo appears on assigned computer at start of test and at break

Security - Detection

1. When there are concerns about score validity

– Review individual scores

– Review test center scores

– Voice analysis, handwriting analysis

– Other confidential measures

Biometric Voice Identification

Uses statistical pattern-matching techniques,

advanced voice classification methods and input

from multiple systems to compare speech

samples from TOEFL® test takers

– Introduced in 2012 for security investigations

– Since February 8, 2014 now used on all test takers

worldwide before scores are released

Biometric Voice IdentificationDetects impersonation in three ways:

– Potential impersonators within a test center

• Compare voiceprints with speech samples for all test takers in a given test center

– Repeat test takers

• Compare voiceprints with speech samples across multiple administrations for the same test centers

– Known impersonators within a group

• Compare voiceprints with speech samples of known imposters to all test takers within a suspect group

Additional Measures– Implementation of electronic wands at all test

centers worldwide to detect electronic

photographic, audio or recording devices

– New techniques to ensure the authenticity of test-

taker photographs

– Requirements of second-generation government

ID document in China

– Always piloting new measures - i.e., facial

recognition

Security - Detection

2. When policy or procedural irregularities are discovered

– Scores are canceled

– Test center is closed

– Scores from previous administrations are reviewed

– Institutions are informed

Security - Communication

1. When scores are cancelled, ETS contacts all institutions designated by the student to receive scores

2. Communication from institutions with concerns about possibly fraudulent scores helps our investigations

3. Every concern is investigated by the Office of Testing Integrity (OTI)

4. ETS notifies you with the results of any investigation

Security - Communication

Ways to reach the Office of Testing Integrity

Email: TSReturns@ets.org

Security Hotline: 1-800-750-6991

Assisting Institutions

The TOEFL® Program revised its policies and procedures to assist institutions

– Eliminated student permission requirement to tell institution why a score has been cancelled

– Simplified process for institutions to learn why a score has been canceled

– Provided new data fields to score reports: ID type, last four digits of ID number and issuing country

– Free test vouchers available for universities where scores are canceled for students already on campus

The Fight Against Fraud is Never

OverNo single form of prevention or detection will work for all kinds of fraud

– Cheating attempts have become increasingly sophisticated

– Constantly evolving technology enables new forms of fraud

– Individuals and organized rings constantly changing tactics

ETS continually works to develop new tools and strategies to combat fraud

We welcome your help

Responding to Test Fraud

The following have been reported by institutions as actions they have taken when scores were canceled due to inappropriate behavior:

– Ask ETS for the letter given to the test taker

– Call in the student and ask for an explanation

– Require retesting since the score is no longer valid

– Require the student to do an intensive English program if studies are not going well due to language

– Expulsion

Fighting fraud in the credential evaluation process…

• Develop consistent approach– Carefully designed documentation requirements

• Promote appropriate expertise– High resolution image scanning and tracking of

document forensics

• Verify documents

• Follow up with appropriate actions

The Fraud We See…

Document Alteration

The Fraud We See…

Document Fabrication

The Fraud We See…

Diploma Mills

Institute Safer Document Policies

• Request a full educational history supported by a full set of official documentation

• Request documents to be sent directly from the issuing institution (if possible)– Request documents issued in the official language of the country

(known exceptions: US-based educational systems, e.g. Taiwan, Philippines etc.)

• Request original documents for closer review– Offer safe document return procedures

• Send documents for verification

20

Review Institution and Program Status

• Identify the recognition status of the institution– Recognized institutions

– Unrecognized institutions

– Diploma mills

• Identify the program status– Program offered at the time of study

– Name of qualification awarded

– Transnational program arrangements

21

Analyze Credentials

• Develop a check-list that will help investigate the following:– Applicant personal data and educational chronology

– Source of document

– Document appearance

– Document content

• Do not give in to applicant’s pressure (pressing deadlines, missing or unacceptable documents)

• Retain sample credentials for future comparison

• Note your observations for future reference when document is being held up for verification

22

Verify Documents

• Keep verification letters brief and to the point!– Use form letters and native language if possible for best results

• Write to the issuing institution– Address the letter to the person who normally is in charge of issuing

documents

– Avoid using specific person’s names

• Ask only reliable sources for assistance in obtaining contact information– Do not accept contact information from the student unless it can be

verified through official resources

• Say “thank you” when you receive a response!

23

Online Verifications

• Government databases

• Private or government agency services

• Individual institution databases

• Lists of graduates/lists of results

UKRAINEGovernment Database

• On-line database available for diplomas awarded in the current (plastic) format beginning 1998

• Now website available in English

• Free registration required to set up account

• Use login to access Verification service

• Green = positive result

• Red = negative result

25

http://www.osvita.net/checkdoc.php

UKRAINE(Data input page for online

verification)

26

UkraineSample forgery

(confirmed negative on-line verification result)

27

WEST AFRICAWAEC Online Verification

Candidate must buy a scratch card in person

Information on where cards can be purchased is found on the respective websites

Additional access details, like how to use the card, are given on the websites

For exams taken prior to the online system, students must request a Statement of Results / Confirmation of Results to be sent directly to a third party

28

WAEC Scratch Card

Front Back

29

http://www.waecdirect.org/

WAEC result checker

30records available from 1991

Example of Results

www.waecdirect.org

31

Individual Institution Verification(Peking University on-line verification)

graduate program verification (The system functions

in both English and Chinese.)

http://www.pku.edu.cn/graduate/diplomaEN.html

Works mostly for credentials issued after 1990.

undergraduate program verification

http://dean.pku.edu.cn/certificate/ (credentials from 1981 to

2009)

Only functions in Chinese. The top link is for graduation

certificates, the bottom link is for degree certificates

The database does not include double majors, medical

majors and adult education programs, for those they

provide contact phone numbers.

32

China

Peking University

Graduate School verification

33

Government Agency Service(China – CHESICC)

http://www.chsi.com.cn/en/

Government Agency ServiceChina - CDGDC

China Academic Degrees & Graduate Education Development Center (CDGDC)

Website:http://www.cdgdc.edu.cn/China Academic Degrees & Graduate Education Development Center (CDGDC)Credential DepartmentB 18, Tongfang Scientific BuildingNo. 1 Wangzhuang Road, Haidian DistrictBeijing 100083People’s Republic of China

Fax: (008610) 82379491E-mail: zxb@mail.cdgdc.edu.cn

35

CDGDC Verification Report

36

Background colors:

BLUE = Verification confirms

authentic documents

PINK = Verification confirms

fraudulent documents

YELLOW = Duplicate Verification

copy

Individual Institution VerificationOnline Verification of UNAM transcript

37

38

Undergraduate: http://www.dgae-siae.unam.mx/ and click "Acceso”

Graduate: go to http://www.uap.unam.mx/ enter the Numerode cuenta and the students birthdate (NIP) to access their transcript. (2)

Numero de cuenta (without dashes, start with zero for pre-2000

Usually, it’s the DOB (ddmmyyyy), but student can reset it. Ask for NIP if it’s been reset.

•http://www.igmohe.gov.iq/rwabitKhrijeen.html

Lists of GraduatesIraq – links to graduate listings online

Multi-Institution Online Verification System

http://www.uias.org/

htt

p:/

/ww

w.r

yers

on

.ca/

curr

ents

tud

en

ts/e

ssr/

Individual InstitutionVerification Database

Canada – Ryerson University

http://www.minesup.gov.cm/

Online Exam ResultsCameroon – Ministry of Higher Education

National Examinations

Institutional Perspective

2. Preventing/detecting fraud in:

• Academic records

• Essays and recommendations

3. Avoiding fraud on campus: promoting and

enforcing academic integrity

1. What are universities looking for in the

admissions process?

What are universities looking for

when they admit students?

1. Potential for success

2. A specific academic profile

3. Potential to contribute to class profile

4. Potential to enrich campus and community

5. In other words, a good “match”

Problem of Fraud

1. “Matches” based on fraud serve no one

2. Students perpetrating fraud are more likely to

fail in the long term

3. Agents and counselors committing fraud on

student’s behalf betray student and the

process

4. Institution can suffer harm also

Avoiding Fraud

with Academic Records

1. Using a credential evaluation service confers

the highest level of security and least risk to

institution

2. Next best thing is to have in-house

expertise—know what to expect, what to look

for

3. Verify when possible and use a holistic

approach

Tips to Avoid Fraud

1. Accept documents only from entity

authorized to issue them

2. Require submission in official, properly

sealed envelopes

3. Board exam results should be submitted

directly to the institution

Essays and Personal Statements

1. Purpose of these documents should be clear

for both the applicant and the institution

2. Is content, language proficiency, personal

motivation, etc the primary consideration?

3. Question of authenticity: “Who wrote this?”

Tips to Avoid Fraud

1. Be sure purpose and expectations are clear

2. Be sure writing prompt is clear

3. Indicate how the piece of writing will be

used/evaluated

Tips to Avoid Fraud

1. Alert applicants to format/style requirements,

use of anti-plagiarism software; reference

appropriate tools/resources

2. Be very clear about consequences of fraud

(plagiarism, omission of information, etc)

What to Watch for

1. Font changes, inconsistent spelling (US vs.

UK), lack of coherence

2. Inconsistency between quality of writing and

submitted test scores and grades

3. Uncited concepts, terms, theories that derive

from recently published work

Recommendations

1. One to three letters is standard (for graduate

programs)

2. Checklist of applicant’s academic attributes

3. Narrative section

4. Applicant agreement not to have access to

recommendations

Tips to Avoid Fraud

1. Be clear about what type of recommendation

is desired (academic vs. professional)

2. Check that recommendation supports other

parts of the application

3. Confirm relationship of applicant and

recommender

4. Verify recommendations

Promoting Academic Integrity

1. Be sure institution has explicit and consistent

policies on academic integrity and process for

handling violations, with penalties made clear

2. Alert students pre-arrival about academic

integrity policies

3. Educate incoming students about policies and

procedures at orientation and in follow-up

outreach

Fraud on Exams and Papers“Alleged exam cheating leads to fraud charges against 2students in Waterloo

Two Ontario university students have been charged with forgery and fraud after a first-year student allegedly paid a PhD student $900 to write her final math exam.University of Waterloo officials said a 26-year-old PhD student at Toronto's York University was contacted by the first-year student through a website connecting international students to others who are willing to write exams for compensation.The 20-year-old University of Waterloo student allegedly paid $900 to the York student, and provided a fake student ID so he could write her exam.” (CBC News, Dec. 18, 2014)

Fraud on Exams and PapersFROM AN EMAIL CIRCULATED AT UB IN SUMMER 2014:

summer的又一个section开始了，有木有觉得作业太难不会写？有木有觉得lab数据太烦很难算？有木有觉得作业太多没空玩耍？有木有觉得考试不会焦头烂额？这里能解决你的需求

代写MTH，及其他一切与编程有关的作业

出售CHE101 LAB计算表格，excel格式，自动计算，输入实验数据即可自动得到答案，简单易用，完全照搬书本表格

代考MTH，及其他一边与编程有关考试，可指定要考到的分数，误差不超过5%的分数

有需求的请回复邮件或联系QQ446579909

Group Discussion