Translation and Verification of ICCS instruments

Summary of the Field Trial&

Plans for the Main Study

National Research Coordinators Meeting

Windsor, June 2008

NRCMeetingWindsor

9-12 June 2008

Content of presentation

• Field Trial

- Scope of verification

- Quality of translation/adaptations

- Major problems and feedback from the NRCs

• Main Study

- Process of preparation of the national instruments

- Translation/adaptation procedures

- External verification of the national instruments

- Timeline

NRCMeetingWindsor

9-12 June 2008

FT: Scope of verification

• 34 educational systems- 2222 participants: international and regional instruments - 12 participants: international instruments

• 22 languages

- Most popular: Spanish (7) and English (4)

• 2 participants used two languages

• Time: September- October 2007September- October 2007

NRCMeetingWindsor

9-12 June 2008

FT: Quality of translation and/or adaptations

Overall very good quality!

• Primus Inter Pares:

CHILE, ENGLAND, FINLAND

NRCMeetingWindsor

9-12 June 2008

FT: Typical errors

• Translation: mistranslations, “free translation” vs. “word for word” translation, inconsistencies, lack of harmonization between translators

• Cultural Adaptations: not always documented properly, use of English terminology

• Omissions/Additions

• Grammar: English syntax • Punctuation

• Typos

NRCMeetingWindsor

9-12 June 2008

FT: Feedback from countries (TV Summary and SAQ) • 16 participants completed TV Summary Form

- 4 accepted all severity code “1” suggestions- 12 accepted some/partially of severity code “1” suggestions

6 participants reported in SAQ problems with translation and/or translation verification and/or documentation

Reported problems:- Translation/adaptation of some concepts and words (e.g. local

community, school, council, school board, ombudsman, immigrants) - Problems with the Zedland, etc. - Updating NAFs - Verification and NAFs for instruments developed in English - Coordination between NAF – language – layout verification

• Other issues:- Using other country translation (7 countries)

NRCMeetingWindsor

9-12 June 2008

MS: Process of preparation of the national instruments

• The same process as in Field Trial:

Step 1: National Center translates and/or adapts instrumentsStep 2: National Center reviews instruments and completes

NAFStep 3: International Center reviews NAFStep 4: The IEA Secretariat conducts external verification of

translation/adaptation Step 5: National Center corrects and assembles instruments Step 6: International Center conducts layout verificationStep 7: National Center conducts final review and prints

instruments

• The same team as in Field Trial: Translator reviewer NRC

NRCMeetingWindsor

9-12 June 2008

MS: Procedure of preparation of the national instruments

• Select items/questions which were changed after Field Trial. Retranslate them.

• Select and review carefully items/questions which remain unchanged after Field Trial. Correct/ improve them if necessary.

• Follow the same translation/adaptation formula as in Field Trial. Use Field Trial experiences.

• If your country participated in CIVED and you want to have overtime comparisons: do not change the trend items!

• Update NAFs on each stage of your work.

NRCMeetingWindsor

9-12 June 2008

MS: International verification of translation/adaptations

• Materials submitted to external verification:- translated\adapted instruments (international and regional)*

- NAFs ( to be reviewed twice: by the International Center and by the international reviewer) • Feedback in electronic form:

- suggestions inserted in NAFs- proposed corrections, changes and comments (including

severity codes) inserted in instruments

• Please use DPC FTP Server for uploading and downloading instruments!

* Note: Please send test in blocks of items; do not send booklets!

NRCMeetingWindsor

9-12 June 2008

MS: International layout verification

• The same procedure as in Field Trial:

- One copy of each instrument (translation verified and corrected) as PDF file

- Updated NAFs

- The ISC will review instruments and will send its comments to NRC

NRCMeetingWindsor

9-12 June 2008

MS: Finalization of the national instruments

• Final corrections to the instruments have to be introduced

• National Adaptation Forms have to be revised

• Final version of the instruments and National Adaptation Forms should be sent to ISC

• INSTRUMENTS CAN BE PRINTED!

NRCMeetingWindsor

9-12 June 2008

Timeline

• Translation verification opens:

- For Southern Hemisphere: SEPTEMBER 1, 2008

- For Northern Hemisphere: JANUARY 1, 2009

• Verification of full set of instruments takes approximately two – four weeks, dependently on:

- Quality of translation

- “Appointment” for translation verification

NRCMeetingWindsor

9-12 June 2008

Questions and comments

?!!