Assessing Intercultural Competencefiles7.webydo.com/91/9185608/UploadedFiles/6B09E36... ·...
Transcript of Assessing Intercultural Competencefiles7.webydo.com/91/9185608/UploadedFiles/6B09E36... ·...
![Page 1: Assessing Intercultural Competencefiles7.webydo.com/91/9185608/UploadedFiles/6B09E36... · Assessing Intercultural Competence: Case Studies from the Field - Part B Chris Cartwright,](https://reader035.fdocuments.us/reader035/viewer/2022063022/5fe71db3fa722938587ff91c/html5/thumbnails/1.jpg)
1
Assessing Intercultural Competence: Case Studies from the Field - Part A
Chris Cartwright, Intercultural Communication Institute Dr. Iris Berdrow,Bentley University Chris Hightower, Texas Christian University Martha (Marty) Petrone, Miami University of Ohio
2014 Assessment Institute, in Indianapolis
![Page 2: Assessing Intercultural Competencefiles7.webydo.com/91/9185608/UploadedFiles/6B09E36... · Assessing Intercultural Competence: Case Studies from the Field - Part B Chris Cartwright,](https://reader035.fdocuments.us/reader035/viewer/2022063022/5fe71db3fa722938587ff91c/html5/thumbnails/2.jpg)
2 2
n What is it? n How to recognize it? n How to asses it? n Your questions!
Agenda
![Page 3: Assessing Intercultural Competencefiles7.webydo.com/91/9185608/UploadedFiles/6B09E36... · Assessing Intercultural Competence: Case Studies from the Field - Part B Chris Cartwright,](https://reader035.fdocuments.us/reader035/viewer/2022063022/5fe71db3fa722938587ff91c/html5/thumbnails/3.jpg)
3
Culture is the Software of the Mind
![Page 4: Assessing Intercultural Competencefiles7.webydo.com/91/9185608/UploadedFiles/6B09E36... · Assessing Intercultural Competence: Case Studies from the Field - Part B Chris Cartwright,](https://reader035.fdocuments.us/reader035/viewer/2022063022/5fe71db3fa722938587ff91c/html5/thumbnails/4.jpg)
4
What is a Competency?The quality of being adequately or well-qualified physically & intellectually.
http://www.visualthesaurus.com/
![Page 5: Assessing Intercultural Competencefiles7.webydo.com/91/9185608/UploadedFiles/6B09E36... · Assessing Intercultural Competence: Case Studies from the Field - Part B Chris Cartwright,](https://reader035.fdocuments.us/reader035/viewer/2022063022/5fe71db3fa722938587ff91c/html5/thumbnails/5.jpg)
5
Intercultural Competency:
• A Mind set: Knowledge
• A Heart set: Attitude
• A Skill set: Abilities
![Page 6: Assessing Intercultural Competencefiles7.webydo.com/91/9185608/UploadedFiles/6B09E36... · Assessing Intercultural Competence: Case Studies from the Field - Part B Chris Cartwright,](https://reader035.fdocuments.us/reader035/viewer/2022063022/5fe71db3fa722938587ff91c/html5/thumbnails/6.jpg)
6
Gap vs. Competency Assessments
GAP
COMPETENCY
![Page 7: Assessing Intercultural Competencefiles7.webydo.com/91/9185608/UploadedFiles/6B09E36... · Assessing Intercultural Competence: Case Studies from the Field - Part B Chris Cartwright,](https://reader035.fdocuments.us/reader035/viewer/2022063022/5fe71db3fa722938587ff91c/html5/thumbnails/7.jpg)
7
HIGH-PERFORMING���PEOPLE IN ���
CROSS-CULTURAL& DIVERSE CONTEXTS
RelevantOperationalKnowledge
Personal Competencies
TechnicalExpertise
INTERCULTURAL ADAPTATION MODEL
![Page 8: Assessing Intercultural Competencefiles7.webydo.com/91/9185608/UploadedFiles/6B09E36... · Assessing Intercultural Competence: Case Studies from the Field - Part B Chris Cartwright,](https://reader035.fdocuments.us/reader035/viewer/2022063022/5fe71db3fa722938587ff91c/html5/thumbnails/8.jpg)
8
THE BUCKET (FACTOR) MODEL
PERSONALCOMPETENCIES
Learn & UnderstandEffectively
Develop &Manage
RelationshipsEffectively
Manage Self Effectively in Challenging Situations
![Page 9: Assessing Intercultural Competencefiles7.webydo.com/91/9185608/UploadedFiles/6B09E36... · Assessing Intercultural Competence: Case Studies from the Field - Part B Chris Cartwright,](https://reader035.fdocuments.us/reader035/viewer/2022063022/5fe71db3fa722938587ff91c/html5/thumbnails/9.jpg)
The Intercultural Effectiveness ScaleINTERCULTURAL EFFECTIVENESS SCALE
CONTINUOUS LEARNING
INTERPERSONAL ENGAGEMENT
HARDINESS
Exploration Global Mindset Positive Regard
Self-Awareness Relationship Interest Resilience
![Page 10: Assessing Intercultural Competencefiles7.webydo.com/91/9185608/UploadedFiles/6B09E36... · Assessing Intercultural Competence: Case Studies from the Field - Part B Chris Cartwright,](https://reader035.fdocuments.us/reader035/viewer/2022063022/5fe71db3fa722938587ff91c/html5/thumbnails/10.jpg)
Continuous Learning Self-Awareness & Exploration
IES - Continuous Learning
![Page 11: Assessing Intercultural Competencefiles7.webydo.com/91/9185608/UploadedFiles/6B09E36... · Assessing Intercultural Competence: Case Studies from the Field - Part B Chris Cartwright,](https://reader035.fdocuments.us/reader035/viewer/2022063022/5fe71db3fa722938587ff91c/html5/thumbnails/11.jpg)
Interpersonal Engagement IES – Interpersonal Engagement
Global Mindset & Relationship
Interest
![Page 12: Assessing Intercultural Competencefiles7.webydo.com/91/9185608/UploadedFiles/6B09E36... · Assessing Intercultural Competence: Case Studies from the Field - Part B Chris Cartwright,](https://reader035.fdocuments.us/reader035/viewer/2022063022/5fe71db3fa722938587ff91c/html5/thumbnails/12.jpg)
Hardiness
IES – Hardiness
Positive Regard & Resilience
![Page 13: Assessing Intercultural Competencefiles7.webydo.com/91/9185608/UploadedFiles/6B09E36... · Assessing Intercultural Competence: Case Studies from the Field - Part B Chris Cartwright,](https://reader035.fdocuments.us/reader035/viewer/2022063022/5fe71db3fa722938587ff91c/html5/thumbnails/13.jpg)
IES Results Report
![Page 14: Assessing Intercultural Competencefiles7.webydo.com/91/9185608/UploadedFiles/6B09E36... · Assessing Intercultural Competence: Case Studies from the Field - Part B Chris Cartwright,](https://reader035.fdocuments.us/reader035/viewer/2022063022/5fe71db3fa722938587ff91c/html5/thumbnails/14.jpg)
14
Low Moderate High
1 2 3 4 5 6 A. Continuous Learning 1 3 1 1 3 7 Exploration 3 1 2 3 7
Self-Awareness 2 1 2 2 9
B. Interpersonal Engagement 3 4 4 5 Global Mindset 1 4 2 9 Relationship Interest 2 2 1 6 5 C. Hardiness 1 2 2 11 Positive Regard 8 8 Emotional Resilience 3 1 1 1 3 7 Overall IES Score 1 4 11
IES Group Report
![Page 15: Assessing Intercultural Competencefiles7.webydo.com/91/9185608/UploadedFiles/6B09E36... · Assessing Intercultural Competence: Case Studies from the Field - Part B Chris Cartwright,](https://reader035.fdocuments.us/reader035/viewer/2022063022/5fe71db3fa722938587ff91c/html5/thumbnails/15.jpg)
15
Properties of a Good Assessment Instrument
![Page 16: Assessing Intercultural Competencefiles7.webydo.com/91/9185608/UploadedFiles/6B09E36... · Assessing Intercultural Competence: Case Studies from the Field - Part B Chris Cartwright,](https://reader035.fdocuments.us/reader035/viewer/2022063022/5fe71db3fa722938587ff91c/html5/thumbnails/16.jpg)
16
Intercultural Knowledge & ���Competence Rubric§ Knowledge § Cultural self- awareness § Knowledge of cultural worldview frameworks
§ Skills § Empathy § Verbal and nonverbal communication
§ Attitudes § Curiosity § Openness
![Page 17: Assessing Intercultural Competencefiles7.webydo.com/91/9185608/UploadedFiles/6B09E36... · Assessing Intercultural Competence: Case Studies from the Field - Part B Chris Cartwright,](https://reader035.fdocuments.us/reader035/viewer/2022063022/5fe71db3fa722938587ff91c/html5/thumbnails/17.jpg)
17 17
Case Studies
![Page 18: Assessing Intercultural Competencefiles7.webydo.com/91/9185608/UploadedFiles/6B09E36... · Assessing Intercultural Competence: Case Studies from the Field - Part B Chris Cartwright,](https://reader035.fdocuments.us/reader035/viewer/2022063022/5fe71db3fa722938587ff91c/html5/thumbnails/18.jpg)
Assessing A Pilot Program to Create Higher Impact Short Term Study Abroad
Marty Petrone [email protected]
![Page 19: Assessing Intercultural Competencefiles7.webydo.com/91/9185608/UploadedFiles/6B09E36... · Assessing Intercultural Competence: Case Studies from the Field - Part B Chris Cartwright,](https://reader035.fdocuments.us/reader035/viewer/2022063022/5fe71db3fa722938587ff91c/html5/thumbnails/19.jpg)
Mo<va<on: Results of the Miami University Global Assessment Project
Challenge: How can we encourage study abroad students to engage below the water line?
![Page 20: Assessing Intercultural Competencefiles7.webydo.com/91/9185608/UploadedFiles/6B09E36... · Assessing Intercultural Competence: Case Studies from the Field - Part B Chris Cartwright,](https://reader035.fdocuments.us/reader035/viewer/2022063022/5fe71db3fa722938587ff91c/html5/thumbnails/20.jpg)
VVsi
Goal: To incorporate “stealth” interventions In select study abroad programs
intentionally designed to both enhance and assess student cultural competence.
![Page 21: Assessing Intercultural Competencefiles7.webydo.com/91/9185608/UploadedFiles/6B09E36... · Assessing Intercultural Competence: Case Studies from the Field - Part B Chris Cartwright,](https://reader035.fdocuments.us/reader035/viewer/2022063022/5fe71db3fa722938587ff91c/html5/thumbnails/21.jpg)
1. Iden<fying the learning outcomes
students are to achieve while studying abroad and… 2. Then work backward to iden<fy and build in the designed to facilitate the
achievement of those outcomes. Engle, L. & Engle, J. 2004
Reverse Engineering Process
![Page 22: Assessing Intercultural Competencefiles7.webydo.com/91/9185608/UploadedFiles/6B09E36... · Assessing Intercultural Competence: Case Studies from the Field - Part B Chris Cartwright,](https://reader035.fdocuments.us/reader035/viewer/2022063022/5fe71db3fa722938587ff91c/html5/thumbnails/22.jpg)
Desired Learning Outcomes ü Greater awareness of one’s own cultural norms and
unique worldview
ü Increased understanding of the values underpinning other cultural perspectives
ü Ability to apply cultural competency in daily interactions
ü Better preparation for effective participation in an
interconnected, ever-changing world
![Page 23: Assessing Intercultural Competencefiles7.webydo.com/91/9185608/UploadedFiles/6B09E36... · Assessing Intercultural Competence: Case Studies from the Field - Part B Chris Cartwright,](https://reader035.fdocuments.us/reader035/viewer/2022063022/5fe71db3fa722938587ff91c/html5/thumbnails/23.jpg)
• 28 students studying abroad for six weeks during summer term in Florence Italy
The Pilot Program
![Page 24: Assessing Intercultural Competencefiles7.webydo.com/91/9185608/UploadedFiles/6B09E36... · Assessing Intercultural Competence: Case Studies from the Field - Part B Chris Cartwright,](https://reader035.fdocuments.us/reader035/viewer/2022063022/5fe71db3fa722938587ff91c/html5/thumbnails/24.jpg)
• Intercultural Effec<veness Scale Pre and Post • Individual Personal Development Planning
• AAC&U KNOWLEDGE AND COMPETENCE VALUE RUBRIC • Contact & Reflec<on on Private Facebook Site • Weekly group mee<ngs with cultural mentor
• Peer Assessment/Observa<on
• Self-‐Repor<ng
Assessment Strategies
![Page 25: Assessing Intercultural Competencefiles7.webydo.com/91/9185608/UploadedFiles/6B09E36... · Assessing Intercultural Competence: Case Studies from the Field - Part B Chris Cartwright,](https://reader035.fdocuments.us/reader035/viewer/2022063022/5fe71db3fa722938587ff91c/html5/thumbnails/25.jpg)
1. Students create a personal development plan based on their IES scores.
2. They report their PDP progress on a frequent basis (could be a
journal or blog)
3. They have a truly immersive experience where they form rela<onships with locals and ideally accomplish a joint task(s) with them at some point.
4. They par<cipate in mediated learning with facilitated discussions to help them make sense of what they encounter.
Four Cri<cal Components
![Page 26: Assessing Intercultural Competencefiles7.webydo.com/91/9185608/UploadedFiles/6B09E36... · Assessing Intercultural Competence: Case Studies from the Field - Part B Chris Cartwright,](https://reader035.fdocuments.us/reader035/viewer/2022063022/5fe71db3fa722938587ff91c/html5/thumbnails/26.jpg)
• A two-‐part pre-‐departure orienta<on
• Intercultural training while in Florence including two days of orienta<on ac<vi<es
• Reflec<ve assignments designed to fostering independence, self-‐direc<on, and personal safety when in Florence or traveling to other loca<ons.
• Survival Italian using LAMP Method
• Weekly structured ac<vi<es for local engagement
• Re-‐entry training and post-‐program debriefing
Sample Interven<ons
![Page 27: Assessing Intercultural Competencefiles7.webydo.com/91/9185608/UploadedFiles/6B09E36... · Assessing Intercultural Competence: Case Studies from the Field - Part B Chris Cartwright,](https://reader035.fdocuments.us/reader035/viewer/2022063022/5fe71db3fa722938587ff91c/html5/thumbnails/27.jpg)
“I feel like I am on my way to achieving these goals. Through all explora;on, I am star;ng to understand Italian culture. My new goal is to start to feel comfortable with Italian culture. I am in the 2nd level of culture shock and am feeling really out of place here. In order to achieve this goal I’m going to con;nue to talk to locals and ask them about their culture and try to immerse myself more.”
Midterm Self-‐Assessment
![Page 28: Assessing Intercultural Competencefiles7.webydo.com/91/9185608/UploadedFiles/6B09E36... · Assessing Intercultural Competence: Case Studies from the Field - Part B Chris Cartwright,](https://reader035.fdocuments.us/reader035/viewer/2022063022/5fe71db3fa722938587ff91c/html5/thumbnails/28.jpg)
• Overall score increase 19
1 point 5 2 points 3
3 points 3 4 points 4 5 points 4
• Overall score maintained 5
• Overall score lower 4
IES Post Test Results
![Page 29: Assessing Intercultural Competencefiles7.webydo.com/91/9185608/UploadedFiles/6B09E36... · Assessing Intercultural Competence: Case Studies from the Field - Part B Chris Cartwright,](https://reader035.fdocuments.us/reader035/viewer/2022063022/5fe71db3fa722938587ff91c/html5/thumbnails/29.jpg)
• I have a stronger desire to adapt and fit into other cultures. Also, I have a greater sense of respect and empathy towards people who may not be in a place
they feel comfortable.
• I observe how people interact/how I interact with people. Learning how things work here gave me a new perspec?ve and pa?ence.
• I am not afraid to start a conversa?on with someone that doesn’t speak English as their na?ve language. I do not fear communica?on setbacks.
In what ways do you feel more culturally competent than when you first arrived in Italy?
![Page 30: Assessing Intercultural Competencefiles7.webydo.com/91/9185608/UploadedFiles/6B09E36... · Assessing Intercultural Competence: Case Studies from the Field - Part B Chris Cartwright,](https://reader035.fdocuments.us/reader035/viewer/2022063022/5fe71db3fa722938587ff91c/html5/thumbnails/30.jpg)
• To me, the most important thing I’ve learned is self-‐awareness, specifically rela?ng to my American background.
• That even though I was nervous about using the language
and sounding dumb, I did it anyways and when I was done I felt accomplished.
• I have learned how my personality and choices affect other people of my own culture and of other cultures. Also [I] developed more awareness of my strengths and weaknesses.
What is the most significant thing you learned in the past six weeks either in or out of the classroom?
![Page 31: Assessing Intercultural Competencefiles7.webydo.com/91/9185608/UploadedFiles/6B09E36... · Assessing Intercultural Competence: Case Studies from the Field - Part B Chris Cartwright,](https://reader035.fdocuments.us/reader035/viewer/2022063022/5fe71db3fa722938587ff91c/html5/thumbnails/31.jpg)
Discovering Global Ci<zenship • Assessing Intercultural Competence at TCU
Texas Christian University Chris Hightower
![Page 32: Assessing Intercultural Competencefiles7.webydo.com/91/9185608/UploadedFiles/6B09E36... · Assessing Intercultural Competence: Case Studies from the Field - Part B Chris Cartwright,](https://reader035.fdocuments.us/reader035/viewer/2022063022/5fe71db3fa722938587ff91c/html5/thumbnails/32.jpg)
TCU Fast Facts
To educate individuals to think and act as ethical leaders and responsible citizens in the global community.
Texas Christian University Chris Hightower
• Mission
• Enrollment of 10,033 (8,647 undergraduates; 1,386 graduate students)
• 117 undergraduate areas of study, 62 master’s level programs, 25 areas of doctoral study
• Students
• The University • 2014-2015 annual budget of $547 million • Endowment as of June 30, 2014, of $1.44 billion • Freshman-to-sophomore retention rate of 90 percent • Student/faculty ratio approximately 13 to 1
![Page 33: Assessing Intercultural Competencefiles7.webydo.com/91/9185608/UploadedFiles/6B09E36... · Assessing Intercultural Competence: Case Studies from the Field - Part B Chris Cartwright,](https://reader035.fdocuments.us/reader035/viewer/2022063022/5fe71db3fa722938587ff91c/html5/thumbnails/33.jpg)
• Developed as a result of the university’s Quality Enhancement Plan
• Increased effort toward comprehensive internationalization
• Focused on developing countries and communities where TCU has minimal engagement
Texas Christian University Chris Hightower
qep.tcu.edu
![Page 34: Assessing Intercultural Competencefiles7.webydo.com/91/9185608/UploadedFiles/6B09E36... · Assessing Intercultural Competence: Case Studies from the Field - Part B Chris Cartwright,](https://reader035.fdocuments.us/reader035/viewer/2022063022/5fe71db3fa722938587ff91c/html5/thumbnails/34.jpg)
Student Learning Outcomes Students will identify global issues from the perspectives of multiple disciplines and cultures
Texas Christian University Chris Hightower
Students will discuss critical questions about the impact of global issues on domestic and global communities
• Foundational Level
• Engagement Level
• Understanding Others Level Students will develop cultural empathy and intercultural competence
Students will make responsible decisions about global issues
• Action and Application Level
![Page 35: Assessing Intercultural Competencefiles7.webydo.com/91/9185608/UploadedFiles/6B09E36... · Assessing Intercultural Competence: Case Studies from the Field - Part B Chris Cartwright,](https://reader035.fdocuments.us/reader035/viewer/2022063022/5fe71db3fa722938587ff91c/html5/thumbnails/35.jpg)
Initiatives
Visiting Scholars
Texas Christian University Chris Hightower
Virtual Voyage
Global Academy
Local-Global Leaders
Global Innovators
TCU Abroad
![Page 36: Assessing Intercultural Competencefiles7.webydo.com/91/9185608/UploadedFiles/6B09E36... · Assessing Intercultural Competence: Case Studies from the Field - Part B Chris Cartwright,](https://reader035.fdocuments.us/reader035/viewer/2022063022/5fe71db3fa722938587ff91c/html5/thumbnails/36.jpg)
Assessment Methods Intercultural Effectiveness Scale (IES)
Texas Christian University Chris Hightower
• Pre-Test/Post-Test
Reflection work using online ePortfolio software provided by Digication
• FrogFolio
• Artifact Collection Application of AAC&U Global Learning VALUE Rubric on student products
Observed measurable progress through academic or programmatic projects
• Capstone Projects
![Page 37: Assessing Intercultural Competencefiles7.webydo.com/91/9185608/UploadedFiles/6B09E36... · Assessing Intercultural Competence: Case Studies from the Field - Part B Chris Cartwright,](https://reader035.fdocuments.us/reader035/viewer/2022063022/5fe71db3fa722938587ff91c/html5/thumbnails/37.jpg)
Implementation of Methods
• Build individualized Mentor-Mentee relationships • Review individual IES reports • Prepare Personal Development Plans • Introduce FrogFolio to students
Texas Christian University Chris Hightower
• The University Experience
• All incoming students are asked to complete the IES (72% completion rate: 2013 – 1,355 & 2014 – 1,373)
• Graduating seniors are asked to complete the IES (43% completion rate: 2014 – 561)
• Intercultural Effectiveness Scale
• Other Data & Database Warehouse • Purple People Counters • Student surveys after programs • Academic and programmatic artifact collection
![Page 38: Assessing Intercultural Competencefiles7.webydo.com/91/9185608/UploadedFiles/6B09E36... · Assessing Intercultural Competence: Case Studies from the Field - Part B Chris Cartwright,](https://reader035.fdocuments.us/reader035/viewer/2022063022/5fe71db3fa722938587ff91c/html5/thumbnails/38.jpg)
Chris Hightower • Office of the Chancellor • O: 817.257.4158 | F: 817.257.7373
• 2900 South University Drive | Sadler 3001 • TCU Box 297028 | Fort Worth, TX 76129
Texas Christian University Chris Hightower
![Page 39: Assessing Intercultural Competencefiles7.webydo.com/91/9185608/UploadedFiles/6B09E36... · Assessing Intercultural Competence: Case Studies from the Field - Part B Chris Cartwright,](https://reader035.fdocuments.us/reader035/viewer/2022063022/5fe71db3fa722938587ff91c/html5/thumbnails/39.jpg)
INTERCULTURAL EFFECTIVENESS ASSESSMENT: A COMPREHENSIVE PROGRAM DESIGN
Dr. Iris Berdrow Bentley University [email protected] IUPUI 2014
![Page 40: Assessing Intercultural Competencefiles7.webydo.com/91/9185608/UploadedFiles/6B09E36... · Assessing Intercultural Competence: Case Studies from the Field - Part B Chris Cartwright,](https://reader035.fdocuments.us/reader035/viewer/2022063022/5fe71db3fa722938587ff91c/html5/thumbnails/40.jpg)
• University within a business school • Accredited by AACSB, EQUIS, NEASC • Undergraduate Curriculum:
– General educa<on core (freshmen to senior yrs) – General business core (freshmen to senior yrs) – Majors/minors (including Liberal Studies Major)
• Graduate Curriculum – 3 MBA, 7 MS Programs, MBA+MS
• PhD Program – Accountancy, Business
![Page 41: Assessing Intercultural Competencefiles7.webydo.com/91/9185608/UploadedFiles/6B09E36... · Assessing Intercultural Competence: Case Studies from the Field - Part B Chris Cartwright,](https://reader035.fdocuments.us/reader035/viewer/2022063022/5fe71db3fa722938587ff91c/html5/thumbnails/41.jpg)
UG General Business Core Goals and Learning Objec<ves..
Goal: Our students will be knowledgeable about domesMc and global business pracMces. Learning Objec<ve: Our students will iden<fy the challenges of opera<ng in an interna<onal environment.
Goal: Our students will be able to funcMon effecMvely in cross cultural situaMons. Learning Objec<ve: Our students will demonstrate personal competencies associated with environments where there are cultural norms and behaviors different from their own.
![Page 42: Assessing Intercultural Competencefiles7.webydo.com/91/9185608/UploadedFiles/6B09E36... · Assessing Intercultural Competence: Case Studies from the Field - Part B Chris Cartwright,](https://reader035.fdocuments.us/reader035/viewer/2022063022/5fe71db3fa722938587ff91c/html5/thumbnails/42.jpg)
Are student’s global competences improving as a result of our efforts to provide cogni<ve and
experien<al interna<onal educa<on opportuni<es? Is it
working?
![Page 43: Assessing Intercultural Competencefiles7.webydo.com/91/9185608/UploadedFiles/6B09E36... · Assessing Intercultural Competence: Case Studies from the Field - Part B Chris Cartwright,](https://reader035.fdocuments.us/reader035/viewer/2022063022/5fe71db3fa722938587ff91c/html5/thumbnails/43.jpg)
ENVIRONMENT the ‘talents’ we are trying to
develop in our educational program
INPUTS personal qualities the student brings
initially to the education program
OUTCOMES student’s actual experiences
during the educational program
Astin’s I-E-O
Model of Effective Assessment
A: Students choose to participate in
different aspects of the educational
environment
B: The educational environment has an impact on the outcomes (concern of assessment)
C: Differences among students show some
consistency over time.
ASSESSMENT IN CONTEXT
Assessment Strategy: Reflec<ng and ac<ng on the learning outcomes of our undergraduate and graduate curricula in the context of learning opportuni<es provided, pedagogies used, as well as students’ incoming characteris<cs, non-‐curricular experiences and gradua<on aspira<ons.
![Page 44: Assessing Intercultural Competencefiles7.webydo.com/91/9185608/UploadedFiles/6B09E36... · Assessing Intercultural Competence: Case Studies from the Field - Part B Chris Cartwright,](https://reader035.fdocuments.us/reader035/viewer/2022063022/5fe71db3fa722938587ff91c/html5/thumbnails/44.jpg)
ENVIRONMENT IEIA
International Education Experiences
INPUTS IEIA
Student Demographics and Prior International Experience
OUTCOMES IES
What are student intentions, motivations and behaviors relative
to IEO’s?
Is there a correlation between engaging in
IEO’s and IES?
Are there differences in IES between gender, GPA,
choice of major, national background?
Intercultural Effec<veness Assessment
2 Instruments: IEIA (Intercultural Effec<veness Impact
Assessment) IES (Intercultural Effec<veness Scale)
![Page 45: Assessing Intercultural Competencefiles7.webydo.com/91/9185608/UploadedFiles/6B09E36... · Assessing Intercultural Competence: Case Studies from the Field - Part B Chris Cartwright,](https://reader035.fdocuments.us/reader035/viewer/2022063022/5fe71db3fa722938587ff91c/html5/thumbnails/45.jpg)
Measures personality predisposi<ons associated with effec<veness in intercultural situa<ons.
An Overall IES score is generated by combining the scores
of the six sub-‐dimensions
The Intercultural EffecMveness Scale (IES)
Continuous Learning
Interpersonal Engagement Hardiness
Exploration Global Mindset Positive Regard
Self- Awareness Relationship Interest Resilience
* Developed and administered by The Kozai Group, Inc.
![Page 46: Assessing Intercultural Competencefiles7.webydo.com/91/9185608/UploadedFiles/6B09E36... · Assessing Intercultural Competence: Case Studies from the Field - Part B Chris Cartwright,](https://reader035.fdocuments.us/reader035/viewer/2022063022/5fe71db3fa722938587ff91c/html5/thumbnails/46.jpg)
• Part 1: IES self assessment and reflec<on • Part 2: Crea<ng an IES Profile • Part 3: General Tendencies • Part 4: Personal Development Plan • Part 5: Reflec<on
Student Intercultural Evalua<on Assignment
![Page 47: Assessing Intercultural Competencefiles7.webydo.com/91/9185608/UploadedFiles/6B09E36... · Assessing Intercultural Competence: Case Studies from the Field - Part B Chris Cartwright,](https://reader035.fdocuments.us/reader035/viewer/2022063022/5fe71db3fa722938587ff91c/html5/thumbnails/47.jpg)
DATA ANALYSIS DESIGN YEAR 2 YEAR 4 LONGITUDINAL
ANALYSIS Inten<on Behavior Mo<va<on Demographics IES Score
Inten<on Behavior Mo<va<on Demographics IES Score
• Interna<onal program effec<veness
• Instrument and design tes<ng. • Development of pedagogical materials to support educa<on and development efforts.
CORRELATION ANALYSIS • Student self reflec<on, development , and career planning.
• Assessment of global competencies. • Predisposi<on Assessment.
![Page 48: Assessing Intercultural Competencefiles7.webydo.com/91/9185608/UploadedFiles/6B09E36... · Assessing Intercultural Competence: Case Studies from the Field - Part B Chris Cartwright,](https://reader035.fdocuments.us/reader035/viewer/2022063022/5fe71db3fa722938587ff91c/html5/thumbnails/48.jpg)
• Pilot I: 2006, 2007 with 514 students • 2008: IEIA revision • Pilot II: 2009 (235 students), 2010 (144 students) • Longitudinal assessment program rollout:
– Pre assessment in 2010 with sophomores – Post assessment in 2012 with Seniors – By 2012 could match pre and post
• Current analysis based on 2,096 responses collected between 2010 and 2014: – 1632 sophomores – 464 seniors
DATA COLLECTION
![Page 49: Assessing Intercultural Competencefiles7.webydo.com/91/9185608/UploadedFiles/6B09E36... · Assessing Intercultural Competence: Case Studies from the Field - Part B Chris Cartwright,](https://reader035.fdocuments.us/reader035/viewer/2022063022/5fe71db3fa722938587ff91c/html5/thumbnails/49.jpg)
• Being at Bentley longer? – Seniors scored significantly higher than Sophomores on all dimensions
• Being an Interna<onal Student? – Interna<onal students scored higher than Domes<c students on Explora<on, Global Mindset, Rela<onship. Interest, Con<nuous Learning, Interpersonal Engagement, and Overall IES.
– Domes<c students scored higher than Interna<onal students on Posi<ve Regard and Hardiness.
Preliminary Descrip<ve Findings
* Results based on independent sample t-tests. Significance assessed at P<.05.
![Page 50: Assessing Intercultural Competencefiles7.webydo.com/91/9185608/UploadedFiles/6B09E36... · Assessing Intercultural Competence: Case Studies from the Field - Part B Chris Cartwright,](https://reader035.fdocuments.us/reader035/viewer/2022063022/5fe71db3fa722938587ff91c/html5/thumbnails/50.jpg)
• Having an Interna<onal Educa<on Experience while at Bentley? – Students who had an IE scored higher on all dimensions.
• Planning on an Interna<onal Educa<on Experience? – Students who were not planning on having an IE scored lower on Explora<on, Global Mindset, Rela<onship Interest, Interpersonal Engagement, and Overall IES.
• Gender? – Men scored higher on Self Awareness, Global Mindset, Emo<onal Resilience, and Hardiness.
– Women scored higher on Explora<on, Rela<onship Interest, and Posi<ve Regard.
PRELIMINARY DESCRIPTIVE FINDINGS
* Results based on independent sample t-tests. Significance assessed at P<.05.
![Page 51: Assessing Intercultural Competencefiles7.webydo.com/91/9185608/UploadedFiles/6B09E36... · Assessing Intercultural Competence: Case Studies from the Field - Part B Chris Cartwright,](https://reader035.fdocuments.us/reader035/viewer/2022063022/5fe71db3fa722938587ff91c/html5/thumbnails/51.jpg)
• Faculty Commitment • Student response to results • Providing peer and aspirant comparisons • Data management • Ins<tu<onal priori<es • Office of Interna<onal Educa<on Partnership
Lessons Learned
![Page 52: Assessing Intercultural Competencefiles7.webydo.com/91/9185608/UploadedFiles/6B09E36... · Assessing Intercultural Competence: Case Studies from the Field - Part B Chris Cartwright,](https://reader035.fdocuments.us/reader035/viewer/2022063022/5fe71db3fa722938587ff91c/html5/thumbnails/52.jpg)
![Page 53: Assessing Intercultural Competencefiles7.webydo.com/91/9185608/UploadedFiles/6B09E36... · Assessing Intercultural Competence: Case Studies from the Field - Part B Chris Cartwright,](https://reader035.fdocuments.us/reader035/viewer/2022063022/5fe71db3fa722938587ff91c/html5/thumbnails/53.jpg)
1. Does just being at Bentley longer correlate with higher IES scores?
2. Does taking an interna<onal educa<on experience at Bentley correlate with higher IES scores?
3. Do certain interna<onal educa<on experiences correlate differently? I.e. does intensity of experience or cultural distance from home maqer more?
4. Does previous interna<onal experience influence scores and movement in scores?
5. Do student inten<ons, mo<va<ons and behaviors influence scores?
6. Do some student groups (i.e. honors, LSM, higher GPA’s) just score differently?
Intercultural EffecMveness Assessment QuesMons
![Page 54: Assessing Intercultural Competencefiles7.webydo.com/91/9185608/UploadedFiles/6B09E36... · Assessing Intercultural Competence: Case Studies from the Field - Part B Chris Cartwright,](https://reader035.fdocuments.us/reader035/viewer/2022063022/5fe71db3fa722938587ff91c/html5/thumbnails/54.jpg)
54 54
Assessing Intercultural Competence: Case Studies from the Field - Part B
Chris Cartwright, Intercultural Communication Institute Dr. Iris Berdrow,Bentley University Chris Hightower, Texas Christian University Martha (Marty) Petrone, Miami University of Ohio
2014 Assessment Institute, in Indianapolis
![Page 55: Assessing Intercultural Competencefiles7.webydo.com/91/9185608/UploadedFiles/6B09E36... · Assessing Intercultural Competence: Case Studies from the Field - Part B Chris Cartwright,](https://reader035.fdocuments.us/reader035/viewer/2022063022/5fe71db3fa722938587ff91c/html5/thumbnails/55.jpg)
55
55 55
n What is it? n How to assess it? n Why asses it? n What if – we assess it? n Questions!
Agenda
![Page 56: Assessing Intercultural Competencefiles7.webydo.com/91/9185608/UploadedFiles/6B09E36... · Assessing Intercultural Competence: Case Studies from the Field - Part B Chris Cartwright,](https://reader035.fdocuments.us/reader035/viewer/2022063022/5fe71db3fa722938587ff91c/html5/thumbnails/56.jpg)
Fish is Fish
By Leo Leoni
![Page 57: Assessing Intercultural Competencefiles7.webydo.com/91/9185608/UploadedFiles/6B09E36... · Assessing Intercultural Competence: Case Studies from the Field - Part B Chris Cartwright,](https://reader035.fdocuments.us/reader035/viewer/2022063022/5fe71db3fa722938587ff91c/html5/thumbnails/57.jpg)
Perspective
![Page 58: Assessing Intercultural Competencefiles7.webydo.com/91/9185608/UploadedFiles/6B09E36... · Assessing Intercultural Competence: Case Studies from the Field - Part B Chris Cartwright,](https://reader035.fdocuments.us/reader035/viewer/2022063022/5fe71db3fa722938587ff91c/html5/thumbnails/58.jpg)
Perspective
![Page 59: Assessing Intercultural Competencefiles7.webydo.com/91/9185608/UploadedFiles/6B09E36... · Assessing Intercultural Competence: Case Studies from the Field - Part B Chris Cartwright,](https://reader035.fdocuments.us/reader035/viewer/2022063022/5fe71db3fa722938587ff91c/html5/thumbnails/59.jpg)
Things We Know About ���Intercultural Competence:• Cultural
knowledge
• Cultural contact
• Reduction of stereotypes
• Language
59
![Page 60: Assessing Intercultural Competencefiles7.webydo.com/91/9185608/UploadedFiles/6B09E36... · Assessing Intercultural Competence: Case Studies from the Field - Part B Chris Cartwright,](https://reader035.fdocuments.us/reader035/viewer/2022063022/5fe71db3fa722938587ff91c/html5/thumbnails/60.jpg)
Individual DevelopmentRequires:
§ Self-motivation
§ Learn & Transform
§ Experiential Learning & Reflection
§ Crucible Experiences
§ Cross-Cultural Exposure
§ Extensive Practice60
![Page 61: Assessing Intercultural Competencefiles7.webydo.com/91/9185608/UploadedFiles/6B09E36... · Assessing Intercultural Competence: Case Studies from the Field - Part B Chris Cartwright,](https://reader035.fdocuments.us/reader035/viewer/2022063022/5fe71db3fa722938587ff91c/html5/thumbnails/61.jpg)
What Can Campuses Do? O ? § Multicultural teams
§ Local cultural immersions
§ Study abroad & diverse field work
§ Global/diverse projects
§ Mentors/coaches
§ Behavioral + Pre & Post assessment
61
Provide & Leverage Experiences:
![Page 62: Assessing Intercultural Competencefiles7.webydo.com/91/9185608/UploadedFiles/6B09E36... · Assessing Intercultural Competence: Case Studies from the Field - Part B Chris Cartwright,](https://reader035.fdocuments.us/reader035/viewer/2022063022/5fe71db3fa722938587ff91c/html5/thumbnails/62.jpg)
62
What Leads to ���Intercultural Competence?
• Intentional Design
• Balance
• Book End
![Page 63: Assessing Intercultural Competencefiles7.webydo.com/91/9185608/UploadedFiles/6B09E36... · Assessing Intercultural Competence: Case Studies from the Field - Part B Chris Cartwright,](https://reader035.fdocuments.us/reader035/viewer/2022063022/5fe71db3fa722938587ff91c/html5/thumbnails/63.jpg)
63
Low High
High
DEVELOPMENTAL METHODOLOGIESHighest PotenMal For Re-‐mapping
Classroom (20%)
Info Exchanges w/Culturally
Different others (30%)
Personal Study/Work Experience (50%)
RIG
OR
FEEDBACK
![Page 64: Assessing Intercultural Competencefiles7.webydo.com/91/9185608/UploadedFiles/6B09E36... · Assessing Intercultural Competence: Case Studies from the Field - Part B Chris Cartwright,](https://reader035.fdocuments.us/reader035/viewer/2022063022/5fe71db3fa722938587ff91c/html5/thumbnails/64.jpg)
64
How do YOU know THEY know?
![Page 65: Assessing Intercultural Competencefiles7.webydo.com/91/9185608/UploadedFiles/6B09E36... · Assessing Intercultural Competence: Case Studies from the Field - Part B Chris Cartwright,](https://reader035.fdocuments.us/reader035/viewer/2022063022/5fe71db3fa722938587ff91c/html5/thumbnails/65.jpg)
Discussion
• How do (or would) you assess ICC?
• Why do (or would) you asses ICC?
• What if you assessed ICC?
65
![Page 66: Assessing Intercultural Competencefiles7.webydo.com/91/9185608/UploadedFiles/6B09E36... · Assessing Intercultural Competence: Case Studies from the Field - Part B Chris Cartwright,](https://reader035.fdocuments.us/reader035/viewer/2022063022/5fe71db3fa722938587ff91c/html5/thumbnails/66.jpg)
66
66
“There is wisdom in turning as often as possible from the familiar to the unfamiliar: it keeps the mind nimble, it kills prejudice, and it fosters humor.” -George Santayana, philosopher, (1863-1952)
![Page 67: Assessing Intercultural Competencefiles7.webydo.com/91/9185608/UploadedFiles/6B09E36... · Assessing Intercultural Competence: Case Studies from the Field - Part B Chris Cartwright,](https://reader035.fdocuments.us/reader035/viewer/2022063022/5fe71db3fa722938587ff91c/html5/thumbnails/67.jpg)
67
Chris Cartwright, MPA, Ed.D. Director Intercultural Assessment Intercultural Communication Institute SKYPE: cartwrightc2 [email protected]
Dr. Iris Berdrow, MBA, Ph.D. Associate Professor of Management Bentley University 781-891-2130 [email protected]
Chris Hightower, M.Ed.Texas Christian UniversityOffice of the ChancellorOffice for Institutional EffectivenessOffice: 817.257.7156, [email protected] Martha (Marty) Petrone, Ph.D.Professor, Emerita & Cultural Immersion CoordinatorOffice of Global InitiativesMiami University of Ohio [email protected]