Dr Theresa KWONGCentre for Holistic Teaching and Learning, Hong Kong Baptist University

Learning & Teaching Expo 2016, December 2016

http://ar-learn.com

OUTLINE

Background and Objectives (a short video)

Overview of Trails of Academic Integrity and Ethics (TIEs)

Results Highlight

Showcase of a Discipline-specific TIE (TIE-SR)

Moving Forward

http://ar-learn.com

http://chtl.hkbu.edu.hk/TIEs-videohttp://chtl.hkbu.edu.hk/TIEs-videohttp://ar-learn.com/

Background of AIE-AR Project & Teachers’ Feedback

Video link: http://chtl.hkbu.edu.hk/RE2016/teacher.html

Play

http://chtl.hkbu.edu.hk/RE2016/teacher.html

Be responsible citizens with an international outlook and a sense of

ethics and civility;

Have up-to-date, in-depth knowledge of an

academic specialty, as well as a broad range of

cultural and general knowledge;

Be independent, lifelong learners with an open mind

and an inquiring spirit;

Have the necessary information literacy and IT skills,

as well as numerical and problem-solving skills, to

function effectively in work and everyday life;

Be able to think critically and creatively;

Have trilingual and biliterate competence in English

and Chinese, and the ability to articulate ideas

clearly and coherently;

Be ready to serve, lead and work in a team, and to

pursue a healthy lifestyle.

7 HKBU Graduate Attributes

Whole Person Educationas the Institution’s founding educational philosophysince its inception in 1956

Aspires to be a leading research-led liberal arts university

Though most tertiary institutions have emphasized the importance of AIE by offering classes, tutorials and learning activities to help students understand the meaning and common practices

of AIE, cases of plagiarism, data fabrication, etc. still arise with alarming regularity.

Interest Over Time – “Plagiarism” Google Trends (2016)

Could IT be used to combat an important issue brought on and worsened by IT itself?

If misconduct, e.g. plagiarism can be deterred in the first place this would reduce the need for detection!

How can we turn abstract conceptual knowledge of AIE into understanding which is more directly linked to students’ everyday realities?

• Title: Reinforcing the Importance of Academic Integrity and Ethics in Studentsthrough Blended Learning – A Deployment of Augmented Reality Applications

• Funded by University Grants Committee of the Hong Kong SAR, around HK$8 million; started in autumn of 2014

AIE-AR Project

Project Objectives

• Enhance teaching and learning by helping students develop the concepts of academic integrity and ethics (AIE) through a thoughtful design of mobile learning activities to be conducted in real-world environment (a form of situated learning).

• Develop a learning environment supported by a combination of mobile technology and augmented reality (AR).

Project website: http://ar-learn.com

http://ar-learn.com/

The Team Core HKBU team-members

The AIE-AR team-members

TIEs OverviewIn Operation• TIE-General

• For cross-Institutions (CUHK, EdUHK & PolyU) transplantation

• TIE-HT (Hall Tutor)

• TIE-HUM (Humanites)

• TIE-LabS (Laboratory Safety)

• TIE-SL (Service Learning)

• TIE-SR (Sports and Recreation)

Under Development• TIE-LC (Language Learning - English)

• TIE-BUS (Business Ethics & Corporate Social Responsibility)

Source: Gorman, N. (2016, Jul. 14). How Pokémon GO is the perfect tool for encouraging summer learning. Education World. https://goo.gl/zQ7lI3 (10 Oct 2017)

• Pokemon Go released in July 2016

• TIE-General, with 4 scenarios,launched in January 2015.

https://goo.gl/zQ7lI3

TIE-General: 4 ScenariosMobXZQR code trigger GPS trigger

Image recognition

Image recognition

Data CollectionTIE-General No. of students

(Jan 2015 – Oct 2016)

HKBU (UG) 438

EdUHK (UG) 141

PolyU (UG) 24

CUHK (UG) 62

HKBU (PG) 151

Total 816 (665 UG + 151 PG)

Other TIEs at HKBU No. of students (Jan 2015 – Oct 2016)

TIE-SR (Sports & Recreation) 111

TIE-SL (Service Learning) 63

TIE-HT (Hall Tutors) 46

TIE-HUM (Humanities) 20

TIE-LabS (Laboratory Safety) 118

Total 358 (UG only)

1174 Students

Four sets of data collected:1. User Experience Survey2. Qualitative Feedback3. Clickstream Data4. Pre- and Post-Trail Discussion

Perception data (indirect evidence)

Learning analytics(direct evidence)

Reinforcing the importance of integrity and ethical leadership within disciplines

Results Highlights

I find this App easy to use

My interaction with this App is clear and understandable

My overall usage experience with this learning trail is good

Working with this App is fun

The Wi-Fi connection is stable

This App makes learning AIE more interesting

(Strongly Agree)

(Strongly Disagree)

1. User Experience Survey (Example from TIE-General, n=982)

3.753.92 3.89

3.74

3.27

3.81

1.00

2.00

3.00

4.00

5.00

2. Qualitative Feedback (Example from TIE-HT, n=21)

Remarks: Triangulation analysis illustrated that through the TIE-HT, hall tutors recognized the importance of behaving as ethical role models to their peer hall residents.

Question: After listening to different people’s views, what is your own view? What role do you see yourself in the cited situation? Role model I didn’t behave as a good role model Should be more attentive and respectful to my floor-mates Act as a mediator to understand things and get the problem solved Be a role model myself, be fair, just and mediate amongst the

different parties Be fair and listen to different opinions I feel I have been irresponsible and should have listened more to my

floor-mates’ requests Should invite floor-mates to share their feelings and take action

accordingly as their representative I didn’t do my job properly to follow-up floor-mates’ requests, I am

irresponsible and not detail-minded enough I should apologise to my floor-mates and take up my responsibilities

Carrot2 Clustering Result

Results Highlights

Plagiarism CitationLibrary Ethical

ConcernData

Falsification

Avg. of Time on Consequence 40.5971 23.2333 6.2514 16.1129

Avg. of Time on Choice 6.2427 2.1889 6.7263 3.4946

Avg. of Time on Challenge 103.068 44.2222 42.7318 75.914

0

20

40

60

80

100

120

140

160

Tim

e in

se

con

ds

Time on Task

3. Clickstream Data (Example from TIE-General in “Business Ethics & Corporate Social Responsibility” course, n=195)

Results Highlights

3. Clickstream Data cont’d (Example from TIE-General in “Business Ethics & Corporate Social Responsibility” course, n=195)

Remarks: Clickstream data collected showed that the average time on tasks was reasonable and the ethical choices varied. Hence we can infer that cognitive processes for ethical reasoning had taken place on the TIEs, and consequently, students had learned to respect the dignity and rights of others through the learning trails.

Decisions on Ethical Choices

Results Highlights

Nu

mb

er o

f K

eyw

ord

Occ

urr

ence

s

0

2

4

6

8

10

12

14

PrePost

Students’ view on "sport ethics"

4. Pre- & Post-Trail Discussions (Text mining example from TIE-SR in “Leadership & Communication in Sport and Recreation” course, n=24)

Remarks: Analysis of the pre-/post-trail discussion showed that students’ awareness of sports ethics was heightened with increased expression of terms like doping, physical violence, corruption, etc.

Results Highlights

Emphasize on student generated materials

Showcase of TIE-SR

Three student and alumni societies/associations

• Physical Education & Recreation Management (PERM) Society.

• PERM Alumni Association

• Sport and Recreation Leadership (SRL) Association

Each association designed 10 scenarios on either academic integrity or ethics related to Sports and Recreation management/ Fitness and wellness.

Requirements

1. Relevance – daily life scenarios

2. Engaging – use of multi-media

3. Challenging – choices of answers require students to reflect

TIE-SR

Conducted four trials• PERM Class – September 2015

• PREM Academic week – November 2015

• SRL society activity – December 2015

• PERM Class – September 2016

Procedures:1. 2’s in a group, found the QR code,

read the case, answered the question and got the “Checkpoint Code”

2. Completed post-trail worksheet

https://youtu.be/s_zx5lTmGYA

Qualitative comments from students

Positive

• Good game

• Great app

• Very exciting

• Nice interactive game

• Challenges on find the QR code is excited

• Questions are good for understanding the

ethics.

Negative•Very bad WiFi connection•Data connection relatively weak•Take time to load the QR code•Scanning speed is slow•Connection is weak•App works too slow•Too many photos

Quality of the TIE-SR?

Comments on scenarios

Moving Forward

• Expansion of subject-specific TIEs can reinforce ethical behaviour and professional standards in the discipline classes (immersion in learning will be more comprehensive)

• Incorporation of gaming elements to motivate collaborative as well as individual learning

• Encourage student-created scenarios (involving students in the creation and design of scenarios)

• Introduce to the rest of the UGC-funded institutions

Refining the Process to Enhance Students’ Learning in AIE

Dissemination – Publications to Date Refereed Journal Articles:• Chan, J., Chiu, R., Ng, G. & Kwong, T. (2015). How Clickstream Tracking Helps Design Mobile Learning

Content. International Journal of Humanities Social Sciences and Education (IJHSSE). Volume 2, Issue 7, July 2015, PP 95-104.

• Chow, E., Pegrum, M., Thadani, D. & Wong, E. (2015). Mobile Technologies and Augmented Reality: Early Experiences in Helping Students Learn About Academic Integrity and Ethics. International Journal of Humanities Social Sciences and Education (IJHSSE). Volume 2, Issue 7, July 2015, PP 112-120

Book Chapter:• Wong, E., Kwong, T., Cheung, S., Ng, G., Chiu, R., & Zhong, E. (2016). Application of Augmented Reality

Mobile Learning Trails to Develop Students’ Academic Integrity. In ELearning Excellence Awards - An Anthology of Case Histories 2016 (pp. 217-232). Remenyi, D. (Ed.). United Kingdom: Academic Conferences and Publishing International Limited.

Conference Proceeding:• Yue, K.K., Law, L.Y., Chan, H.L., Chan, J.B., Wong, E.Y., Kwong, T.F. &Wong, E.Y. (2016). Factors in Designing an

Augmented Reality M-Learning Trail with Place-based Pedagogy in Residential Education. In Conference Proceedings Mobile Learning Futures - Sustaining Quality Research and Practice in Mobile Learning (pp. 295-309). Dyson, Ng, Fergusson (Eds.). 15th World Conference on Mobile and Contextual Learning, mLearn2016. Sydney, Australia, October 24-26, 2016.

Reimagine Education Awards 2015 Silver Award (Regional Award Asia)

ACPIL-ECEL 2016 Certificate of Merit

Reimagine Education Awards 2016 Shortlisted (Ethical Leadership Award)

SingTao Daily (星島日報), 8 Jan 2016

WenWeiPo (文匯報), 16 Dec 2015

HKBU eNews, HKBUCPRO,

22 Dec 2015

All our effort is for one goal:

Enhancing student

learning to prepare

our students to

become future leaders

with ethics and civility

Students’ Feedback on TIEs

Video Link: http://chtl.hkbu.edu.hk/RE2016/student.html

Play

http://chtl.hkbu.edu.hk/RE2016-student.html

• Ally and Khan (2015) International Handbook of E Learning Volume 2: Implementation and Case Studies, Routledge• Biemer, P.P., Groves, R.M., Lyberg, L., Mathiowetz, N.A. and Sudman, S. (1991). Measurement Errors in Surveys. New York: Wiley.• Chatti M. A., Dyckhoff A. L., Schroeder U. and Thüs H. (2012). A reference model for learning analytics. International Journal of Technology Enhanced

Learning, 4 (5/6)• Davis, F. D. (1989). Perceived usefulness, perceived ease of use, and user acceptance of information technology. MIS quarterly, 13(3), 319-340.• Elias, T. (2011) Learning Analytics: Definitions, Processes, Potential http://learninganalytics.net/LearningAnalyticsDefinitionsProcessesPotential.pdf• FitzGerald, E., Adams, A., Ferguson, R., Gaved, M., Mor, Y., & Thomas, R. (2012). Augmented reality and mobile learning: The state of the art. In M.

Specht, M. Sharples & J. Multisilta (Eds.), mLearn 2012: Proceedings of the 11th International Conference on Mobile and Contextual Learning 2012, Helsinki, Finland, October 16-18 (pp.62-69). http://ceur-ws.org/Vol-955/papers/paper_49.pdf

• Global Smartphone Market Share By Platform. (2014). BI Intelligence. Retrieved Jan 02, 2015, from http://goo.gi/ntcriK• Johnson, L., Smith, R., Willis, H., Levine, A., & Haywood, K. (2011). The 2011 Horizon Report. Austin, Texas: The New Media Consortium.• Kuhlmann, T. (2009, July 13). Build Branched E-Learning Scenarios in Three Simple Steps | The Rapid E-Learning Blog. Retrieved November 30, 2015,

from http://blogs.articulate.com/rapid-elearning/build-branched-e-learning-scenarios-in-three-simple-steps/• Moe, W., P. S. Fader. (2004). Dynamic conversion behavior at e-commerce sites. Management Science. 50(3): 326–335.• Mohamed Amine Chatti, Anna Lea Dyckhoff, Ulrik Schroeder, Hendrik Thüs• Montgomery, A. L. (2001). Applying quantitative marketing techniques to the internet. Interfaces 31(2): 90–108.• Owunwanne, D., Rustagi, N., & Dada, R. (2010). Students' perceptions of cheating and plagiarism in higher institutions. Journal of College Teaching and

Learning, 7(11), 59-68.• Pegrum, M. (2014). Mobile learning: Languages, literacies and cultures. Basingstoke: Palgrave Macmillan.• Ping, L., Kong, S. C., Wong, E. Y. W., & Guo, C. (2015). Enhancing Academic Integrity Online via Blended Learning and Discussion Analytics.

Proceedings of eLearning Forum Asia 2015.• Roebuck, K. (2011). Web Analytics: High-Impact Strategies - What You Need to Know: Definitions, Adoptions, Impact, Benefits, Maturity, Vendors,

Newstead: Emereo Pty Limited:• Russell, T. (2001). The no significant difference phenomenon. In R. NC (Ed.), A comparative research annotated bibliography on technology for distance

education (5th ed.): The International Distance Education Certification Centre.• Stovall, I. (2003). Engagement and Online Learning. UIS Community of Practice for E-Learning, 3, 2014.• Chan, J., Chiu, R., Ng, G., & Kwong, T. (2015). An Application of Clickstream Tracking for Mobile Learning. Proceedings of eLearning Forum Asia 2015.• Thomas, A., & Zyl, A. V. (2012). Understanding of and attitudes to academic ethics among first-year university students. African Journal of Business

Ethics, 6(2), 143-155.• US Department of Education. (2009/2010). Evaluation of Evidence-Based Practices in Online Learning: A Meta-Analysis and Review of Online Learning

Studies.• Venkatesh, V., Morris, M. G., Davis, G. B., & Davis, F. D. (2003). User acceptance of information technology: Toward a unified view. MIS quarterly, 27(3),

425-478.• Wu, H.-K., Lee, S.W.-Y., Chang, H.-Y., & Liang, J.-C. (2013). Current status, opportunities and challenges of augmented reality in education. Computers

& Education, 62, 41-49.

References