On Using Learning Analytics to Track the Activity of Interactive MOOC Videos

21
S C I E N C E P A S S I O N T E C H N O L O G Y u www.tugraz.at 2016-04-26 Josef Wachtler, Mohammad Khalil, Behnam Taraghi, Martin Ebner On Using Learning Analytics to Track the Activity of Interactive MOOC Videos

Transcript of On Using Learning Analytics to Track the Activity of Interactive MOOC Videos

Page 1: On Using Learning Analytics to Track the Activity of Interactive MOOC Videos

1S C I E N C E P A S S I O N T E C H N O L O G Y

u www.tugraz.at

2016-04-26Josef Wachtler, Mohammad Khalil, Behnam Taraghi, Martin Ebner

On Using Learning Analytics to Track the Activity of Interactive MOOC Videos

Page 2: On Using Learning Analytics to Track the Activity of Interactive MOOC Videos

22 Graz University of Technology

• Europe, Austria, Graz• http://www.tugraz.at • http://elearningblog.tugraz.at

On Using Learning Analytics to Track the Activity of Interactive MOOC Videos

2016-04-26Josef Wachtler, Mohammad Khalil, Behnam Taraghi, Martin Ebner

Page 3: On Using Learning Analytics to Track the Activity of Interactive MOOC Videos

33

@TuMohdKhalil @mebner@behi_at@wachjose88

The Authors

Josef Wachtler, Mohammad Khalil, Behnam Taraghi, Martin Ebner2016-04-26

On Using Learning Analytics to Track the Activity of Interactive MOOC Videos

Page 4: On Using Learning Analytics to Track the Activity of Interactive MOOC Videos

44 Content

1. Motivation2. Related Work3. Interactions in Learning Videos4. Evaluation5. Summary

On Using Learning Analytics to Track the Activity of Interactive MOOC Videos

2016-04-26Josef Wachtler, Mohammad Khalil, Behnam Taraghi, Martin Ebner

Page 5: On Using Learning Analytics to Track the Activity of Interactive MOOC Videos

55 Motivation

• interaction and communication are very important influencing factors of students' attention

• attention is considered as the most crucial resource for human learning

• it is from high importance to understand and to analyze it

• learning analytics plays a major factor in enhancing learning environments components

• reflecting and benchmarking the whole learning process

On Using Learning Analytics to Track the Activity of Interactive MOOC Videos

2016-04-26Josef Wachtler, Mohammad Khalil, Behnam Taraghi, Martin Ebner

Page 6: On Using Learning Analytics to Track the Activity of Interactive MOOC Videos

66 Related work

• other interactive video tools• Youtube• Zaption• EdTed• …

• real-world pendant: audience response system• has the power to enhance students‘ attention and

participation• the addition of interactivity to learning videos tries to

generate similar benefits

On Using Learning Analytics to Track the Activity of Interactive MOOC Videos

2016-04-26Josef Wachtler, Mohammad Khalil, Behnam Taraghi, Martin Ebner

Page 7: On Using Learning Analytics to Track the Activity of Interactive MOOC Videos

77 Interactions in Learning Videos

• web-based information system called LIVE• registered and authenticated users• different methods of interaction

• automatically asked questions and captchas• questions to the lecturer by the learners• asking text-based questions to the attendees live or at

pre-defined positions• multiple-choice questions at pre-defined positions

• different possibilities of analysis

On Using Learning Analytics to Track the Activity of Interactive MOOC Videos

2016-04-26Josef Wachtler, Mohammad Khalil, Behnam Taraghi, Martin Ebner

Page 8: On Using Learning Analytics to Track the Activity of Interactive MOOC Videos

88 Video interrupted by a multiple-choice question1. paused video is

overlaid by an interaction

to resume playing, it is required to respond to the interaction

2. control elements on the right side of the video

invoke interactions manually

ask a question to the teacher

Interactions in Learning Videos

2016-04-26Josef Wachtler, Mohammad Khalil, Behnam Taraghi, Martin Ebner

Page 9: On Using Learning Analytics to Track the Activity of Interactive MOOC Videos

99 Timeline Analysis

• number of users (green) and views (red)• exact values on mousehover

Interactions in Learning Videos

2016-04-26Josef Wachtler, Mohammad Khalil, Behnam Taraghi, Martin Ebner

Page 10: On Using Learning Analytics to Track the Activity of Interactive MOOC Videos

1010 Watched Parts per User

• marks each watched part with a bar• time of joining and leaving in relative and absolute

values on mousehover

Interactions in Learning Videos

2016-04-26Josef Wachtler, Mohammad Khalil, Behnam Taraghi, Martin Ebner

Page 11: On Using Learning Analytics to Track the Activity of Interactive MOOC Videos

1111 Evaluation

• MOOC – Maker Day for School Children

• Using Log File of LIVE

• Exploratory Analysis and Visualizations

• Examining effeciency and weak-points.

On Using Learning Analytics to Track the Activity of Interactive MOOC Videos

2016-04-26Josef Wachtler, Mohammad Khalil, Behnam Taraghi, Martin Ebner

Page 12: On Using Learning Analytics to Track the Activity of Interactive MOOC Videos

1212 Evaluation – Delay of ResponseOn Using Learning Analytics to Track the Activity of Interactive MOOC Videos

2016-04-26Josef Wachtler, Mohammad Khalil, Behnam Taraghi, Martin Ebner

Delay of Response

Certified students took less time than the others in answering the questions.

Page 13: On Using Learning Analytics to Track the Activity of Interactive MOOC Videos

1313 Evaluation – Delay of ResponseOn Using Learning Analytics to Track the Activity of Interactive MOOC Videos

2016-04-26Josef Wachtler, Mohammad Khalil, Behnam Taraghi, Martin Ebner

More timeansweringquestions

Page 14: On Using Learning Analytics to Track the Activity of Interactive MOOC Videos

1414 Evaluation – Delay of ResponseOn Using Learning Analytics to Track the Activity of Interactive MOOC Videos

2016-04-26Josef Wachtler, Mohammad Khalil, Behnam Taraghi, Martin Ebner

Non-certified holds more outliers

Page 15: On Using Learning Analytics to Track the Activity of Interactive MOOC Videos

1515 Evaluation – Timing of the QuestionsOn Using Learning Analytics to Track the Activity of Interactive MOOC Videos

2016-04-26Josef Wachtler, Mohammad Khalil, Behnam Taraghi, Martin Ebner

Timing of the Questions

We wanted to infer the relevance timing of the first question to describe the drop rate during videos.

Students drop after 15% of the videos. Most students who watch 20%, keep watching the

whole video

Page 16: On Using Learning Analytics to Track the Activity of Interactive MOOC Videos

1616 Evaluation – Timing of the QuestionsOn Using Learning Analytics to Track the Activity of Interactive MOOC Videos

2016-04-26Josef Wachtler, Mohammad Khalil, Behnam Taraghi, Martin Ebner

Limited drop ratio

1st Question, should be in the high-drop rate area. (0-10%)

Page 17: On Using Learning Analytics to Track the Activity of Interactive MOOC Videos

1717 Evaluation – Timing of the QuestionsOn Using Learning Analytics to Track the Activity of Interactive MOOC Videos

2016-04-26Josef Wachtler, Mohammad Khalil, Behnam Taraghi, Martin Ebner

Colored points depict distinct watchers count of each week video.

Grey points indicates number of views.

Week1-3 shows more views per user

Last two weeks, views=watchers

Page 18: On Using Learning Analytics to Track the Activity of Interactive MOOC Videos

1818 Evaluation – Total ActivityOn Using Learning Analytics to Track the Activity of Interactive MOOC Videos

2016-04-26Josef Wachtler, Mohammad Khalil, Behnam Taraghi, Martin Ebner

Total Activity of the Videos Counting no. Of plays,stops and fully watched. Activity was high in Week1,Week3 & Week5.

Page 19: On Using Learning Analytics to Track the Activity of Interactive MOOC Videos

1919 Evaluation – Total ActivityOn Using Learning Analytics to Track the Activity of Interactive MOOC Videos

2016-04-26Josef Wachtler, Mohammad Khalil, Behnam Taraghi, Martin Ebner

Highly active because of the topic

Page 20: On Using Learning Analytics to Track the Activity of Interactive MOOC Videos

2020 Summary

• an interactive video platform presenting videos of a MOOC

• an evaluation of this system to examine its performance and describe the behavior of students

• the main concept behind latching on the students' attention becomes attainable through evaluating the questions' content and the interactions timing

On Using Learning Analytics to Track the Activity of Interactive MOOC Videos

2016-04-26Josef Wachtler, Mohammad Khalil, Behnam Taraghi, Martin Ebner

Page 21: On Using Learning Analytics to Track the Activity of Interactive MOOC Videos

2121 Thank you for your attention!

• Josef Wachtler, [email protected]• Mohammad Khalil, [email protected]• Behnam Taraghi, [email protected]• Martin Ebner, [email protected]

Graz University of TechnologyEducational TechnologyMünzgrabenstraße 35a, 8010 Graz, Austria – Europehttp://elearningblog.tugraz.at

On Using Learning Analytics to Track the Activity of Interactive MOOC Videos

2016-04-26Josef Wachtler, Mohammad Khalil, Behnam Taraghi, Martin Ebner