What we learned from ourpilot

Bert De CoutereCenter for Creative LeadershipOnline Educa Berlin 2013

What we learned from our pilot.

Nice to meet you!

Bert De Coutere lives in Belgium, works for the Center for Creative Leadership, blogs on homocompetens.blogspot.com and is one third of the core team behind LeaderMOOC.net.

What we learned from our pilot.

Why we felt we had to do this.

Ignore MOOCs Have an opinion Just do it.

or or

What we learned from our pilot.

What we really wanted to find out.1. Does the MOOC format work for leadership development?And not just insights, but all the way to behavior change…

2. If so, who does it work for? What did they achieve? Why did it work for them?

3. Who did it not work for?Who are they and why did it not work out?

4. How can we improve so more people benefit from the MOOC?How to make LeaderMOOC work out for more people?

5. Oh, and what is a sustainable model for offering MOOCs?Show me the money.

What we learned from our pilot.

What we did – project timeline• January Start of project with discovery interviews• March Design week – decide between 4 alternatives• April Testing out various platforms• June information site and intake survey online• July Canvas.net registrations open and build-up to course• August Production time: video shoots, creating all content• Sept-Oct8 weeks of serious MOOCing• November Announcing all winners, granting badges, little habits• December Our conclusions and recommendations

What we learned from our pilot.

What we did – consider the context

It’s not about being pure.

It’s about what works.

No repurpose.

Build for purpose.

Not academic.

Corporate training.

It’s not about a diploma.

It’s about more effective behavior.

It’s not about the star.

CCL is its people.

It’s not risk-free.

It is a pilot after all.

What we learned from our pilot.

How we did it.

What we learned from our pilot.

Nothing really new, just more of it.

Rather New

What we learned from our pilot.

So what? (Warning: limited audience interaction ahead.)

The answer to life, the universe and everything.

The raw data

M for massive dropouts

Educational Darwinism

How far can we go?

Learning outcomes

Show me the money

In search of a business model

It’s what you do with it.

Technology matters.

Maybe this will work.

Three experiments.

M for massive work

No traffic jams on the extra mile.

The after-MOOC

The cult of the wicker-man.

<insert incredibly insightful question

here>

Anything else

What we learned from our pilot.

We are sitting on a mountain of data• Intake survey• Demographics survey• Mid-MOOC survey• Learning Agility check-

point discussion• End of course evaluation• What would you tell

them?• Grades of assignments• Discussion forum content

The answer to life, the universe and everything.

The raw data

What we learned from our pilot.

Some numbers…

• Over 4800 people have enrolled in LeaderMOOC. Some have been very active, some haven't done much.

• We produced 80 videos that together were watched over 26000 times or for an estimated duration of over 1700 hours.

• On our most busy day we had over 60000 page views. On normal days we have between 5000 and 10000.

• We had over 1900 assignments turned in, and peer reviewed.• We awarded 75 badges to people asking for them and earning them.• We counted almost 4800 posts in the 99 topics of the discussion forum.• We gave away 10 prizes each week, including guidebooks, books and Life explorer

sets. One winner won a seat in one of our classes. Five people won a goal setting session.

• The end-of-course evaluation got a satisfaction of 88% and a NPS of 61%.• The top 10 of countries participating were: United States, Canada, India, United

Kingdom, France, Belgium, Spain, China, Germany and Australia.

What we learned from our pilot.

Who are they?

• We are Mostly Professionals at the Start or in the Midst of our Career

• We come from all over the world• We want Tips, Insights and

Support• We Plan to Spend Between 1 and

4 Hours per Week• For a Lot of Us this Is a New

Experience

What we learned from our pilot.

Dropouts are very real.This is the baseline.

M for massive dropouts

Educational Darwinism

What we learned from our pilot.

Dropouts are very real.We raised the bar (and dropout numbers).

What we learned from our pilot.

Dropouts are very real.We raised the bar (and dropout numbers).

46% of people actually show up at the start of the MOOC.

After 2 weeks it stabilizes to around 11%

Gradually that goes down to 2.9% after 8 weeks.

Around 30% hand in their assignment in the first week.

That grows to 74% of active students in the last week.

58% of those who handed in the last assignment earned the badge (or 1.6% of all enrolled people)

What we learned from our pilot.

For those it works for, we get as far as a similar classroom experience

How far can we go?

Learning outcomes

If the student is ready the MOOC will arrive

Time. It is something you make, not something you have.

The illiterate of the 21st century will not be those who cannot read and write, but those

who cannot learn, unlearn, and relearn.

What we learned from our pilot.

In search of sustainability…

This was a passion-driven project.

Show me the money

In search of a business model

#1. Steal from the rich, give to the

poor

#2. The ones who’s boxes you tick, pay

#3. Do you want fries with that?

#4. Pay for praise #5. Pretty please? #6. Old-fashion “just pay”

In full or for premium features.

Short term

Find sponsors

Very Limited

potential

Not relevant

Doesn’t work

Most straightforward

What we learned from our pilot.

The experience isn’t seamless.

• Technology HAVEs and CANs• Canvas.net platform and

assistance• People prefer one window on

the MOOC• Discussions worked very well• Most questions about peer

review feature

It’s what you do with it.

Technology matters.

What we learned from our pilot.

Three experiments worth mentioning

Maybe this will work.

Three experiments.

Mystery week Wisdom of the Crowd Anchor

What we learned from our pilot.

Designing and running a MOOC takes a lot of work

• “If you ignore your course, so will your students.”

• Don’t make the e-learning 1.0 mistake to produce and throw over the fence

• Daily interactions in the forums, especially in weeks 1-2 community building is essential

• Hours spend: +/- 1000 hours by core team and many, many more people volunteered

M for massive work

No traffic jams on the extra mile.

What we learned from our pilot.

So what?

• Extra activity one month after end date:– 6% of video views– 3% of discussion posts– (Assignments and enrolments

disabled)

The after-MOOC

The cult of the wicker-man.

So what?

Worked well… Even better if…

What we learned from our pilot.

Behind the MOOC

• For more, see the article series ‘behind the MOOC’ on homocompetens.blogspot.com