Assessing Online LearningProcess Maturity: the e-Learning

Maturity Model

Janet MayAssociate Director

Penn State World Campus

2

The e-Learning Maturity Model(eMM) focus…

“…changingorganisational conditionsso that e-learning isdelivered in a sustainableand high quality fashionto as many students aspossible” (2006)

Stephen MarshallVictoria University of Wellington

3

The eMM focus… “The key concept is that the ability of an

organisation to be effective in a particulararea of work is dependent on theircapability to engage in high quality,reproducible, processes that can besustained and built upon”

Stephen Marshall Victoria University of Wellington (2006)

4

How can the eMM benefit PennState World Campus?

• Help us better understand our ownorganizational capacity for sustainedsuccess with online learning

• Implement change based on thatunderstanding

• Benchmark with other Institutions

5

The e-Learning Maturity Model (eMM)is…

• A quality improvement tool that measuresan institution’s ability to sustain onlinelearning

• Provides a set of key practices that caninform improvement activities

6

Process categories

Each process category includes multipleprocesses, for a total of 35 processes

7

Process categories• Each Process assessed on 5 dimensions

8

eMM dimensions1 Delivery ~ creation and delivery of

process outcomes• Assess the extent to which the process is

seen to operate within the institution.• Without capability in other dimensions, at

risk of failure or unsustainable delivery andwasting resources through needlessduplication.

9

eMM dimensions2 Planning ~ assesses the use of

predefined objectives and plans inconducting the work of the process.

• The use of predefined plans potentiallymakes process outcomes more able to bemanaged effectively and reproduced ifsuccessful.

10

eMM dimensions3 Definition ~ use of institutionally defined

and documented standards, templatesand policies during implementation ofprocess.

• The institution has clearly defined how agiven process should be performed.

• This does not mean that the staff of theinstitution follows this guidance.

11

eMM dimensions4 Management ~ how the institution

manages implementation of process andensures the quality of the outcomes.

• Capability reflects measurement of theoutcomes and the way in which thepractices of the process are performed bythe staff of the institution.

12

eMM dimensions5 Optimization ~ the extent to which an

institution is using formal approaches toimprove capability measured within theother dimensions of this process.

• Capability reflects a culture of continuousimprovement.

13

eMM dimensions• Not an hierarchical model; does not measure

progressive levels• The dimension concept is holistic capability• Capability at the higher dimension without

capability at the lower dimensions does notdeliver desired outcomes

• Capability at the lower dimensions that isunsupported in the higher dimensions will beunsustainable and unresponsive to change andlearner needs

14

Not assessed

Fully adequate

Largely adequate

Partially adequate

Not practiced/Notadequate

MeaningRating

Institutional “capability”

15

Example eMM Capability Assessment

Not assessed

Fully adequate

Largely adequate

Partially adequate

Not practiced/Not adequate

MeaningRating

Not assessed

Fully adequate

Largely adequate

Partially adequate

Not practiced/Not adequate

MeaningRating

16

As a Benchmarking Tool

Delivery

OptimizationProcesses that directly impact onpedagogical aspects of e-learning

17

At Penn State World Campus…• Beginning an eMM project…

– Wanted a mature program, fully developed– Wanted a program that the World Campus

had developed, rather than another unit at theUniversity

18

At Penn State World Campus…Selected BS in Turfgrass Science

• Worked with lead faculty, instructional designer,administrators, and others to assess the program.

• Required evidence collection.• Iterative process.• Assessment just completed…..

19

Penn State World Campus

20

21

22

For more information on eMM…Please contact– Janet May at jam11@psu.edu– Stephen Marshall at

stephen.marshall@vuw.ac.nz

Please visit the eMM web site:– http://www.utdc.vuw.ac.nz/research/emm/