Setting a Next-Generation CMS Strategy Robert F. Pack, University of Pittsburgh William K. Jackson,...

47
Setting a Next- Generation CMS Strategy Robert F. Pack, University of Pittsburgh William K. Jackson, University of Georgia Tom Laughner, University of Notre Dame Tom Head, Virginia Tech Kathleen Thomas, University of North Carolina Bradley C. Wheeler, Indiana University Track 3 Copyright © 2003 Learning Technology Consortium, Robert F. Pack, Tom Head, William K. Jackson, Tom Laughner, Kathleen Thomas, and Bradley C. Wheeler. This work is the intellectual property of the authors. Permission is granted for this material to be shared for non-commercial, educational purposes, provided that this copyright statement appears on the reproduced materials and notice is given that the copying is by permission of the author. To disseminate otherwise or to republish requires written permission from the authors.

Transcript of Setting a Next-Generation CMS Strategy Robert F. Pack, University of Pittsburgh William K. Jackson,...

Page 1: Setting a Next-Generation CMS Strategy Robert F. Pack, University of Pittsburgh William K. Jackson, University of Georgia Tom Laughner, University of Notre.

Setting a Next-Generation

CMS StrategyRobert F. Pack, University of PittsburghWilliam K. Jackson, University of GeorgiaTom Laughner, University of Notre Dame

Tom Head, Virginia TechKathleen Thomas, University of North

CarolinaBradley C. Wheeler, Indiana University

Track 3

Copyright © 2003 Learning Technology Consortium, Robert F. Pack, Tom Head, William K. Jackson, Tom Laughner, Kathleen Thomas, and Bradley C. Wheeler. This work is the intellectual property of the authors. Permission is granted

for this material to be shared for non-commercial, educational purposes, provided that this copyright statement appears on the reproduced materials and notice is given that the copying is by permission of the author. To disseminate

otherwise or to republish requires written permission from the authors.

Page 2: Setting a Next-Generation CMS Strategy Robert F. Pack, University of Pittsburgh William K. Jackson, University of Georgia Tom Laughner, University of Notre.

A collaborative of nine universities with common interests and challenges in the area

of teaching and learning with technology

● Indiana University ● University of Delaware ● University of Florida ● University of Georgia

● University of North Carolina ● University of Notre Dame

● University of Pittsburgh ● Virginia Tech ● Wake Forest University

www.learningtechnologyconsortium.org

Page 3: Setting a Next-Generation CMS Strategy Robert F. Pack, University of Pittsburgh William K. Jackson, University of Georgia Tom Laughner, University of Notre.

CMS Adoption

University of Pittsburgh, AY 1998

University of Georgia, AY 1998University of Notre Dame, AY 1997

Indiana University, AY 1998

University of North Carolina, AY 1999Virginia Tech, AY 2000

Page 4: Setting a Next-Generation CMS Strategy Robert F. Pack, University of Pittsburgh William K. Jackson, University of Georgia Tom Laughner, University of Notre.

Current Environment

Students Faculty

University of Pittsburgh 67% 41%

University of Georgia 90% 60%

University of Notre Dame 95% 25%

Virginia Tech 95% 85%

University of North Carolina 84% 56%

Indiana University 79% 72%

Page 5: Setting a Next-Generation CMS Strategy Robert F. Pack, University of Pittsburgh William K. Jackson, University of Georgia Tom Laughner, University of Notre.

Blackboard at Pitt

Over 3,200 unique courses have been developed in Blackboard

67% of Pitt’s 33,804 students are using Blackboard this fall

Blackboard adoption has grown an average of 40% annually from 2000 through 2003

21

351

642745

1003

1401

0

200

400

600

800

1000

1200

1400

1600

1998 1999 2000 2001 2002 2003

Fall Term Sections Using Blackboard

Page 6: Setting a Next-Generation CMS Strategy Robert F. Pack, University of Pittsburgh William K. Jackson, University of Georgia Tom Laughner, University of Notre.

Training and Support

Training Options Summer Institute (4 days) Novice (12 hours; extensive

hands-on) Standard (8 hours; some

hands-on) Expert (1-2 hours; no

hands-on) On-line (1-hour intro; self-

instructional)

Over 1,800 Pitt faculty have taken core Blackboard training (required)

24

325

404

244

330

492

0

100

200

300

400

500

600

1998 1999 2000 2001 2002 2003

Faculty Trained in Blackboard

Page 7: Setting a Next-Generation CMS Strategy Robert F. Pack, University of Pittsburgh William K. Jackson, University of Georgia Tom Laughner, University of Notre.

Agenda The Issues:

Goals and Objectives - University of Georgia CMS Selection - University of Notre Dame Cost Analysis - Virginia Tech Vendor Issues - University of North Carolina Open Source Option - Indiana University

Summary: Where Do We Go From Here?

Page 8: Setting a Next-Generation CMS Strategy Robert F. Pack, University of Pittsburgh William K. Jackson, University of Georgia Tom Laughner, University of Notre.

CMS Goals and Objectives

William K. Jackson

University of Georgia

Page 9: Setting a Next-Generation CMS Strategy Robert F. Pack, University of Pittsburgh William K. Jackson, University of Georgia Tom Laughner, University of Notre.

WebCT at Georgia

Early adopter of WebCT (AY 1998) 33,000 students (90%) using WebCT Current level of CMS use: 3,800 course

sections and more than 1,200 instructors (60%)

Nature of faculty support: centralized for supplemental use, decentralized for support of distance education

Page 10: Setting a Next-Generation CMS Strategy Robert F. Pack, University of Pittsburgh William K. Jackson, University of Georgia Tom Laughner, University of Notre.

In the Beginning

Our goals were modest

Page 11: Setting a Next-Generation CMS Strategy Robert F. Pack, University of Pittsburgh William K. Jackson, University of Georgia Tom Laughner, University of Notre.

In the Beginning

We wanted to provide an alternative to the plethora of instructional Web sites being developed by individuals.

We wanted to create a common interface for students as they moved across courses.

Page 12: Setting a Next-Generation CMS Strategy Robert F. Pack, University of Pittsburgh William K. Jackson, University of Georgia Tom Laughner, University of Notre.

In the Beginning

We wanted to simplify support requirements for web-enhanced courses.

We wanted to provide a platform for web-based distance education.

Page 13: Setting a Next-Generation CMS Strategy Robert F. Pack, University of Pittsburgh William K. Jackson, University of Georgia Tom Laughner, University of Notre.

In the Beginning

And,

We wanted to accomplish these goals at a price we could afford.

Page 14: Setting a Next-Generation CMS Strategy Robert F. Pack, University of Pittsburgh William K. Jackson, University of Georgia Tom Laughner, University of Notre.

Now That We Have “Succeeded”

We must provide CMS reliability & support equal to that of other basic services.

We must provide a CMS that incorporates rich media, multiple learning objects, digital library resources, and a variety of student transactions.

Page 15: Setting a Next-Generation CMS Strategy Robert F. Pack, University of Pittsburgh William K. Jackson, University of Georgia Tom Laughner, University of Notre.

Now That We Have “Succeeded”

We must provide a CMS that supports new options for anytime/anywhere access including tablet PC’s, PDA’s, and web-enabled cell phones.

We must provide a CMS that supports branding and other program-specific requirements.

Page 16: Setting a Next-Generation CMS Strategy Robert F. Pack, University of Pittsburgh William K. Jackson, University of Georgia Tom Laughner, University of Notre.

Now That We Have “Succeeded”

We must accomplish this at a cost we can afford!!

Page 17: Setting a Next-Generation CMS Strategy Robert F. Pack, University of Pittsburgh William K. Jackson, University of Georgia Tom Laughner, University of Notre.

CMS Selection Process

Tom Laughner

University of Notre Dame

Page 18: Setting a Next-Generation CMS Strategy Robert F. Pack, University of Pittsburgh William K. Jackson, University of Georgia Tom Laughner, University of Notre.

Background

WebCT introduced in 1997 25% of faculty and 95% of students Vista announcement in 2003

Page 19: Setting a Next-Generation CMS Strategy Robert F. Pack, University of Pittsburgh William K. Jackson, University of Georgia Tom Laughner, University of Notre.

Fundamental Questions

Should Notre Dame have a course management system?

What is the best course management system for Notre Dame?

Should the course management system be hosted on or off campus?

Page 20: Setting a Next-Generation CMS Strategy Robert F. Pack, University of Pittsburgh William K. Jackson, University of Georgia Tom Laughner, University of Notre.

Philosophy

Must be faculty driven process Student involvement Budget, infrastructure, technical

specifications

Page 21: Setting a Next-Generation CMS Strategy Robert F. Pack, University of Pittsburgh William K. Jackson, University of Georgia Tom Laughner, University of Notre.

Considerations Faculty requirements Student input Ease of use and intuitiveness Conversion Technical Integration/standards Vendor viability Support Training

Page 22: Setting a Next-Generation CMS Strategy Robert F. Pack, University of Pittsburgh William K. Jackson, University of Georgia Tom Laughner, University of Notre.

Products

Angel Blackboard 6.0 eCollege WebCT Campus Edition 4.0 WebCT Vista

Page 23: Setting a Next-Generation CMS Strategy Robert F. Pack, University of Pittsburgh William K. Jackson, University of Georgia Tom Laughner, University of Notre.

Phases

1. Information gathering

2. Product demos

3. Faculty hands-on evaluations

4. Student hands-on evaluations

5. Projects and Planning

6. RFP

Page 24: Setting a Next-Generation CMS Strategy Robert F. Pack, University of Pittsburgh William K. Jackson, University of Georgia Tom Laughner, University of Notre.

Outreach

Web site – http://oit.nd.edu/cms Article in student paper Electronic mail to all faculty (very limited)

and current CMS users (more frequent)

Page 25: Setting a Next-Generation CMS Strategy Robert F. Pack, University of Pittsburgh William K. Jackson, University of Georgia Tom Laughner, University of Notre.

Cost Analysis

Tom Head

Virginia Tech

Page 26: Setting a Next-Generation CMS Strategy Robert F. Pack, University of Pittsburgh William K. Jackson, University of Georgia Tom Laughner, University of Notre.

Blackboard at Virginia Tech

Fall Semester 2003 Usage

1,590 courses 1,150 faculty (85%) 25,215 students

(95%)

392

930

1454

2177

0

500

1000

1500

2000

2500

2000 2001 2002 2003

Blackboard Sections by Academic Year

Page 27: Setting a Next-Generation CMS Strategy Robert F. Pack, University of Pittsburgh William K. Jackson, University of Georgia Tom Laughner, University of Notre.

CMS Costs

Personnel (Help Desk/Technical) License Fees Equipment Amortization Network Connectivity, Space & Overhead

Page 28: Setting a Next-Generation CMS Strategy Robert F. Pack, University of Pittsburgh William K. Jackson, University of Georgia Tom Laughner, University of Notre.

CMS Costs

License20%

Hardware20%

Miscellaneous 10%

Personnel50%

Page 29: Setting a Next-Generation CMS Strategy Robert F. Pack, University of Pittsburgh William K. Jackson, University of Georgia Tom Laughner, University of Notre.

Costs Per Student Decrease withIncreasing Enrollment

CMS Cost Per Student

Increasing Enrollment

Cost

Per

Stu

den

t

Page 30: Setting a Next-Generation CMS Strategy Robert F. Pack, University of Pittsburgh William K. Jackson, University of Georgia Tom Laughner, University of Notre.

CMS Faculty Costs

Faculty Training Course development by faculty Training and development costs must be

balanced by increased productivity a CMS provides for faculty

Page 31: Setting a Next-Generation CMS Strategy Robert F. Pack, University of Pittsburgh William K. Jackson, University of Georgia Tom Laughner, University of Notre.

Vendor Issues

Kathleen Thomas

University of North Carolina at Chapel Hill

Page 32: Setting a Next-Generation CMS Strategy Robert F. Pack, University of Pittsburgh William K. Jackson, University of Georgia Tom Laughner, University of Notre.

Blackboard at UNC

1,575 Course Sections

1,690 Faculty (56%)

21,951 Students (84%)

24

369

650

1050

1500

0

200

400

600

800

1000

1200

1400

1600

1999 2000 2001 2002 2003

Fall Term Sections Using Blackboard

Page 33: Setting a Next-Generation CMS Strategy Robert F. Pack, University of Pittsburgh William K. Jackson, University of Georgia Tom Laughner, University of Notre.

Growing Pains

Expanding client base Expectation that the systems perform

many functions Difficult for vendor to stress test entire

system Clients seem to be the testers

Testing, tracking down, and describing problems to the vendor

Find work-arounds for problems

Page 34: Setting a Next-Generation CMS Strategy Robert F. Pack, University of Pittsburgh William K. Jackson, University of Georgia Tom Laughner, University of Notre.

Vendor Support

Perception that vendors are less responsive

We encourage faculty to send comments directly to Blackboard

Vendor may want access to production systems and data

Has a direct bearing on support

Page 35: Setting a Next-Generation CMS Strategy Robert F. Pack, University of Pittsburgh William K. Jackson, University of Georgia Tom Laughner, University of Notre.

Healthy Relationship

Must be willing to commit resources to the relationship with the vendor

Should not be the front line support person Must follow up often

Page 36: Setting a Next-Generation CMS Strategy Robert F. Pack, University of Pittsburgh William K. Jackson, University of Georgia Tom Laughner, University of Notre.

Trapped?

Despite emerging standards/initiatives, systems aren’t compatible

Courses aren’t portable Need to work with instructors to develop

strategies for increased portability

If unhappy with current CMS, how is change managed?

-Parallel systems? -How long are courses stored in ‘old’ system?

Page 37: Setting a Next-Generation CMS Strategy Robert F. Pack, University of Pittsburgh William K. Jackson, University of Georgia Tom Laughner, University of Notre.

Next-Generation CMS:

The Open Source Option

Bradley C. Wheeler

Indiana University

Page 38: Setting a Next-Generation CMS Strategy Robert F. Pack, University of Pittsburgh William K. Jackson, University of Georgia Tom Laughner, University of Notre.

Oncourse at Indiana

6%

10%

20%

26%

32%

0%

5%

10%

15%

20%

25%

30%

35%

1999 2000 2001 2002 2003

Fall Term Sections using Oncourse 7,332 Course

Sections (32%) 5,352 Faculty (72%) 76,069 Students

(79%)

Page 39: Setting a Next-Generation CMS Strategy Robert F. Pack, University of Pittsburgh William K. Jackson, University of Georgia Tom Laughner, University of Notre.

Indiana University

Positive experiences with home-grown system - Oncourse

100,000+ students provide economies of scale – strong adoption and integration

Want to maintain control of our destiny – “software code mobility” is the key economic bet

Page 40: Setting a Next-Generation CMS Strategy Robert F. Pack, University of Pittsburgh William K. Jackson, University of Georgia Tom Laughner, University of Notre.

CMS Becomes Unbundled Collection of Portal

ServicesLibraryRegistrarCMS UITS

onestart.iu.edu

Portal

AuthenticationPersonalization

WorkflowDelegation

Services:

Data:

Page 41: Setting a Next-Generation CMS Strategy Robert F. Pack, University of Pittsburgh William K. Jackson, University of Georgia Tom Laughner, University of Notre.

Open Source CMS Choice

Architecture uses OKI’s services, J2EE Began as a MOU w/ U. Michigan Currently, In development with Michigan

and Stanford on OKI-based quizzing tool – www.navigoproject.org

ePortfolio 2.0 beginning now with OSPI Full CMS build out with partner schools

during 2004 Fully available as open source 2004-05

Page 42: Setting a Next-Generation CMS Strategy Robert F. Pack, University of Pittsburgh William K. Jackson, University of Georgia Tom Laughner, University of Notre.

Agenda The Issues:

Goals and Objectives - University of Georgia CMS Selection - University of Notre Dame Cost Analysis - Virginia Tech Vendor Issues - University of North Carolina Open Source Option - Indiana University

Summary: Where Do We Go From Here?

Page 43: Setting a Next-Generation CMS Strategy Robert F. Pack, University of Pittsburgh William K. Jackson, University of Georgia Tom Laughner, University of Notre.

What Have We Learned?

Course Management Systems are becoming a ubiquitous tool in Higher Ed

Faculty Adoption Rates Continue to Increase at Accelerating Pace

Student Expectations Grow Exponentially CMS’s are NOT Interoperable

Standards efforts like IMS notwithstanding The Initial Purchase Price is Just the

“Tip of the Tip” of the Iceberg

Page 44: Setting a Next-Generation CMS Strategy Robert F. Pack, University of Pittsburgh William K. Jackson, University of Georgia Tom Laughner, University of Notre.

Considerations

Why did we implement CMS’s? Have we done adequate assessments?

Do CMS’s offer sufficient flexibility? Or, do they constrain originality?

How important is a consistent user interface?

Or, will students adapt to multiple CMS’s?

Can costs be reduced or at least level off?

Page 45: Setting a Next-Generation CMS Strategy Robert F. Pack, University of Pittsburgh William K. Jackson, University of Georgia Tom Laughner, University of Notre.

Considerations

Are CMS’s a fundamental instructional format or just another tool?

Have CMS’s fundamentally changed the role of the faculty member?

Have CMS’s fundamentally changed our courses?

Is there any real evaluation of the impact of CMS’s on teaching and learning?

Page 46: Setting a Next-Generation CMS Strategy Robert F. Pack, University of Pittsburgh William K. Jackson, University of Georgia Tom Laughner, University of Notre.

In Conclusion, We Must ...

... clearly define the role and purpose of a CMS at the institutional level.

... define goals and measurements to determine success.

... anticipate the true costs of alternative approaches to training and support.

... create a strategy for the evolution of the instructional environment.

Page 47: Setting a Next-Generation CMS Strategy Robert F. Pack, University of Pittsburgh William K. Jackson, University of Georgia Tom Laughner, University of Notre.

?Robert F. PackPittsburgh

Tom HeadVirginia Tech

Kathleen ThomasNorth Carolina

Tom LaughnerNotre Dame

Brad WheelerIndiana

William K. JacksonGeorgia