Open Data - Current State & Next Gen

Presented by Jury Konga, Principal

eGovFutures Group

.

Open Data- Current State & Next Gen

MISA BC Open Data ConferenceNanaimo, B.C.April 28 - 30, 2011

Jury KongaOpen by Design TM

Appreciation is extended to a number of people and organizations in the Open Government & Open Data Community including:

• MISA BC and the conference organizing committee with special thanks to Per Kristensen and Jason Birch, City of Nanaimo

• MISA Ontario Gov 2.0 SIG• Tracey Lauriault, DataLibre• WWW, twitter, YouTube, LinkedIn…. and all my “Open” friends

• This presentation will be publicly available on www.slideshare.net/jkonga as Creative Commons BY

• #misaBC #opendata #opengov #gov20 I’m @jkonga … tweet away

Acknowledgements

Open Data – Current State and Next Gen 2

http://www.slideshare.net/jkonga


Open Gov Context – Open Data, Citizen Engagement, Collaboration, Innovation

Open Data Current State• Principles• Open Data – local to global• Open Data Framework

Next Gen Open Data

Closing thoughts

Overview

Open Data – Current State and Next Gen 3


Conference geographic context

Regional presence- small to medium size municipalities

Couple of Out-of-province visitors

Overview

4Open Data – Current State & Next Gen


• Roots in Freedom of Information legislation (oldest identified with Sweden in 1766, U.S.A. 1966; Canada FOI as well as Privacy Act; 1983)

• More recently, Open Government focuses on citizen engagement, transparency, accountability, collaboration and innovation

• 3 Pillars of Open Government from Senator Kate Lundy, Australia:Citizen- Centric Government, Open and Transparent Government and Innovation Facilitation (June 2009)

• President Obama’s Open Government directive (Jan. 2009) synopsis: Government should be transparent, participatory and collaborative

Context- Open Government



• “Government 2.0: Using Technology to Improve Education, Cut Red Tape, Reduce Gridlock, and Enhance Democracy”William Eggers, Deloitte. 2005

• Gov 2.0 “is the use of technology – especially the collaborative technologies at the heart of Web 2.0 – to better solve the collective problems at a city, state, national and international level”Tim O’Reilly, “Open Government – Collaboration, Transparency and Participation in Practice”. 2010

• From GovLoop (the government Facebook), working definition (2010):Gov 2.0 embraces the use of new and old tools, changes of employee and contractor culture, and improvements in processes that make government more transparent, collaborative, and participatory--enabling citizens and others to gain more efficient and timely access to data, information, and services through the sharing and distribution of information within and throughout the government.

Context- Gov(ernment) 2.0



• Open Data is a foundational component for Open Government and focuses on freely making public data available in a usable format for all to re-use and add value for the benefit of citizens.

• Open Data – it’s about public data being easily discoverable, readily accessible and freely available without restrictions (to a degree)

• Recent Open Data initiatives have focused on public sector data and very recently has also turned to private sector corporate data

• Open Data – not new, we’ve been doing it for a while … what has changed is the public’s expectations of expanded scope and ease of access to government data

Context- Open Data


Jury KongaOpen by Design TM 8

Credit: Rob Tornoe / Delaware News Journal, PoliticalCartoons.com

Open Data – Current State & Next Gen


Open Government- Why?

9

This is the “rush” …. needs & expectations

Images via MS Office



Open Government - A View of Principles



Business: Public Services

Structure: Corporation

Governance: Council (Board of Directors)

Servicing: Citizens and Businesses- the SHAREHOLDERS

Open Government- Perspective for Local Government



Open Government and Service Delivery

Open Government – Focus on Citizens and Service 12

ClientOrganizations

IndividualClientsOutputs

ProviderOrganizations

Authority

AccountabilityRoles

Responsibility

Used in

Deliver

Accomplish

Governance Outcomes& Impacts

Jurisdictions

Programs

Services

Processes

Resources

Municipal Reference Model MRMv2 Components – An Organizing Framework

Work in Progress

Source: “Describing Municipal Government -Using Programs and Services” presentationby Roy Wiseman



13

Federal

Provincial

Municipal

Government

It’s _ _ _Government

#&*!%?

We need to move from this ….




14

Federal

Provincial

Municipal

Government

It’s GOODGovernment !!!

To this ….

Integrated Service Delivery

– Service One conceptMISA Ontario 2010 conference



Open Government Elements- Focus on Citizens

15

Core Element Value to Citizens

Citizen Engagement Democracy with the opportunity to participate and influence policy

Open Data Transparency via access to public information and potential value added products and services

Collaboration Efficiencies in government , reduced duplication of effort and better results

Innovation Enhancing policy , service delivery and optimizing government resources

What needs to improve to benefit citizens …



Citizen Engagement- Current State

16

Gov 2.0/Web 2.0/ Social Media technologies are pervasive

Social media becomes key in engagement

Communications demands increase

Forming community partnerships is imperative


http://images.google.ca/imgres?imgurl=http://www.cocatalyst.com/blog/wp-content/uploads/2008/07/linkedin4.jpg&imgrefurl=http://www.cocatalyst.com/blog/index.php/category/targeted-technology/&usg=__6G6NLFSy6H1fr2ePJfJPP_phTWM=&h=216&w=640&sz=49&hl=en&start=2&tbnid=d5Sjr-qb-drGeM:&tbnh=46&tbnw=137&prev=/images?q=linkedin&gbv=2&hl=en&safe=off

http://images.google.ca/imgres?imgurl=http://techno.branchez-vous.com/actualite/upload/2007/10/logo_second_life.jpg&imgrefurl=http://techno.branchez-vous.com/actualite/2007/10/le_pouvoir_de_la_pensee.html&usg=__JP2rX5mancTfHoCgjlzBhgf57ko=&h=646&w=955&sz=63&hl=en&start=4&tbnid=nexrZsn4-vbEhM:&tbnh=100&tbnw=148&prev=/images?q=second+life+logo&gbv=2&hl=en&safe=off&sa=G


Crowdsourcing

ChangeCamps, CityCamps, GovCamps …

Pull -> Push -> Dialogue

Effective communications and citizen engagement requires … ongoing resources

Citizen Engagement- additional Perspectives



Manitoba & Saskatchewan flooding

First implement-ation of Ushahidi platform in Canada

Visualization, submit reports, get alerts, download reports

Application creators: Laura Madison (MB) and Dale Zak (SK)

Thanks to Heather Leson for her insight

Citizen Engagement - Open Community Project

18

Source: http://mbfloods.ca #mbfloods via Tweetdeck


http://mbfloods.ca/


Collaboration- Current State

19

Collaborate Now“All of us are smarter than one of us”

“There are more knowledgeable people outside your organization than inside”



Collaborate Now

Collaboration- Current State

Informal Info sharing

LegalPartnerships

Collaboration Continuum – resource requirements increase ->>>

Open Data – Current State & Next Gen 20


Collaboration Current State- Open Data Framework Project

Kudos to the Group of 4 (G4) for taking a leadership role in Canada

Open Data Framework Project with focus on Data Standards End Use agreement Open Data UI and

functionality Contributing to best

practices for the open data community



Innovation- Current State

2222

htt

p:/

/ww

w.s

oci

als

ign

al.c

om

/ca

rto

on

Promote innovation - don’t stifle it!


http://www.socialsignal.com/cartoon


Institute for Citizen Centred Service• Report on Innovation in Municipal Service Delivery (2010)

Need a focal point for Innovation• Centre Of Excellence for Innovation in Municipal

Government (proposed in 2009 presentation http://www.slideshare.net/jkonga/web-20-from-a-social-to-a-service-web )

Apps Development contests and hackathons, leveraging social media technologies, cloud computing (IaaS, SaaS, DaaS …)

Innovation- Current State


http://www.slideshare.net/jkonga/web-20-from-a-social-to-a-service-web


Innovation Current State - Re-using the Data

24

Applications that use and use and use and use the data

AppsforDemocracy in Washington, DC started a trend of apps contests (2009)

Examples shown here are: World Bank , British Columbia, Ottawa and Edmonton



Culture change/shock

• “Good Failure”

• Engagement /participation

• Transparency –from control to empowerment

Open Gov Reality – Biggest Challenge is Organizational Culture & Change Management

http://www.publivate.com/thinking-a-innovation/entry/elephant-in-the-room-culture-and-social-media-uptake-in-the-public-sector.html Open Data – Current State & Next Gen 25

http://www.publivate.com/thinking-a-innovation/entry/elephant-in-the-room-culture-and-social-media-uptake-in-the-public-sector.html




Open Data- Current State

10 Principles for Opening Up Government Informationhttp://sunlightfoundation.com/policy/documents/ten-open-data-principles/ Completeness Primacy Timeliness Ease of Physical and Electronic Access Machine readability Non-discrimination Use of Commonly owned standards Licensing Permanence Usage costs


http://sunlightfoundation.com/policy/documents/ten-open-data-principles/



10 Principles for Opening Up Government Information


Jury KongaOpen by Design TM Open Data - the New Reality


Global example – World Bank Data Catalog & Apps for Development contest (Initiated April 2010 )



Open Data Current State- the National Level

29

• United States – www.data.gov May 21, 2009

• United Kingdom –data.gov.uk Jan. 19, 2010

• Australia –data.australia.gov.au

• Canadawww.data.gc.ca March 17, 2011


http://www.data.gov/

http://www.data.gov.uk/

http://www.data.gc.ca/


Open Data Current State- the Provincial Level

30

• Land Info Ontario• GeoNova Portal• GeoBC

Apps 4 ClimateAction


MUCH TO DO IN PROVINCES !


Open Data Current State- Small to Medium Municipal Space

31

• Open Data – not just for large municipalities

• Examples include Nanaimo, B.C.; North Vancouver, B.C.; Surrey, B.C.; London, ON; Mississauga, ON; Windsor, ON (and more on the way)

• Most municipalities provide some degree of “open data” – the need is to make it more extensiveOpen Data – Current State & Next Gen

Jury KongaOpen by Design TM 32Open Data - the New Reality

Open Data Current State- U.S. Municipal Space

32

• Washington DC

• San Francisco

• New York City

• Seattle

• Portland


Open Data Current State- Use & Re-Use of the Data

33

• Value is not in the raw data alone

• Apps for use of the data is key to open data success

• Value to the Citizen is the bottom line

Great video on value of open data- http://www.streetfilms.org/a-case-for-open-data-in-transit/

Open Data - the New Reality

http://www.streetfilms.org/a-case-for-open-data-in-transit/


Open Data Current State - Collaboration from Local to Global

Local Open Data Community sites and events “owned and operated” by citizens

USING Open Data - Local to Global collaborations – all at once!

Participated in RHoK Dec 4 – 5, 2010. Combined with Intl Open Data Hackathon: 63 cities, 25 countries, 5 continents



G4: Vancouver, Toronto, Edmonton & Ottawa ODF Project: August – December 2010. ODF Components

• Governance• Principles & Policy• Standards• Technology• Data, Operations & Human Resources• Open Data Portal• Future Roadmap


G4 Open Data CitiesODF Project


How do you start an Open Data initiative? Who starts it? Who does what? Etc …

Open Data is part of Information Management

Governance structure• Leverage existing structure (e.g. Steering Committees, Working Groups)• Fit to size of your organization• Define roles & responsibilities (initial “pilot” -> ongoing -> “Coordinator”)• Enterprise participation – internal stakeholders (minimum: key players)• External Stakeholders – advisory/feedback loop


Open Data Framework- Governance


Principles: Sunlight Foundation’s “Ten Principles for Opening up Government Information”

Freedom of Information & Protection of Privacy governs& guidelines http://www.ipc.on.ca/english/Resources/Discussion-Papers/Discussion-Papers-Summary/?id=949

Key policy issue to be resolved: Terms of Use Open Data license (CIPPIC report - http://www.cippic.ca/open-licensing re: PDDL)

Reality check – not all principles can be achieved from the outset

… but need to review existing corporate & IM policies (aligned?)Open Data – Current State & Next Gen 37

Open Data Framework- Principles & Policy

http://www.ipc.on.ca/english/Resources/Discussion-Papers/Discussion-Papers-Summary/?id=949

http://www.cippic.ca/open-licensing


Information Management – open data lifecycle & Municipal Reference Data Model

Data Discovery and Access – “findability”

Data Distribution and Data formats – ETL & end user needs• Commonly requested: CSV/XLS; txt; XML; JSON; KML/KMZ & Mr SID (raster)

Metadata – best practices & context for data use• Dublin Core (+ quality) & ISO 19115 NAP for geo data)

Linked Open Data – next steps towards semantic webOpen Data – Current State & Next Gen 38

Open Data Framework- Standards

Source: W3C : “Publishing Open Government Data”


Technology is not seen as a major challenge

Technology service elements related to Open Data operations• Content Management Systems (CMS) ; Extract-Transform-Load

(ETL); DBMS; Web 2.0; Access APIs; Analytics & Visualization

Open Data platform - in-house or hosted

Public “G Cloud” shared services

Enterprise approach – defer to Vancouver’s presentation


Open Data Framework- Technology


Open Data … more please• Budget, Transit, Service Requests (3-1-1), Facilities &

services, policies, website content ….

Information Asset Inventory – what data do you have? Own?

Open Data Request process & Prioritization• Vancouver provided a draft prioritization as part of project


Open Data Framework- Data, Operations & HR


Open Data/IM Lifecycle Activities

Data Discovery and Asset Inventory

Data Request and Prioritization

Open Data Extraction and Dissemination

Data and Metadata Maintenance and Quality Assurance

Departmental and Related Agency Collaboration


Open Data Framework- Data, Operations & HR


People are the key to any success – corporation’s intellectual capital

For Open Data operations, a number of HR areas need to be addressed including• Roles and responsibilities;• Knowledge and training requirements;• Integrated teams;• Career path planning;• Optimal work environment and reward system

New position/role: Open Data CoordinatorOpen Data – Current State & Next Gen 42

Open Data Framework- Data, Operations & Human Resources


Content and User Interface/Experience

Open Data Portal Functionality

OpenData.ca Community collaboration portal

Portal architecture review


Open Data Framework- Open Data Portal


Similar to eGov phased approach by Gartner and Deloitte, following proposed as the Five Phases of Open Data (FPOD)• Phase 1 – Open Data Start-up: Publishing Information on Website

• Phase 2 – Open Data Transactional: Providing a Data Catalogue Service

• Phase 3 – Creating a Multi-functional Open Data Portal

• Phase 4 – Open Data Transformation: Achieving Enterprise Open Data

• Phase 5 – Full Integration with Global Open Data Community

A Roadmap addresses moving along the maturity model


Open Data Framework- Open Data Maturity Model

Jury KongaOpen by Design TM Open Data – Current State & Next Gen 45

Open Data Framework- Open Data Maturity Model

1 Startup

2 Data Catalog

3 Open Data Portal

4 Enterprise Open Data

5 Global Integration

Five Phases of Open Data

Evolutionary withinInfo Management Best Practices


46

Government

NGO

PrivateAcademia

Community Groups

Moving forward together … as a community

Need to leverage ourCommunity Intellectual Capitaland resources



• Where should we be headed …• Ubiquitous + Gov as a Facilitator

• Real time FOI responses

• Real time updates

• Crowdsourced data maintenance & QA

• Access by voice or standard QRcodes

Open Data- the Next Generation

47Open Data – Current State & Next GenJury KongaOpen by Design TM

Jury KongaOpen by Design TM 48Open Data – Current State & Next Gen

Open Data - NxGen

Open DataDNA

LinkedOpen Data

LinkedPersonal Data

… everything is connected to everything


Open Data NxGen- the Co Factor

Co-llaboration

Co-development

Co-delivery

Co-mmunication

Co-mmunity engagement

Co-mmunity benefit


Open Data NxGen- New Approach

50

Consider a new focus for the Service Provider – Client Relationship

Service Provider

Service Recipient

Us

Government

Them

Citizens

From this ….

Service Provider

Service Recipient

to this ..

WE

A Community ApproachTo Public Service



Open Data NxGen- Crowdsourcing

Today’s examples of where tomorrow will go


Open Data NxGen- Crowdsourcing

Many ways to Crowdsource- don’t discount any of the opportunities

…. Not everything is digital


Open Data NxGen- MRDM v1.0

MRM v2 = Municipal Services Model NxGen = Municipal Reference Data Model

• Data required for services• Data definitions – a standard (leverage existing

work) to be used by public + private sector• Semantics resolution – mapping the differences• Moving it from local –global• Optimizes open data search results• Assists apps dev community


http://www.guardian.co.uk/politics/interactive/2010/oct/19/comprehensive-spending-review-cuts

Open Data NxGen- Enhanced UsabilityVisualization

User interaction

http://www.guardian.co.uk/politics/interactive/2010/oct/19/comprehensive-spending-review-cuts


OpenData.EARTH

OpenData.EARTH

55

Academia, Non-Profits,

Community Groups

OpenStreetMapCommunity

Updates

External Data Linkages(e.g. World Bank)

OpenData.CA

Provincial

Municipal

Federal

Public Service

Source: Municipal Open Government Framework, 2010www.slideshare.net/jkonga

Open Data NxGen- Enhanced Content & Access


http://www.slidershare.net/jkonga


5656

Service One (2.0)- The Service Coordinator

Service One (2.0)- The Service Coordinator

•Products & Services




Provincial

Municipal

FederalPrivate & Non-

Profits

Integrated Service Delivery “Engine”

Process C

Process B

Process A

Standardized Processes, Protocols and Knowledge Base

Business KnowledgeDatabase

Service Requests

Requests from MyHomePage(Facebook, Twitter, verbal)

Open Data becomes part of Integrated Service Delivery

Value of the strategic asset is optimized

Source: From a Social to a Service Web, 2009. www.slideshare.net/jkonga

Open Data NxGen- Integrated Service Delivery




Embrace Open Government and Open Data – you’re actually already part of the way there

Accelerate Open Data – all levels of government need to increase knowledge and pick up the pace of moving forward to benefit all

Plan now, develop incrementally – awareness of the new environment, readiness assessment, align with priorities & allocate resources

Collaborate Now - limited resources and increasing internal and external demands for efficient and effective government dictate it

Build and Leverage Your Community – engage the citizens, businesses and community groups … the community wants to help

Make Innovation the default – expectations are that government will become open and efficient through innovation

“Just Do It” - NxGen … here we come

… a few Concluding Thoughts



… a final Thought


Get involved – you’ll enjoy it and get benefits back!

Open Data NxGen is open to everyone!


59

It’s a long road …. enjoy the drive - the destination is worth it!


Thank you Nanaimo

Jury Konga, PrincipaleGovFutures Group

[email protected] @jkongaSkype jury.konga

Other presentations:www.slideshare.net/jkonga

Thank You

mailto:[email protected]


Open Data - Current State & Next Gen

Technology

Transcript of Open Data - Current State & Next Gen