Agile Business Intelligence in the Large...

13
PRESENTATION FOR THE AUSTRALIAN CHAPTER OF THE DATA WAREHOUSE INSTITUTE AGILE BUSINESS INTELLIGENCE IN THE LARGE ENTERPRISE IN THE LARGE ENTERPRISE Jason Sharpe Telstra Enterprise & Government 06 October 2010

Transcript of Agile Business Intelligence in the Large...

PRESENTATION FOR THE AUSTRALIAN CHAPTER OF THE DATA WAREHOUSE INSTITUTE

AGILE BUSINESS INTELLIGENCE IN THE LARGE ENTERPRISEIN THE LARGE ENTERPRISE

Jason Sharpe

Telstra

Enterprise & Government

06 October 2010

AGILE SOFTWARE DEVELOPMENT IS A GROUP OF SOFTWARE DEVELOPMENT METHODOLOGIES BASED ON ITERATIVE AND INCREMENTAL DEVELOPMENT, WHERE REQUIREMENTS AND SOLUTIONS EVOLVE

THROUGH COLLABORATION BETWEEN SELF-ORGANIZING, CROSS-FUNCTIONAL TEAMS.ORGANIZING, CROSS-FUNCTIONAL TEAMS.

August 2010, from Wikipedia, the free encyclopedia

(Redirected from Agile Manifesto)

Jason Sharpe | Agile BI in the Large Enterprise | Telstra Unrestricted | Final

ABSTRACT & TOPICS

Telstra is the largest telecommunications provider in Australia with an enterprise data warehouse program, 7 legacy data warehouses, over 120 data marts, many reporting systems, multiple business units and centralised IT and Finance.

With the business and technical landscapes continuously changing and the time available to adapt and respond to those changes continuously decreasing, Telstra is pursuing a Collaborative Information Management Approach to enable agile business intelligence.

This presentation will discuss motivation, theory and approach to agile business This presentation will discuss motivation, theory and approach to agile business intelligence in the large enterprise.

Topics:

– Business & Technical Challenges

– Natural Systems

– Complex Adaptive Systems

– Making Best Use of All Levels of BI Maturity

– Enabling Collaborative Information Management

– Governing towards a Single View of Truth

Jason Sharpe | Agile BI in the Large Enterprise | Telstra Unrestricted | Final

BUSINESS & TECHNICAL CHALLENGES

Business Challenges

– Dynamic external business environment

– Dynamic internal business organisation

– Decreasing time to market or respond

– Timely access to [quality and complete] information

Profitability pressures on more cost efficient solutions– Profitability pressures on more cost efficient solutions

Technical Challenges

– Incorporating data from new, transient and legacy systems

– Too many BI technologies with too few and varying skills

– One size does not fit all, not all data suited for the EDW

– Addressing tactical needs whilst pursuing strategic plans

– Aligning business intelligence teams across the enterprise

Jason Sharpe | Agile BI in the Large Enterprise | Telstra Unrestricted | Final

THEORY OF NATURAL SYSTEMS

Water & Environment

Natural systems have evolved with large central components servicing and being serviced by a distribution network of smaller components that are equally as important as the central components. All are needed in balance to operate as a whole.

SOURCE: The National Centre for Atmospheric Research SOURCE: www.worldinvisible.com

Jason Sharpe | Agile BI in the Large Enterprise | Telstra Unrestricted | Final

COMPLEX ADAPTIVE SYSTEMS

Complex adaptive systems are special cases of complex systems. They are complex in that they are diverse and made up of multiple interconnected elements (and so a part of network science) and adaptive in that they have the capacity to change and learn from experience.

SOURCE: Wikipedia

Jason Sharpe | Agile BI in the Large Enterprise | Telstra Unrestricted | Final

MAKING BEST USE OF ALL LEVELS OF BI MATURITY

1Ad-Hoc

2Repeatable

3Defined

4Integrated

5Optimised

by teams of individuals using a shared system to support …

by LOB for implementation and support by IT to support …

by F&A using definitions provided by LOB using systems implemented and supported by IT that is used to support …

by Transformation Program with input from LOB & F&A to enable LOB & FA& to support …

work performed byIndividuals to support …

Information Flow

Individuals Lines of Business Multiple The

BI Software

Processes

People

Data Content

Data Structures

Infrastructure

Logical 3NF

Cognos / BO

CubesStar Schemas

Teradata

Fat TablesExtracts

MicrosoftSASXcelcius, SAS

Laptop + AAMIE

Performance Financial All Content

ITFinanceBI COEWork GroupsIndividuals

Marketing Operational

Operations ReportingAnalysisModelling Data Warehousing

Individuals & One-Offs

Lines of Businesses

Business Units

Multiple Business Units

The Enterprise

Reps DSC F&A IT

IDM IDM/CIMA CIMA EDW

Typical …

Jason Sharpe | Agile BI in the Large Enterprise | Telstra Unrestricted | Final

ENABLING COLLABORATIVE INFORMATION MANAGEMENT

1 2 3 4 5

TE&G withCorp Mktg

TE&G CKI with DWSA and TEG

F&A

TE&G CKI with DWSA and Corp

F&A

TE&G with Corp IT and Corp F&A

Will be for cross-BU Dashboards & Reports and

self-service data exploration and reporting

Will be for Business Unit Dashboards & Reports

Will be for exclusive use with SAS

Ent-MinerFor data mining

Will be for use with SAS

Ent-Guide or BI-MAXFor self-

service queries

To enable collaborative information management, we have first enabled power users at level 1 and are adding in more users as we progress to level 5.

Ad-Hoc Repeatable Defined Integrated Optimised

TacticalCIMA via EDW

AAMIE

Ad-Hoc Queries

Business Unit Dashboards

and Reports

Cross-BU Dashboards & Reports

IDM TEG

CVA D&B MAXIM

IDM CORP

CIMA Sandpits

Enterprise Data

Warehouse

RAPTOR EPMAcct PlansStop Gap MeasureInterim Data Mart

Enterprise Dashboards & Reports

Initial CapabilityAAMIE

StrategicEDW

Data

Mining

Jason Sharpe | Agile BI in the Large Enterprise | Telstra Unrestricted | Final

A COLLABORATIVE INFORMATION MANAGEMENT APPROACH

Agile data warehousing with integrated sandboxing will enable business units to self-manage data from their systems and blend that data with enterprise data from corporate systems through a suite of enterprise grade reporting architectures.

Jason Sharpe | Agile BI in the Large Enterprise | Telstra Unrestricted | Final

Operating ModelTE&G Alignment to Cross-Company Governances & Forums

Cross-Company Data Governance

EDW Program

Corp F&A EIM

TE&GJ Sharpe

Cross-Company Reporting & Metrics

Governance

Cross-Company Data & Reporting Strategy

& Architecture

Corp F&A EIMJ Hebden

Corp F&AS Dorrington

Business Unit Representatives

TE&G Data Stewards Council

• Report Rationalisation• Dashboard Enablement• Data Quality Improvement• Collaboration & Knowledge

Cross-Company Governances & Forums

• EDW Key Advisers & CSA Program Governance• Enterprise Reporting Governance• EDMS Program Governance• Telstra Business Intelligence Forum• Telstra Collaboration & Knowledge Mgmt Forum

TE&G CKI Team

• Operational BI• Performance BI• Predictive BI• CK Mgmt

Corp IT S&AM Kortink

Jason Sharpe | Agile BI in the Large Enterprise | Telstra Unrestricted | Final

Operating ModelTE&G VBM Business Intelligence Review April 2008

Other Groups Requesting Support

Project JupiterProject Jupiter

NA&S

NES

TPM

TEG Ops CKI

TEG Ops CKI

TE&G Data Stewards

Jason Sharpe | Agile BI in the Large Enterprise | Telstra Unrestricted | Final

Operating ModelTE&G VBM Business Intelligence Review April 2008

Jason Sharpe | Agile BI in the Large Enterprise | Telstra Unrestricted | Final

REFLECTION

Business & Technical Challenges

Natural Systems

Complex Adaptive Systems

Making Best Use of All Levels of BI Maturity

Enabling Collaborative Information ManagementEnabling Collaborative Information Management

Governing towards a Single View of Truth

With the business and technical landscapes continuously changing and the time available to adapt and respond to those changes continuously decreasing, Telstra is pursuing a Collaborative Information Management Approach to enable agile business intelligence.

Jason Sharpe | Agile BI in the Large Enterprise | Telstra Unrestricted | Final