Metadata and IT service management

Metadata and Metadata and IT service managementIT service management

Charlie BetzCharlie BetzAccentureAccenture

04/10/23 2Metadata & IT Service Management

What we will coverWhat we will cover

A brief history & analysis of this A brief history & analysis of this word “metadata”word “metadata”

Comparison and contrast of Comparison and contrast of metadata repository, CMDB, and metadata repository, CMDB, and other sources of structured IT other sources of structured IT information. information.

CMDB data architectureCMDB data architecture Technical and organizational issues Technical and organizational issues Integrated, ERP-like solutions for ITIntegrated, ERP-like solutions for IT


What is “metadata”?What is “metadata”?

A view from the data analysis A view from the data analysis community:community:

““Metadata describes critical elements Metadata describes critical elements of data scattered across the of data scattered across the organization.”organization.” (Jahn) (Jahn)


The data dictionaryThe data dictionaryLogical Name

Physical Name

Definition

Entity Customer CUST An identified consumer or purchaser of enterprise services.

Logical Name

Physical Name

Definition Datatype

Attributes First Name FNAME A first or given name char(32)Last Name LNAME A last or surname char(32)Address 1 ADDR_1 The first part of a mailing

address.char(64)

Address 2 ADDR_2 The second part of a mailing address.

char(64)

City CITY The city pertaining to the mailing address.

char(64)

State STATE A recognized metropolitan char(2)Zip ZIP A US ZIP code. char(5)


The data dictionary in The data dictionary in contextcontextLogical

NamePhysical Name

Definition

Entity Customer CUST An identified consumer or purchaser of enterprise services.

Logical Name

Physical Name

Definition Datatype

Attributes First Name FNAME A first or given name char(32)Last Name LNAME A last or surname char(32)Address 1 ADDR_1 The first part of a mailing

address.char(64)

Address 2 ADDR_2 The second part of a mailing address.

char(64)

City CITY The city pertaining to the mailing address.

char(64)

State STATE A recognized metropolitan char(2)Zip ZIP A US ZIP code. char(5)

What databases is this data structure in?

What servers are they on?

What programs depend on this data?

What data feeds contain this data structure?

Over what middleware are they flowing, and where are they going?


Scope, scope, Scope, scope, scopescope

All of the following are metadata according All of the following are metadata according to current metadata expertsto current metadata experts

Software portfolio (application inventory)Software portfolio (application inventory) IT assets (hardware inventory)IT assets (hardware inventory) File, database, object, class, and File, database, object, class, and

component definitionscomponent definitions Business process documentationBusiness process documentation Organizational structure as it relates to IS Organizational structure as it relates to IS

system control (e.g., data stewardship, system control (e.g., data stewardship, business process ownership)business process ownership)

Data transformationsData transformations Batch job operationsBatch job operations Data quality statisticsData quality statistics Software configuration managementSoftware configuration management


Configuration management Configuration management according to ITILaccording to ITIL

The Configuration Management system The Configuration Management system identifies relationships between an item that is to identifies relationships between an item that is to

be changed and any other components of the be changed and any other components of the infrastructure, infrastructure,

thus allowing the owners of these components to thus allowing the owners of these components to be involved in the impact assessment process. be involved in the impact assessment process.

Whenever a Change is made to the Whenever a Change is made to the infrastructure, infrastructure, associated Configuration Management records associated Configuration Management records

should be updated in the CMDB. should be updated in the CMDB. Where possible, this is best accomplished by use Where possible, this is best accomplished by use

of integrated tools that update records of integrated tools that update records automatically as Changes are made.automatically as Changes are made.


Scope of CMDBScope of CMDB

From ITIL Service Support From ITIL Service Support volume:volume:

Infrastructure servers Infrastructure servers Mainframes Mainframes Customer and supplier Customer and supplier

databases [why stop databases [why stop there?]there?]

Operational Operational environments and environments and applications supporting applications supporting regulated business regulated business systems systems

Mission-critical services Mission-critical services

Desktop builds and Desktop builds and software licencessoftware licences

Networks. Networks. Items that could affect Items that could affect

regulatory compliance regulatory compliance for the organisation for the organisation

EDI and database EDI and database feeds, e.g. payroll feeds feeds, e.g. payroll feeds

External interfaces to External interfaces to trading partners, trading partners, suppliers, Customers suppliers, Customers and business partners and business partners

Interfaces to branches Interfaces to branches with Customer systemswith Customer systems


Other possible CMDB Other possible CMDB data sources data sources

From ITIL Service Support volume:From ITIL Service Support volume:

Requirements analysis and Requirements analysis and design tools, systems design tools, systems architecture and CASE toolsarchitecture and CASE tools

Database management Database management audit toolsaudit tools

Document-management Document-management systemssystems

Distribution and installation Distribution and installation toolstools

Comparison tools Comparison tools Build and release tools Build and release tools Installation and de-Installation and de-

installation toolsinstallation tools

Compression toolsCompression tools Listing and Listing and

configuration configuration baseline toolsbaseline tools

Audit tools (also Audit tools (also called 'discovery' or called 'discovery' or 'inventory' tools)'inventory' tools)

Detection and Detection and recovery tools recovery tools

Reporting toolsReporting tools


From the ITIL data From the ITIL data management volume management volume

(back-catalog)(back-catalog) “A corporate

repository is a store house for all the data definitions of the complete corporate data model for access by all its authorized users…. UNIX, DEC VAX, PC and other environments use the concept of a Configuration Management Database …”

Metadata repository vs. Metadata repository vs. CMDBCMDB

MDR

CMDBOperations

Development

Management frameworksNon-database discovery tools

CASE toolsSource code

scanners

SCM tools

DBMS scanning

Maintenance processes

Development processes

Config, change, incident, problem, release, etc.

This is the BIG difference!Unstable state. There is strong pressure to converge!


Configuration management Configuration management that’s not about metadatathat’s not about metadata

Desktops have rarely if ever been of Desktops have rarely if ever been of interest to metadata administratorsinterest to metadata administrators

Metadata is typically not integrated Metadata is typically not integrated with management frameworkswith management frameworks Perhaps this should change!Perhaps this should change!

Metadata has been historically Metadata has been historically weak in processweak in process Assumes that someone else has been Assumes that someone else has been

keeping it up to datekeeping it up to date


Can my metadata Can my metadata repository repository

also be a CMDB?also be a CMDB? Possibly, but…Possibly, but…

Most ITIL suites integrate at least Most ITIL suites integrate at least change, config, and incident. change, config, and incident.

More convenient, but also greater More convenient, but also greater vendor lock-in.vendor lock-in.

Stand-alone CMDBs can existStand-alone CMDBs can exist One can decouple the CI inventory from One can decouple the CI inventory from

process applications through unique IDs process applications through unique IDs (e.g. URLs/URIs)(e.g. URLs/URIs)

Your repository starts to turn into an Your repository starts to turn into an OLTP tool; be readyOLTP tool; be ready


Repository as CMDB - 2Repository as CMDB - 2

Simple data

Complex dataAre you ready for

complex data?


Challenges of complex Challenges of complex datadata

Deep inheritance Deep inheritance from highly abstract from highly abstract supertypessupertypes

Recursion (trees and Recursion (trees and networks)networks)

Many many-manysMany many-manys All of the above All of the above

result in result in object/relational object/relational mapping layers in mapping layers in advanced repository advanced repository productsproducts

Industry standards…Industry standards…


The CMDB requirementsThe CMDB requirements ““Configuration structures should describe the relationship and position of Configuration structures should describe the relationship and position of

CIs in each structure… CIs should be selected by applying a CIs in each structure… CIs should be selected by applying a decomposition process to the top-level item using guidance criteria for the decomposition process to the top-level item using guidance criteria for the selection of CIs. A CI can exist as part of any number of different CIs or CI selection of CIs. A CI can exist as part of any number of different CIs or CI sets at the same time… The CI level chosen depends on the business and sets at the same time… The CI level chosen depends on the business and service requirements. service requirements.

““Although a 'child' CI should be 'owned' by one 'parent' CI, it can be 'used Although a 'child' CI should be 'owned' by one 'parent' CI, it can be 'used by' any number of other CIs… by' any number of other CIs…

““Components should be classified into CI types…Typical CI types are: Components should be classified into CI types…Typical CI types are: software products, business systems, system software.…software products, business systems, system software.…

The relationships between CIs should be stored so as to provide The relationships between CIs should be stored so as to provide dependency information. For example, … a CI is a part of another CI[,] … dependency information. For example, … a CI is a part of another CI[,] … a CI is connected to another CI [,] … a CI uses another CI…”a CI is connected to another CI [,] … a CI uses another CI…”


Configuration item Configuration item definitiondefinition

Per ITIL: The CM team is to "set up CI Per ITIL: The CM team is to "set up CI types, attributes, types of relationships, types, attributes, types of relationships, high-level CIs."high-level CIs."

Defining types and valid dependencies Defining types and valid dependencies is metamodelingis metamodeling

Difficult, abstract task for CMDB admins Difficult, abstract task for CMDB admins Risks re-inventing metamodel wheel Risks re-inventing metamodel wheel

when standards existwhen standards exist


Naïve CMDB metamodelNaïve CMDB metamodel Far too close to the data modeler’s inside jokeFar too close to the data modeler’s inside joke Doesn’t scale! SQL databases can’t optimize…Doesn’t scale! SQL databases can’t optimize… Seek out your company’s data architecture group!Seek out your company’s data architecture group!

(You’ll probably need the most senior person to (You’ll probably need the most senior person to assist in assessing/setting up your CMDB.)assist in assessing/setting up your CMDB.)

Thing


Problems of unconstrainedProblems of unconstrained any to any any to any

Columns can contain databases, Columns can contain databases, tables can contain servers, and so on.tables can contain servers, and so on.

Logical consequence: “black belt” Logical consequence: “black belt” team emergesteam emerges

Can’t outsource data entryCan’t outsource data entry HP just introduced HP just introduced

constraint architectureconstraint architecture Need standards!Need standards!


Challenge your vendors!Challenge your vendors!

If I define an service CI, and a server If I define an service CI, and a server CI, can I prevent my CMDB admins CI, can I prevent my CMDB admins from putting the service from putting the service inside inside the the server?server?

If I define a hard drive CI, and an If I define a hard drive CI, and an application CI, can I prevent my CMDB application CI, can I prevent my CMDB admins from making the application admins from making the application directly dependentdirectly dependent on the hard drive? on the hard drive?

The technical data management term The technical data management term is “constraints.” Does your tool support is “constraints.” Does your tool support them?them?


Trying to make sense of Trying to make sense of the enterprise IT worldthe enterprise IT world

IT Governance IT Governance Portfolio ManagementPortfolio Management

Project Portfolio ManagementProject Portfolio Management Application Portfolio Application Portfolio

ManagementManagement IT Portfolio ManagementIT Portfolio Management

IT Service Management IT Service Management ChangeChange IncidentIncident ConfigConfig AssetAsset ReleaseRelease CapacityCapacity ContinuityContinuity … … moremore

StandardsStandards ITIL, COBIT, CMM, TOGAF, ITIL, COBIT, CMM, TOGAF,

IEEE/ISO/ANSI, …IEEE/ISO/ANSI, …

Business Service Business Service ManagementManagement

Enterprise Architecture Enterprise Architecture Configuration Configuration

Management Management Application/Technology Application/Technology

Relationship MappingRelationship Mapping Application Application

Profiling/Reverse Profiling/Reverse EngineeringEngineering

IT DiscoveryIT Discovery Data & Metadata Data & Metadata

ManagementManagement


The IT value chainThe IT value chainDefine/Analyze

Design/Build

Deploy/Run

Measure/Optimize


Simplified convergenceSimplified convergence

ERPfor IT

Pla

n


ERPfor IT

The IT tools vendor The IT tools vendor cyclonecyclone Most are silos

Tremendous data redundancy

Limited interoperability and/or standards

Great risk of lock-in!

Pla

n


Plan

The internal IT tools messThe internal IT tools mess

ERPfor IT

CMDB

Metadatarepository

CASE tools(Modeling, SCM)

EnterpriseArchitecture

Project/programportfolio

Projectmanagement

Applicationportfolio

Operationsframework &

metrics

ETL

Elementmanagement


The tools mess 2The tools mess 2

Most shops do not build these Most shops do not build these interfaces, resulting in disparate interfaces, resulting in disparate internal IT data and IT service internal IT data and IT service inefficiencyinefficiency

They are VERY TOUGH tools-level They are VERY TOUGH tools-level programmingprogramming

WE NEED STANDARDS!WE NEED STANDARDS!

CMDB

Metadatarepository

CASE tools(Modeling, SCM)

EnterpriseArchitecture

Project/programportfolio

Projectmanagement

Applicationportfolio

Operationsframework &

metrics

ETL

Elementmanagement


The standards The standards convergenceconvergence


ConclusionsConclusions

Look for opportunities for data re-use in Look for opportunities for data re-use in ITIT

Don’t underestimate the difficulty of Don’t underestimate the difficulty of defining the CI metamodeldefining the CI metamodel

Or building interfaces between internal Or building interfaces between internal IT toolsIT tools

Challenge your vendors for Challenge your vendors for understandable, standard data models understandable, standard data models more detailed than “any to any.”more detailed than “any to any.”

Start paying attention to the standards Start paying attention to the standards warswars


ResourcesResources www.erp4it.comwww.erp4it.com Charlie’s weblog Charlie’s weblog www.itil.co.ukwww.itil.co.uk official ITIL website official ITIL website http://www.ogc.gov.uk/index.asp?id=1000364http://www.ogc.gov.uk/index.asp?id=1000364 ITIL ITIL

publicationspublications www.itsmf.comwww.itsmf.com ITSMF international ITSMF international http://en.itsmportal.net/http://en.itsmportal.net/ ITSM portal ITSM portal http://www.itilpeople.comhttp://www.itilpeople.com independent ITIL portal independent ITIL portal http://www.tso.co.uk/itil/http://www.tso.co.uk/itil/ Back catalog, including data Back catalog, including data

management volumemanagement volume www.dmtf.orgwww.dmtf.org Distributed Management Task Force, Distributed Management Task Force,

standards organization focusing on detailed standards organization focusing on detailed metamodels for operational IT metamodels for operational IT

www.dcml.orgwww.dcml.org Data Center Markup Language, Data Center Markup Language, essentially a new DMTF competitoressentially a new DMTF competitor

www.omg.orgwww.omg.org Standard metamodels from a Standard metamodels from a development perspectivedevelopment perspective

Metadata and IT service management

Technology

Transcript of Metadata and IT service management