M EASURING IA S UCCESS ? P OLISH PERSPECTIVE Konrad Knedler, CIA, CGAP O CTOBER 4, 2011.

21
MEASURING IA SUCCESS? POLISH PERSPECTIVE Konrad Knedler, CIA, CGAP OCTOBER 4, 2011

Transcript of M EASURING IA S UCCESS ? P OLISH PERSPECTIVE Konrad Knedler, CIA, CGAP O CTOBER 4, 2011.

Page 1: M EASURING IA S UCCESS ? P OLISH PERSPECTIVE Konrad Knedler, CIA, CGAP O CTOBER 4, 2011.

MEASURING IA SUCCESS?

POLISH PERSPECTIVE

Konrad Knedler, CIA, CGAP

OCTOBER 4, 2011

Page 2: M EASURING IA S UCCESS ? P OLISH PERSPECTIVE Konrad Knedler, CIA, CGAP O CTOBER 4, 2011.

www.auditsolutions.pl2

IA IN POLISH PUBLIC SECTOR BASIC FEATURES

Decentralised IA function Initial legal framework were laid down in 2001 –

mandatory requirements Many, rather small units in ministries, government offices,

quangos and local government Soft coordination (and quality assurance) – Ministry of

Finance IIA standards in force Recognition of IIA qualifactions Functional reporting to top management (ministries, CEOs,

mayors) Audit Committees at ministries’ level Coexistence with Control, Inspection type units

Page 3: M EASURING IA S UCCESS ? P OLISH PERSPECTIVE Konrad Knedler, CIA, CGAP O CTOBER 4, 2011.

www.auditsolutions.pl

1 person37%

2 per-sons9%

2-10 persons9%

part time job32%

va-canc

y6%

external provider5%

others2%

GOV IA SIZE*

*Internal Audit & Management controli2011 – MoF Activity Report

Page 4: M EASURING IA S UCCESS ? P OLISH PERSPECTIVE Konrad Knedler, CIA, CGAP O CTOBER 4, 2011.

www.auditsolutions.pl

1 person22%

2 per-sons2%

2-10 per-sons3%

part time job16%

vacancy24%

external provider32%

others1%

LOCAL IA SIZE*

*Internal Audit & Management controli2011 – MoF Activity Report

Page 5: M EASURING IA S UCCESS ? P OLISH PERSPECTIVE Konrad Knedler, CIA, CGAP O CTOBER 4, 2011.

www.auditsolutions.pl

Statutory obejctives27%

Supporting activities (e.g. HR, procurment

etc.)58%

Managemnt processes

14%

others1%

Audit area focus

Page 6: M EASURING IA S UCCESS ? P OLISH PERSPECTIVE Konrad Knedler, CIA, CGAP O CTOBER 4, 2011.

www.auditsolutions.pl6

IC IN POLISH PUBLIC SECTOR BASIC FEATURES

2001 – start with the concept of financial control 2010 – management control (MC) concept COSO based framework MC is top management responsibility Ministers and other top managers issue

Declarations of Assurance (avaliable on www) Only 5 of 17 ministries issued clean DAS Reservations concerned mostly the lack of risk

management process No liaison (so far) between DAS and budgetary

discharge procedure

Page 7: M EASURING IA S UCCESS ? P OLISH PERSPECTIVE Konrad Knedler, CIA, CGAP O CTOBER 4, 2011.

www.auditsolutions.pl7

WHAT’S THE PROBLEM? WHAT IS IA FOR?

Ex ante IA existence justification: „As easy as that” – legal requirements EU negotiations commitments SAI recommendations to professionalise existing

Control inspection type units Calls for Value for Money

Ex post IA existence justification : Compliance focus – is it enough? What was in lawmakers minds? Where is added value? What are IA costs? What are CLEAR benefits for IA existence?

Page 8: M EASURING IA S UCCESS ? P OLISH PERSPECTIVE Konrad Knedler, CIA, CGAP O CTOBER 4, 2011.

www.auditsolutions.pl8

IA INDICATORS

Compliance oriented Independence Charter Audit process as defined in

regulations Timeliness as defined in

regulations Performance oriented

Time consumed for audit activities (target 70%)

Savings? Audit area focus

Page 9: M EASURING IA S UCCESS ? P OLISH PERSPECTIVE Konrad Knedler, CIA, CGAP O CTOBER 4, 2011.

www.auditsolutions.pl9

PUBLIC SECTOR INTERNAL AUDIT BENCHMARKING – MOF REPORT SEPT.

2011 Start of benchmarking process Source of criteria for selfassessment Limited to government sector Organisations grouped by: empleyees number,

expenditure level, IA size, type (ministries, central officess), number of auditors/number of staff

Measures based on: Performance Measures for Internal Audit Functions: A Research Project

3 performance measures categories based on: Outcomes Quality Efficiency Impact

Page 10: M EASURING IA S UCCESS ? P OLISH PERSPECTIVE Konrad Knedler, CIA, CGAP O CTOBER 4, 2011.

www.auditsolutions.pl10

OUTCOMES BASED MEASURES

Number of assurance assignments Number of consulting assignments Number of recommendations

Page 11: M EASURING IA S UCCESS ? P OLISH PERSPECTIVE Konrad Knedler, CIA, CGAP O CTOBER 4, 2011.

www.auditsolutions.pl11

NUMBER OF ASSURANCE ASSIGNMENTS IN DIFFERENT TYPES OF ORGANISATIONS

Minist

ries

Unive

rsiti

es

Hospi

tals

Agenc

ies

Fund

s

Tax

Cham

bers

Custo

ms

Regio

nal O

ffice

s

Defen

ce u

nits

Centra

l Offi

ces

Pros

ecut

or's

Office

s

Courts

Budge

tary

Uni

ts

Cultu

re in

stitu

tions

Lega

l ent

ities

0

5

10

15

20

25

30

43 3

11

27

43 3

23

2

4

2 23

Series1

Page 12: M EASURING IA S UCCESS ? P OLISH PERSPECTIVE Konrad Knedler, CIA, CGAP O CTOBER 4, 2011.

www.auditsolutions.pl12

QUALITY BASED MEASURES

Auditors turnover Audit certificates Auditing experience Quality assurance techniques

Page 13: M EASURING IA S UCCESS ? P OLISH PERSPECTIVE Konrad Knedler, CIA, CGAP O CTOBER 4, 2011.

www.auditsolutions.pl13

AUDITORS TURNOVER IN DIFFERENT TYPES OF ORGANISATIONS

Minist

ries

Unive

rsiti

es

Hospi

tals

Agenc

ies

Fund

s

Tax

Cham

bers

Custo

ms

Regio

nal O

ffice

s

Defen

ce u

nits

Centra

l Offi

ces

Pros

ecut

or's

Office

s

Courts

Budge

tary

Uni

ts

Cultu

re in

stitu

tions

Lega

l ent

ities

0%

5%

10%

15%

20%

25%

30%

35%

40%

45%

33%

19%

30%

21%

7%

41%

21%23%

33%

20%

25%23%

28%

42%

26%

Series1

Page 14: M EASURING IA S UCCESS ? P OLISH PERSPECTIVE Konrad Knedler, CIA, CGAP O CTOBER 4, 2011.

www.auditsolutions.pl14

EFFICIENCY BASED MEASURES

Audit duration Audit workload Auditing as % of IA time budget Accepted recommendations

Page 15: M EASURING IA S UCCESS ? P OLISH PERSPECTIVE Konrad Knedler, CIA, CGAP O CTOBER 4, 2011.

www.auditsolutions.pl15

AUDIT WORKLOAD-ASSURANCE MANDAYS/NUMBER OF

ASSURANCE PROJECTS

exte

rnal

pro

vide

r

part

time

- bel

ow 1

/2

part

time

- 1/2

- 1

1 au

dito

r

max

2 a

udito

rs

over

2 a

udito

rs

over

all

0

10

20

30

40

50

60

20 20

29

36

57 56

39

Page 16: M EASURING IA S UCCESS ? P OLISH PERSPECTIVE Konrad Knedler, CIA, CGAP O CTOBER 4, 2011.

www.auditsolutions.pl16

IMPACT BASED MEASURES

High risk areas covered by IA Audit cycle

Page 17: M EASURING IA S UCCESS ? P OLISH PERSPECTIVE Konrad Knedler, CIA, CGAP O CTOBER 4, 2011.

www.auditsolutions.pl17

HIGH RISK AREAS COVERED BY IA

Minist

ries

Unive

rsiti

es

Hospi

tals

Agenc

ies

Fund

s

Tax

Cham

bers

Custo

ms

Regio

nal O

ffice

s

Defen

ce u

nits

Centra

l Offi

ces

Pros

ecut

or's

Office

s

Courts

Budge

tary

Uni

ts

Cultu

re in

stitu

tions

Lega

l ent

ities

31% 31%

20%

37%

54% 54%

42%

29%

23%26%

23%

40%

22%

29%

22%

Series1

Page 18: M EASURING IA S UCCESS ? P OLISH PERSPECTIVE Konrad Knedler, CIA, CGAP O CTOBER 4, 2011.

www.auditsolutions.pl18

IA MEASURES - WORRIES

One dimension assessment always fails. A need for multidimensional appraisal

Every measure can be interpreted in different way. „White or black” situations are really rare

Contextual perspective is essential. IA is as matured as organisation for which it serves

Common distrust in benchmarking – specificity as an excuse

Page 19: M EASURING IA S UCCESS ? P OLISH PERSPECTIVE Konrad Knedler, CIA, CGAP O CTOBER 4, 2011.

www.auditsolutions.pl19

FURTHER CONSIDERATIONS

Rationality What is profit maximizing for IA?

Goals consistency Top management and IA – are they working for

the same (common) good? Independence

Help or obstacle? Top management vs IA perspective.

Performance Performance or compliance – what goes first?

Page 20: M EASURING IA S UCCESS ? P OLISH PERSPECTIVE Konrad Knedler, CIA, CGAP O CTOBER 4, 2011.

www.auditsolutions.pl20

POTENTIAL FOR IA RATIONALE

Proactive involvement in management control and risk management processes, performance based budgeting and other projects – „agent of changes”

Auditing external actions – subordinate and supervised bodies.

Focus on savings – VFM audits Meeting Board’s expectations More data analyses job