Choosing modelling options and transfer criteria for...

15
Choosing modelling options and transfer criteria for IFRS 9: from theory to practice RiskMinds 2015 - Amsterdam Vivien BRUNEL – Benoît SUREAU December 10 th , 2015 Disclaimer : this presentation reflects the opinions of the author and not the one of his employer. Neither Société Générale nor the author may be held responsible for the use which may be made of the information contained therein.

Transcript of Choosing modelling options and transfer criteria for...

Page 1: Choosing modelling options and transfer criteria for …vivienbrunel.free.fr/Presentations/RISKMINDS2015.pdf · Choosing modelling options and transfer ... Manage the interplay between

Choosing modelling options and transfer criteria for IFRS 9: from theory to practice

RiskMinds 2015 - Amsterdam

criteria for IFRS 9: from theory to practice

Vivien BRUNEL – Benoît SUREAU

December 10th , 2015

Disclaimer: this presentation reflects the opinions of the author and not the one of his employer. Neither SociétéGénérale nor the author may be held responsible for the use which may be made of the information contained therein.

Page 2: Choosing modelling options and transfer criteria for …vivienbrunel.free.fr/Presentations/RISKMINDS2015.pdf · Choosing modelling options and transfer ... Manage the interplay between

Modelling principles and challengesModelling principles and challenges

Page 3: Choosing modelling options and transfer criteria for …vivienbrunel.free.fr/Presentations/RISKMINDS2015.pdf · Choosing modelling options and transfer ... Manage the interplay between

MAIN IMPLEMENTATION CHALLENGES – IFRS 9 Phase 2

� A complex principle-based requirement

� New concepts and principles in the accounting framework

� A larger scope, that includes all exposures evaluated at the amortized cost

� An accurate evaluation of risks based on modelling

� Global issues across the bank: processes, IT, reporting

� Substantial evolution of accounting and management systems across the Group

� Data collection since granting on a line by line basis

� Reporting / Disclosure : new requirements (transfers between buckets, evolution of provisions) and additional

disclosures.

| P.3December 10th, 2015 Choosing modelling options and transfer criteria for IFRS 9: from theory to practice

disclosures.

� Production issues (coordination Corep / Finrep)

� SG is specific because of its diversity (entity sizes, geography, business lines)

� Modelling options (norm compliance, existing processes, market practices)

� Data requirements

� Modelling and impact studies

� Calculator and calibration tool design

� Normative modelling documentation

Page 4: Choosing modelling options and transfer criteria for …vivienbrunel.free.fr/Presentations/RISKMINDS2015.pdf · Choosing modelling options and transfer ... Manage the interplay between

MAIN PRINCIPLES – IFRS 9 phase 2

� Risk management based

� Build upon the existing frameworks (monitoring, regulatory,…)

� Accounting should not change the risk management and monitoring practices, but should improve them

� Manage the interplay between accounting, regulatory and risk management processes

� Simplicity

� Avoid black box effects

� Leverage business knowledge

� Avoid full automatic framework, preference for auditability and understanding of the provision variations

� Make sure that the framework will be displayed and will evolve conveniently

| P.4December 10th, 2015 Choosing modelling options and transfer criteria for IFRS 9: from theory to practice

� Materiality, proportionality

� A reference method displayed on the most significant entities in terms of exposure or credit risk

� A simplified approach for less significant entity which data collection and qualification is not the same level

� Comparability / benchmarking with peers

� Working groups are now structured across boarders

� Audit firms are starting to settle their standards

Page 5: Choosing modelling options and transfer criteria for …vivienbrunel.free.fr/Presentations/RISKMINDS2015.pdf · Choosing modelling options and transfer ... Manage the interplay between

MODELLING CHALLENGES FOR NON RETAIL EXPOSURES

� A market standard has emerged

� Use of internal ratings for the transfer criteria

� Methodologies based on the Basel 2 framework

� PDs calibrated from observed migrations instead of observed defaults only

� Forward-looking estimations based on the stress testing framework

� Main modelling challenges / still to be done

� Calibration of the transfer criteria

� Identification of the risk drivers (segmentation and forward looking)

� Lifetime PDs backtesting

| P.5December 10th, 2015 Choosing modelling options and transfer criteria for IFRS 9: from theory to practice

PD PIT 1Y

TD (t-1,t)

TD Moyen

Temps

Tau

x d

e D

éfa

ut

t-1 t 1Y

TD historique

2Y 3Y 4Y 5Y

Projections

pertinentes

Time

Defa

ult r

ate

ForeseeablefutureHistorical default rate

Page 6: Choosing modelling options and transfer criteria for …vivienbrunel.free.fr/Presentations/RISKMINDS2015.pdf · Choosing modelling options and transfer ... Manage the interplay between

MODELLING CHALLENGES FOR RETAIL EXPOSURES

� The market standard has not emerged yet

� Risk indicator for the transfer criteria (score, risk class, 1Y or lifetime PD, current or past payments in

arrear)

� Tolerence on the initial recognition date (granting vs. first behavioral score)

� Lifetime PD measurement

� Lifetime PD measurement

� Data sources

� Observed default

� Observed risk class migrations

| P.6December 10th, 2015 Choosing modelling options and transfer criteria for IFRS 9: from theory to practice

� Roll rates

� STEP 1: estimate TTC parameters

� Either risk class migration matrices or TTC PD curves

� At a one year horizon, mind the gap with Basel 2 PDs!

� STEP 2: adjust for current conditions and forward-looking

� Cycle effects should be included to take macro economics factors into account

� Additional adjustments for trends or other effects

Page 7: Choosing modelling options and transfer criteria for …vivienbrunel.free.fr/Presentations/RISKMINDS2015.pdf · Choosing modelling options and transfer ... Manage the interplay between

POSSIBLE APPROACHES FOR RETAIL EXPOSURES (1/2)

Observed migrations Observed defaults

Cohort

� Matrix approach

• Risk class (rating matrix)

• Days-past-due buckets(roll-rate matrix)

� Vintage model

� Risk class

Duration� Matrix approach taking into account time spent

within risk segment (risk class, days-past-due

bucket, etc.)

� Cox model: estimation of the default rate based

on time spent within risk segment before default

A

Contracts

|December 10th, 2015

Data used in the duration approach (all the historical data available is used)

Data used in the cohort approach

Exit of portfolio

Default

Risk class of the

contract

Transition to a new

risk class

A

B

C

D

E

F

Historical data available

R1

R2

Ri

R1

Choosing modelling options and transfer criteria for IFRS 9: from theory to practice

P.7

R2

R3

R3

R1

R1 R3

R2

R2

Page 8: Choosing modelling options and transfer criteria for …vivienbrunel.free.fr/Presentations/RISKMINDS2015.pdf · Choosing modelling options and transfer ... Manage the interplay between

POSSIBLE APPROACHES FOR RETAIL EXPOSURES (2/2)

Observed migrations Observed defaults

Pros Cons Pros Cons

Cohort

� Adapted for low default

portfolios (especially the

duration approach: use of all

historical data available

� Same mathematical

framework as the

mainstream corporate

� Does not cope with path-

dependence

� Complex to include maturation

effects

� Backtests not relevant

(significant gaps between

historical and calibrated PDs on

horizons higher than 1Y)

� Simple to

estimate/apply

� Use test

� No need to estimate

transition parameters

between

� Vintage approaches

allow calculations at

portfolio level only

� A lot of parameters to estimate

(non homogeneous matrix

� Use of all historical data

available

� Multiple defaults: same

contract or not?

|December 10th, 2015

mainstream corporate

framework

� Easy to estimate lifetime PDsDuration

(non homogeneous matrix

model)

available contract or not?

� Among the panorama of Retail PD approaches, several are considered not relevant:

• Duration models seem unduly complex for retail exposures (very high default portfolios)

• The structure of observed migrations is highly complex due to path-dependence

� Default rate with a cohort vision seems to be the most appropriate approach to build lifetime PD curves for Retail

portfolios

Choosing modelling options and transfer criteria for IFRS 9: from theory to practice

P.8

Page 9: Choosing modelling options and transfer criteria for …vivienbrunel.free.fr/Presentations/RISKMINDS2015.pdf · Choosing modelling options and transfer ... Manage the interplay between

Assessing the performance of IFRS 9 models

http://ssrn.com/abstract=2606080

Page 10: Choosing modelling options and transfer criteria for …vivienbrunel.free.fr/Presentations/RISKMINDS2015.pdf · Choosing modelling options and transfer ... Manage the interplay between

TRANSFER CRITERIA STAGE 1 – STAGE 2

� The emerging consensus is that transfer criteria are based on Basel risk measures

� Retail: scores or measures derived from the score (risk class, PD)

� Non retail: internal rating

� Transfer criteria are still an open field of research for the whole industry

� Relative vs. absolute

� How do we set the thresholds?

� What is the impact on the provision itself?

� An optimal transfer criterion leads at setting some targets in terms of thresholds and discriminatorypower

| P.10December 10th, 2015 Choosing modelling options and transfer criteria for IFRS 9: from theory to practice

power

� Absolute risk criterion is a good proxy whenever the bank originates loans above a given cut-off threshold

� The discriminatory power of the transfer criterion is assessed for a 1 year period of time

� The target hit rate associated with the transfer criterion depends on the average risk of the portfolio andon the accuracy ratio

� It is a driver of the stage 2 portfolio size

� It is a driver of the provision

Page 11: Choosing modelling options and transfer criteria for …vivienbrunel.free.fr/Presentations/RISKMINDS2015.pdf · Choosing modelling options and transfer ... Manage the interplay between

Receiving Operating Characteristic (ROC) curve

� The ROC curve plots the Hit rate as a function of the False Alarm Rate

� Random model: hit rate = false alarm rate

� Perfect model: hit rate = 100%

� Statisticians usually fit the ROC curve with regular functions

� Binormal fit

� Exponential fit (Van Der Burgt’s fit of the CAP curve)

| P.11December 10th, 2015 Choosing modelling options and transfer criteria for IFRS 9: from theory to practice

)(1

2 αα −−= RAR

Page 12: Choosing modelling options and transfer criteria for …vivienbrunel.free.fr/Presentations/RISKMINDS2015.pdf · Choosing modelling options and transfer ... Manage the interplay between

OPTIMAL TRANSFER CRITERION

� The optimal transfer criterion maximizes the area under the 2 stages ROC curve

( ) 1)(*1 =′ − αRR

60%

70%

80%

90%

100%

| P.12December 10th, 2015 Choosing modelling options and transfer criteria for IFRS 9: from theory to practice

0%

10%

20%

30%

40%

50%

60%

0% 20% 40% 60% 80% 100%

Score accuracy ratio

Target Hit Rate (binormal b=1)

AR2 (binormal b=1)

Target Hit Rate (exponential)

AR2 (exponential)

Page 13: Choosing modelling options and transfer criteria for …vivienbrunel.free.fr/Presentations/RISKMINDS2015.pdf · Choosing modelling options and transfer ... Manage the interplay between

STAGE 2 PORTFOLIO SIZE

( )22 1 BpAR −=− α

30%

40%

50%T

arg

et

size

of

the

Sta

ge

2 p

ort

foli

o

p=1%

p=5%

p=10%

| P.13December 10th, 2015 Choosing modelling options and transfer criteria for IFRS 9: from theory to practice

0%

10%

20%

30%

0% 20% 40% 60% 80% 100%

Ta

rge

t si

ze o

f th

e S

tag

e 2

po

rtfo

lio

Score accuracy ratio

p=10%

Page 14: Choosing modelling options and transfer criteria for …vivienbrunel.free.fr/Presentations/RISKMINDS2015.pdf · Choosing modelling options and transfer ... Manage the interplay between

PROXY FORMULA FOR THE PROVISION

[ ]21)1(.. DDLGDpP αα +−=

� The hit rate is the driver of the stage 2 portfolio size and of the total provision as a consequence

� The stage 2 portfolio size depends on both the risk parameters and discriminatory power of the transfer criterion

� The provision proxy formula is helpful as a benchmark formula for advanced methodologies and could be used as a

simplified approach for less advanced banks or entities

� Risk sensitivity is a requirement of the IFRS 9 framework. We see that the provision is sensitive to thequality of the models as well

� It is not certain that the provision decreases when we increase the quality of the classification between

| P.14December 10th, 2015 Choosing modelling options and transfer criteria for IFRS 9: from theory to practice

� It is not certain that the provision decreases when we increase the quality of the classification betweenstage 1 and stage 2 (likely to generate negative misclassification costs)

Page 15: Choosing modelling options and transfer criteria for …vivienbrunel.free.fr/Presentations/RISKMINDS2015.pdf · Choosing modelling options and transfer ... Manage the interplay between

CONCLUSION

� Complexity is a threat for IFRS 9 frameworks, on models and on other aspects as well.

� The goal in designing the framework is to set norms

� The framework must deliver the correct information to the market

� For instance: the description of anticipated defaults should not be biased: stage 2 portfoliosshould catch a significant proportion of defaults and should not generate too high false alarmrates)

� Not sure that we need a consensus on method details on any segment of business or portfolio

� However, trade-offs are necessary for fitting pratice to theory

| P.15December 10th, 2015 Choosing modelling options and transfer criteria for IFRS 9: from theory to practice

� However, trade-offs are necessary for fitting pratice to theory

� Coherent frameworks

� Set targets