Testing Probability Calibrations: Application to credit scoring models

DefaultRisk.com the web's biggest credit risk modeling resource.

Submit Your Paper

Post Your Résumé

For Recruiters

Today's Featured Book

Understanding Credit Derivatives and Related Instruments
by Antulio N. Bomfim, Academic Press, (December 6, 2004), Hardcover, 368 pages

Training Discounted for DefaultRisk.com visitors only:

The Mathematics of Credit Derivatives: The Essential Credit Modelling and Pricing Companion
by Philipp J. Schönbucher,
WBS Training, August 2003, DVD / Interactive CD-ROM

Sponsor:
Shop at Amazon.com and support DefaultRisk.com

Testing Probability Calibrations: Application to credit scoring models

by Andreas Blöchlinger of Credit Suisse, and
Markus Leippold of the Federal Reserve Bank of New York & University of Zurich

May 6, 2006

Abstract: The validation of probability calibration is an inherently difficult task. We develop a testing procedure for credit-scoring models. The models comprise two components to check whether the ex-ante probabilities support the ex-post frequencies. The first component tests the level of the probability calibration under dependencies. In the long term, the number of events should equal the sum of assigned probabilities. The second component validates the shape, measuring the differentiation between high and low probability events. We construct a goodness-of-fit statistic for both level and shape together with a global statistics, which is asymptotically X²-distributed.

JEL Classification: C12, C52, G21.

Keywords: Receiver Operating Characteristic (ROC), Credit scoring, Probability of Default (PD) validation, Basel Committee on Banking Supervision, Bernoulli mixture models.

Books Referenced in this Paper: (what is this?)