The Economics of Models
Via Baseline Scenario:
One thing that seems clear is that risk models that are designed to function in normal market conditions should not be relied upon to predict outcomes in times of crisis. On this account, VaR doesn’t kill banks; executives who don’t recognize the limits of VaR kill banks. As Bookstaber put it, “one has to look beyond VaR, to culprits such as sheer stupidity or collective management failure: The risk managers missed the growing inventory [of risky assets], or did not have the courage of their conviction to insist on its reduction, or the senior management was not willing to heed their demands. Whichever the reason, VaR was not central to this crisis.”
Given that everyone is agreeing sophisticated risk models are worthless in crises, it seems particularly remarkable that regulators allowed some banks to use their in-house models in determining their own capital requirements – since one of the purposes of capital requirements is precisely to provide a cushion that protects banks (and their creditors, and taxpayers) in the event of a crisis. The obvious solution is that regulators should rely on cruder constraints, such as an absolute limit on leverage that banks cannot arbitrage around (one of the recommendations of Treasury’s recent white paper on capital requirements, which we discussed here), or periodic stress tests that estimate how bank asset portfolios will perform in a real crisis.
But there is a more interesting question to ask as well: why did VaR become so popular? It’s important to remember that competition among models is shaped by the human beings who create and use them, and those human beings have their own incentives.
David Colander made this point about economic models: the sociology of the economics profession gave preference to elegant mathematical models that could describe the world using the smallest number of parameters. “Common sense does not advance one very far within the economics profession,” he says.
A similar point can be made about VaR models. Sure, maybe all the financial professionals who design and work with VaR know about its shortcomings, both mathematical and practical. But nevertheless, using VaR brought concrete benefits to specific actors in the banking world. If common sense would lead a risk manager to crack down on a trader taking large, risky bets, then the trader is better off if the risk manager uses VaR instead.
Read the full post here