Econophysics · PNAS 2012
Linking agent-based models and stochastic models of financial markets
National University of Singapore (Graduate School for Integrative Sciences and Engineering · Physics) · Boston University · University of Rijeka · University of Ljubljana · Zagreb School of Economics and Management · ETH Zurich · Artemis Capital Asset Management
Daily stock returns have fat tails and a long memory. We start from what traders are documented to do, copy each other’s technical strategies and judge prices over different horizons, and obtain both features quantitatively, with every parameter taken from market data rather than from a statistical fit.
The claim
Fat tails appear when technical traders act in concert after large price moves; long memory appears because they look back over different horizons.
One mechanism, opinion convergence among technical traders, drives both an agent-based model and the stochastic model derived from it. The agent-based model gives return tails with exponent close to 4 for any number of agents; the stochastic model predicts how the memory of |returns| and of squared returns decays, from a single exponent measured in a survey of fund managers.
0 · Context
Two ways of modelling prices, each missing what the other has
Two empirical facts about stock returns are known to hold across markets and decades. Large price changes are far more common than a Gaussian bell curve allows: the probability that a daily return exceeds falls off as a power law, , with a tail exponent of about 3 to 4 (a fat tail). And the size of price changes has a long memory: a turbulent day is followed by turbulent days, and the correlation of absolute returns decays slowly, as a power of the time lag, over months.
Two traditions model these facts. Stochastic models, starting with Engle’s ARCH and Bollerslev’s GARCH processes, let the variance of tomorrow’s return depend on past returns. They reproduce the statistics accurately, but their parameters are fitted to the data and say nothing about why traders produce them. Agent-based models, from statistical physics and economics, simulate individual traders and give a qualitative picture of where the regularities come from. But they rarely match the data quantitatively, and in many of them the fat tails fade away when the number of agents grows unless the interaction strength is re-tuned.
In our paper we combine the two: an agent-based model built only from documented trading behaviour, a stochastic model derived from it, and parameters that are measured in markets and surveys instead of fitted.
1 · Evidence
Technical traders, not fundamentalists, drive daily price changes
Fundamentalists try to work out what a company is worth. They hold most of the shares, institutional owners held 83 % of the outstanding shares on average in our data, but they trade rarely. Technical traders instead make decisions from price patterns, and they trade their smaller holdings much more often, so they account for most of the daily trading. We therefore model only technical traders and treat fundamentalists as background noise. The data end in 2006, before high-frequency trading became significant.
The model rests on four documented features of their behaviour:
- Daily decisions that look random. Each trader uses a different strategy, so from outside, the decision to buy, sell or hold appears random. Decisions are made once a day, because intraday trading shows little persistence.
- Price change follows the order imbalance. The price moves with the difference between buy and sell orders on a day; the largest move happens when everyone buys or everyone sells.
- Interaction through the price. Technical traders all read the same input, the past price movement, so the price itself couples them. The coupling then grows with the number of traders and needs no network of who talks to whom.
- Opinions converge after large moves. Traders copy the most profitable strategy. After a small price change, differences in their strategies (timing, risk tolerance, portfolio) dominate and they act independently. After a large one, such as a crash, they act in concert regardless of those differences, as in the spreading panic of a sell-off. This is the mechanism that distinguishes our model from others.
2 · Model
Three steps, and a large price move today merges traders into fewer groups tomorrow
The agent-based model has traders, each trading one unit. Every day it runs three steps.
Each trader decides (buy) with probability , (sell) with probability , and (hold) with probability .
Step 2 · Move the priceThe price change (of the log price) is proportional to the demand imbalance . The sensitivity does not change the statistics, so . The trading volume is the number of traders who trade, .
Step 3 · ConvergeThe next day, traders are split at random into opinion groups, and all members of a group take the same action, again buy, sell or hold with probabilities . If everyone traded the same way today (), there is a single opinion tomorrow; after a minimal price move there are groups and everyone acts alone. With market noise from news, is drawn from a normal distribution with mean and variance . We use in most simulations.
The trading probability is measured, not fitted. For the 309 companies that stayed in the S&P 500 throughout 1997–2006, a share changed hands times a year on average (the trading velocity, between 1.3 and 1.9 over the decade). Taking institutional owners, who held 83 % of the shares, as fundamentalists who trade less than once a year (velocity ), the technical traders’ velocity is , and with about 250 trading days a year, . For to this gives to ; with , and technical traders make about 80 % of the volume.
Scroll the panel sideways →
Top left: the daily price change in units of its standard deviation (dashed lines at ). Bottom left: the number of opinion groups , on a log scale from 1 to ; each large move collapses it. Right: the probability that exceeds standard deviations, against the Gaussian curve (dashed). The readout gives the tail exponent by the Hill estimator on the largest 1 % of days.
Switch to independent traders (every trader is their own group) and the tail collapses onto the Gaussian. Raise and the tail thins; lower it and it fattens, as in Table 1 below. In our checks this browser version gives at after a few hundred thousand days.
3 · Fat tails
The model matches the S&P 500 in returns and in the number of trades, for any number of agents
We compared simulated returns with about 800,000 daily returns of the 309 S&P 500 stocks (open to close, so overnight news is excluded, each stock normalized to zero mean and unit variance). Both the distribution of absolute returns and the distribution of the daily number of trades agree with the data over the whole range, centre and tail. The Hill estimator gives tail exponents (S&P 500) and (simulation) for returns, and and for the number of trades. Capturing both of these highly correlated quantities at once makes the mechanism plausible.
The exponent in Eq. 3 sets how strongly a price move merges opinions, and is the value closest to the data:
| 0.5 | 0.6 | 0.7 | 0.8 | 0.9 | 1.0 | 1.1 | 1.2 | 1.4 | 1.5 | 2.0 | |
|---|---|---|---|---|---|---|---|---|---|---|---|
| 2.3 | 2.5 | 2.7 | 3.0 | 3.3 | 3.8 | 4.3 | 4.4 | 5.9 | 7.8 | 9.4 |
The tail exponent also does not depend on the number of agents or on the fundamentalists’ trading velocity: it stays between 3.66 and 3.89 for from to and from 0.2 to 0.8 (Table 2 of the paper). Most agent-based models lose their fat tails as the population grows; here the interaction runs through the price, so its strength grows with the population by construction.
Fat tails need no tuning: they come from traders who act together after a large move.
4 · Stochastic model
Averaging over traders turns the behaviour into an equation for the volatility
Step 3 makes tomorrow’s price change random, with a variance set by today’s move. On average each of the groups has members and moves the price by with probability each, so
Writing with a random number of zero mean and unit variance (we use a normal distribution; a -distribution gives similar results) gives a time-dependent variance of the kind modelled by ARCH processes. Here it has a behavioural reading: a large price change brings traders’ opinions closer, and that produces large price changes afterwards.
Equation 8 remembers only yesterday. Two more pieces of evidence extend it. (v) Technical strategies are applied at different horizons, from one day to more than a year, and the survey of US fund managers in Fig. 2 shows that the share of traders with horizon days decays as with . (vi) Traders trade more after large moves, because their strategies set price thresholds, so the trading probability rises with past price changes: , with the background activity, mostly of fundamentalists.
A trader with horizon reacts to the price change over the last days, , where is the log price. Opinion convergence then depends on a weighted sum over horizons up to a maximum ,
and with both extensions, keeping the dominant term, the volatility becomes
Here normalizes the horizon weights. sets the typical size of returns and the share of trading triggered by technical thresholds relative to background trading. The form resembles fractionally integrated volatility models, with one difference: depends on absolute aggregate returns over past days, weeks and months rather than on past daily returns, and each term has a behavioural meaning.
5 · Long memory
One survey exponent fixes how slowly the market forgets its volatility
Long memory shows up in the autocorrelation function (ACF) of absolute returns, , and of squared returns, , at lag days. From Eq. 11 we derive scaling relations between these exponents and the survey exponent , much like the relations between critical exponents at a phase transition:
Ding, Granger and Engle had observed that absolute returns stay correlated longer than squared returns. Eq. 12 makes this quantitative and ties it to the behaviour of traders through .
To simulate, every parameter comes from data: trading days (about two years, the longest horizon in the survey), in line with the survey, and , from trading-volume fluctuations and the unconditional variance of price changes. So . Simulation and the S&P 500 index (daily closes 1971–2010) give similar ACFs and return distributions (Fig. 4), with , for the simulation and , for the index. Eq. 11 is still a stationary process, unlike many other power-law memory processes.
Scroll the panel sideways →
Left: absolute daily returns over the 50,000 days; calm and turbulent stretches alternate on all time scales. Right: the ACF of (pine) and (plum) on log–log axes, with straight-line fits over lags 11–250 as in the paper, and the slope that Eq. 12 predicts (dashed). A single 50,000-day sample is noisy: at the fitted scatters with a standard deviation of about 0.1 in our checks. Press new sample a few times; the readout keeps the mean over all samples at the current , which follows . At most samples also satisfy .
Long memory in volatility is the trace of traders who watch different horizons, mostly short ones.
6 · Summary
Behaviour in, stylized facts out, parameters measured
Fat tails without tuning
Opinion convergence after large price moves gives power-law tails in returns and in the number of trades, , unchanged from 256 to 16,384 agents.
ARCH with a reason
The same mechanism, averaged, makes tomorrow’s variance grow with today’s move; heterogeneous horizons turn this into long memory, .
One exponent from a survey
and , with from how fund managers weight their horizons; confirmed on the Dow Jones stocks.
The agent-based model singles out the dominant mechanism; the stochastic model allows a detailed analysis. Both share the same mechanism and both take their parameters from market data with a clear behavioural meaning. The study covers data before 2006, ignores high-frequency trading, and treats fundamentalists only as background noise.