Our website use cookies to improve and personalize your experience and to display advertisements(if any). Our website may also include cookies from third parties like Google Adsense, Google Analytics, Youtube. By using the website, you consent to the use of cookies. We have updated our Privacy Policy. Please click on the button to check our Privacy Policy.
Understanding the difference between accuracy and bias in forecasts

Understanding the difference between accuracy and bias in forecasts

Contents
  1. Summary: the seven findings that matter
  2. Worse than predicting zero
  3. When the random walk wins
  4. Against a machine learning benchmark
  5. What returns the most optimistic deliver
  6. What if the bias were rational?
  7. What to do with this in practice
  8. Frequently asked questions
  9. What we do not know
  10. References

Analysts’ long-run earnings growth forecasts are less accurate than a naive model that simply predicts zero growth. That is not a provocation: it is the literal conclusion of an evaluation published in an accounting and finance journal. And there is more: the random walk beats analysts over long horizons and in small firms, and a naive extrapolation of their own one-year forecast is more accurate than their explicit two- and three-year forecasts. At the same time, the comparison with machine learning models concludes that analysts remain superior to the linear models actually in use. This article sets out what has been measured.

Summary: the seven findings that matter

Each row names the study and the year. It is worth separating accuracy from bias: they are two different problems.

Finding Result Study and year
Long-run accuracy Worse than predicting zero growth Harris, J. Business Finance & Accounting (1999)
Main source of that inaccuracy Random error, not bias Harris (1999)
Where the random walk wins Long horizons, small or young firms Bradshaw et al., Review of Accounting Studies (2012)
The most accurate two- and three-year forecast Naive extrapolation of the one-year one Bradshaw et al. (2012)
Direction and evolution of the bias Optimistic, and growing with the horizon Van Binsbergen et al., Rev. Financial Studies (2022)
Comparison with linear statistical models Analysts are superior to them Van Binsbergen et al. (2022)
Returns of the most optimistic stocks Lower than those of the most pessimistic Bordalo et al., The Journal of Finance (2019)

What you will find here

• The comparison with the dumbest possible model, and who wins.

  • The precise conditions under which the random walk beats an analyst.

• What happens when analysts are compared with machine learning.

  • What returns the stocks with the most optimism around them deliver.
  • The argument that the optimistic bias could be rational instead of a mistake.

Worse than predicting zero

Richard Harris analyzed how accurate, biased, and efficient long-term earnings growth predictions made by analysts for American companies really are, publishing his findings in Journal of Business Finance & Accounting. The opening sentence of his results gets straight to the point: forecast accuracy is shown to be extremely low.

And the comparison that makes it memorable: analysts’ long-run earnings growth forecasts are less accurate than those of a naive model in which earnings growth is forecast to be zero.

The paper adds that, consistently with short-term and intermediate forecasts, long-run forecasts are both biased and inefficient, and that there is evidence that analysts do not fully incorporate the information about future earnings contained in the current share price.

The nuance almost nobody quotes

Here is the part that prevents the finding from becoming a caricature: the bias and inefficiency of the forecasts contribute very little to their inaccuracy, which turns out to be mainly a consequence of random error.

Put another way: the problem with analysts over the long run is not that they push the figures in one direction; it is that a company’s earnings five years out are largely unpredictable. The study itself identifies where they do work: the most reliable growth forecasts are low forecasts issued for large firms with a low price-earnings ratio and a high market-to-book ratio.

Study What it analysed What it found What it does not support
Harris (1999) Long-run growth forecasts in the US Less accurate than predicting zero growth It is long-run growth, not annual forecasts
Bradshaw et al. (2012) Annual forecasts against the random walk The random walk wins in specific horizons and firms Does not assess the usefulness of forecasts for investing
Van Binsbergen et al. (2022) Analysts against a machine learning benchmark Growing optimistic bias, but better than linear models The statistical benchmark is not observable in real time without a model
Bordalo et al. (2019) Portfolios sorted by forecast optimism The most optimistic return less than the most pessimistic It is a test of a belief-formation model
Lim (2001) Analyst utility model and individual data The optimistic bias can be optimal and rational It is a model with empirical testing, not an experiment

When the random walk wins

Mark Bradshaw, Michael Drake along with a pair of co-authors revisited the widely held belief in the Review of Accounting Studies that analysts’ earnings per share forecasts are superior to random walk time-series forecasts.

Their outcome maps out precisely the boundaries where this assumption breaks down: basic random walk projections outperform expert predictions across extended timeframes, among more compact or newer businesses, and whenever forecasters anticipate negative or substantial shifts in earnings per share.

And they add a comparison that is almost comic: they also compared a third longer-horizon earnings forecast based on a naive extrapolation of analysts’ one-year-ahead forecasts. Surprisingly, that naive extrapolation provides the most accurate estimate of long-run earnings at two and three years.

The authors’ conclusion serves as a methodological caution: these insights transform previous generalisations regarding the supremacy of analysts’ predictions, indicating they are incomplete, deceptive, or both.

Against a machine learning benchmark

Jules van Binsbergen, Xiao Han alongside Alejandro Lopez-Lira unveiled within The Review of Financial Studies an alternative approach to quantify this issue: a real-time gauge regarding conditional biases embedded in earnings forecasts, which is established as the gap separating analysts’ projections from a statistically optimal, unbiased benchmark constructed via machine learning.

By that metric, the assessment regarding prejudice is unmistakable: conditional analyst expectations tend on average to be overly optimistic, a distortion that grows as the prediction timeline lengthens.

Observation What it shows Practical use
Direction of the bias Upward, on average Discount optimism by default
Evolution with the horizon Increases the further out you look Three-year forecasts are the worst
Relation to future returns Negative cross-sectional predictability More optimism, lower returns afterwards
Where the most biased cluster In the short legs of many anomalies Matches what funds sell short
What their managers do More likely to issue equity They exploit the high valuation

But the same paper closes with a defence of analysts that should not be omitted: commonly used linear earnings models do not work out of sample and are inferior to those provided by analysts. That is: analysts are worse than an optimal benchmark built with machine learning, and better than the statistical alternatives actually in use.

What returns the most optimistic deliver

Pedro Bordalo, Nicola Gennaioli, along with two co-authors, revisited a well-known discovery in The Journal of Finance and accounted for it through a belief-formation model. The initial premise: stocks possessing the most optimistic long-term earnings growth projections by analysts deliver lower returns than those carrying the most pessimistic forecasts.

Their reasoning is rooted in the representativeness heuristic: analysts project fundamentals using observed earnings growth, yet they overreact to headlines by overstating the likelihood of outcomes that have grown more probable.

The authors document the joint dynamics of fundamentals, expectations and returns of those portfolios, and note that a quantitative estimation of the model accounts for the main patterns in the data.

What if the bias were rational?

Terence Lim suggested in Journal of Finance an interpretation that keeps optimism from being dismissed as mere incompetence. His framework outlines a quadratic loss utility function where analysts balance bias against improved access to corporate leadership and precision.

Something rather counter-intuitive emerges here: the best possible predictions featuring the lowest expected error tend to be optimistically skewed, displaying predictable cross-sectional differences tied to both firm and analyst traits.

And the empirical testing with individual analysts’ forecasts is consistent with the model’s predictions, hence the conclusion: a positive and predictable bias may be a rational property of optimal earnings forecasts, and prior studies using classical notions of unbiasedness may have prematurely dismissed analysts’ forecasts as irrational or inaccurate.

That reasoning aligns with a separate finding: there is heightened demand for private corporate details regarding businesses whose profits are difficult to forecast, and if optimism facilitates entry to executive insights, analysts will publish rosier projections specifically for such companies.

What to do with this in practice

Ordered by the strength of the evidence behind each point:

  • Ignore five-year growth forecasts. They are less accurate than assuming zero growth.
  • Discount optimism, and more the further out you look. The upward bias grows alongside the forecast horizon.

• Distrust the consensus on small or young firms. That is where the random walk beats analysts.

• Be wary of the portfolio the consensus loves most. Stocks with the most optimistic forecasts have returned less than the most pessimistic ones.

• Do not throw away the one-year forecasts. They remain better than the linear models in use, and extrapolating them beats the explicit three-year forecast.

Frequently asked questions

Do financial analysts accurately predict earnings?

Over the long run, very little. The evaluation of the accuracy, bias and efficiency of long-run earnings growth forecasts for US firms concludes that accuracy is extremely low and that those forecasts are less accurate than a naive model in which growth is forecast to be zero.

Is it bias or difficulty?

Primarily difficulty. The same research reports that these predictions display bias and inefficiency, though such flaws account for a minimal share of their overall inaccuracy, which stems predominantly from random error. The most dependable projections turn out to be low estimates concerning large corporations featuring a low price-earnings multiple alongside an elevated market-to-book ratio.

When is a simple model better?

In three specific, measured situations. Simple random walk forecasts are more accurate than analysts’ forecasts over longer horizons, in smaller or younger firms, and when analysts forecast negative or large changes in earnings per share; moreover, a naive extrapolation of the one-year forecast gives the most accurate estimate of earnings at two and three years.

Is there an optimistic bias, and how much does it cost?

There is, it grows with the horizon and it has market consequences. Measured against an unbiased benchmark built with machine learning, analysts’ conditional expectations are on average upward biased, a bias that increases with the horizon, is associated with negative cross-sectional return predictability, and clusters in the short legs of many anomalies.

Does that mean forecasts are useless?

No, and there are two reasons to qualify it. The same paper that documents the bias concludes that commonly used linear earnings models do not work out of sample and are inferior to those provided by analysts. And the model published in Journal of Finance argues that a positive, predictable bias may be a rational property of optimal forecasts, so classical studies may have dismissed them prematurely.

What we do not know

  • How much of the bias stems from incentives versus true belief. Rational frameworks alongside overreaction theories account for identical datasets.
  • Whether machine learning improves real decisions. The unbiased benchmark is built after the fact with a model; using it in real time is another problem.

• How this carries over outside the United States. Much of the evidence comes from US markets with dense analyst coverage.

• To what extent is the discount already factored into the consensus. If market participants realize that projections are overly optimistic, that bias ought to be partially reflected in the valuation.

References

1. Harris, R. D. F. The Accuracy, Bias and Efficiency of Analysts’ Long Run Earnings Growth Forecasts. Journal of Business Finance & Accounting, 1999. DOI: 10.1111/1468-5957.00273

2. Bradshaw, M. T., Drake, M. S., Myers, J. N. and Myers, L. A. A re-examination of analysts’ superiority over time-series forecasts of annual earnings. Review of Accounting Studies, 2012. DOI: 10.1007/s11142-012-9185-8

3. Van Binsbergen, J. H., Han, X. and Lopez-Lira, A. Man versus Machine Learning: The Term Structure of Earnings Expectations and Conditional Biases. The Review of Financial Studies, 2022. DOI: 10.1093/rfs/hhac085

4. Bordalo, P., Gennaioli, N., La Porta, R. and Shleifer, A. Diagnostic Expectations and Stock Returns. The Journal of Finance, 2019. DOI: 10.1111/jofi.12833

5. Lim, T. Rationality and Analysts’ Forecast Bias. Journal of Finance, 2001. DOI: 10.1111/0022-1082.00329

This material is purely informational and does not amount to financial guidance or an investment proposal. The referenced research examines distinct markets and timeframes which cannot be equated, and none of these studies permits the dependability of any specific prediction to be foreseen.

By Miles Spencer

You May Also Like