facebook twitter instagram linkedin google youtube vimeo tumblr yelp rss email podcast phone blog search brokercheck brokercheck Play Pause
Toss Your Expectations Thumbnail

Toss Your Expectations

It’s impossible to prudently build an investment plan without estimating the return to stocks (and bonds), making such estimates a central component of the process. This estimate will determine your need to take risk—how high an allocation to equities you will need to reach your goal.

If your estimate is too high, it’s likely you won’t have sufficient assets to reach your retirement goal. If it’s too low, it could lead you to allocate more to equities, which means taking more risk than necessary. Alternatively, it could lead you to lower your goal, save more, or plan on working longer.

Despite its importance, there is much disagreement about how to estimate stock returns. As is always the case, we rely on academic evidence.

Recent Research

Research on the expected equity premium, including Aswath Damodaran’s 2017 paper, “Equity Risk Premiums (ERP): Determinants, Estimation and Implications,” has found that the best predictor of future equity returns is current valuations—whether using measures such as the earnings yield (E/P) derived from the Shiller CAPE 10 (or, for that matter, the CAPE 7, 8 or 9) or the current E/P—not historical returns.

A review of the evidence led Damodaran to conclude: “Equity risk premiums can change quickly and by large amounts even in mature equity markets. Consequently, I have forsaken my practice of staying with a fixed equity risk premium for mature markets, and I now vary it year to year, and even on an intra-year basis, if conditions warrant.”

Damodaran’s approach is similar to the one we use. At the beginning of each year, we estimate returns for all asset classes and then use those estimates in our assumptions when running Monte Carlo simulations. For equities, while our methodology has changed somewhat over time, our forecast always has been based on current valuations, not historical returns.

Today, we take the average of the estimate using the Shiller CAPE 10 E/P and the Gordon Constant Growth Dividend Discount Model. For factors other than market beta (such as size and value), we have chosen to give the historical premium a 25% haircut—based on research showing some degradation of premiums, even risk-based ones, occurs post-publication. That, in turn, helps us determine the most appropriate asset allocation for clients.

We have been following this process since 2003. I thought it would be an interesting exercise to evaluate the accuracy of our forecasts. Before digging into the results, it’s important to understand that investors should treat all estimates of returns to risky assets only as the mean of what is potentially a wide dispersion of returns.

In other words, it’s unlikely you will earn the mean, estimated return. That is why we use Monte Carlo simulations to help us determine the most appropriate asset allocations—expected returns are not deterministic, but probabilistic. For example, let’s consider the results from Cliff Asness’ study on the Shiller CAPE 10’s ability to forecast future returns.

Shiller CAPE 10: Good Indicator

In a November 2012 paper, “An Old Friend: The Stock Market’s Shiller P/E,” Asness, of AQR, found that the Shiller CAPE 10 does provide valuable information. Specifically, he found 10-year-forward average real returns drop nearly monotonically as starting Shiller P/Es increase.

He also found that, as the starting Shiller CAPE 10 ratio increased, worst cases became worse and best cases became weaker. Additionally, he found that while the metric provided valuable insights, there were still very wide dispersions of returns. For instance:

  • When the CAPE 10 was below 9.6, 10-year-forward real returns averaged 10.3%. In relative terms, that is more than 50% above the historical average of 6.8% (9.8% nominal return less 3.0% inflation). The best 10-year-forward real return was 17.5%. The worst 10-year-forward real return was still a pretty good 4.8%, just 2.0 percentage points below the average and 29% below it in relative terms. The range between the best and worst outcomes was a 12.7 percentage point difference in real returns.
  • When the CAPE 10 was between 15.7 and 17.3 (about its long-term average of 16.5), the 10-year-forward real return averaged 5.6%. The best and worst 10-year-forward real returns were 15.1% and 2.3%, respectively. The range between the best and worst outcomes was a 12.8 percentage point difference in real returns.
  • When the CAPE 10 was between 21.1 and 25.1, the 10-year-forward real return averaged just 0.9%. The best 10-year-forward real return was still 8.3%, above the historical average of 6.8%. However, the worst 10-year-forward real return was now -4.4%. The range between the best and worst outcomes was a difference of 12.7 percentage points in real terms.
  • When the CAPE 10 was above 25.1, the real return over the following 10 years averaged just 0.5%—virtually the same as the long-term real return on the risk-free benchmark, one-month Treasury bills. The best 10-year-forward real return was 6.3%, just 0.5 percentage points below the historical average. But the worst 10-year-forward real return was now -6.1%. The range between the best and worst outcomes was a difference of 12.4 percentage points in real terms.

What can we learn from the preceding data? First, starting valuations clearly matter—a lot. Higher starting values mean future expected returns are lower, and vice versa. However, a wide dispersion of potential outcomes, for which we must prepare when developing an investment plan, still exists.

It’s also why an investment plan should include what we call Plan B, a contingency plan that lists the actions to take if financial assets were to drop below a predetermined level. Actions might include remaining in or returning to the workforce, reducing current spending, reducing the financial goal, selling a home and/or moving to a location with a lower cost of living.

Our Forecasts & Results

Let’s turn now to our prior forecasts of long-term, unconditional (meaning regardless of the horizon) expected returns. Before jumping into the data, however, I’ll describe the framework we use for what should be considered a reasonably close estimate.

An acceptable range for the expected return is one standard deviation divided by the square root of the number of years in the sample (the standard error of the mean). For example, if we look at a nine-year period, the expected return should be within one-third of one standard deviation of the actual return.

The following table presents returns for each of the periods for which we have at least 10 years of results available. Each period ends in 2017. Note that over shorter periods, returns are so volatile that measuring the quality of a forecast over such periods is not a meaningful exercise.

For example, while the compound return to U.S. stocks has been about 10%, there have been very few years (six of the last 92) in which the return actually fell between 8% and 12%. There have been just 20 years over the last 92 in which the return fell between 0% and 12%. With that caveat in mind, the appendix following this article shows our forecasts and the results for the years 2009 through 2013 (which gives us at least five years of data).

The actual returns data is based on the MSCI All Country World Index. As you review the results, keep in mind that we began the period in 2003, when the U.S. Shiller CAPE 10 was about 23. It reached a nadir of about 14 in February 2009. It is now about 32, almost 40% above the level it was at the start of the period.

That increase gave an “unforecastable” tail wind to stock returns, helping to explain why our forecasts generally were below the actual return. Changes in valuation are what John Bogle called the speculative return, by which I believe he meant unforecastable. The record shows there are no good forecasters of changes in valuations, which is why we assume no change.



As you can see, in all six cases we have for review, both the actual annual and annualized returns were inside the acceptable range. Given that the volatility of equity returns is about 20% a year, this looks like an excellent result.

Importantly, especially because the periods all include the 2008 bear market, the worst in the post-World War II era, all the results were well within the expectations set in Monte Carlo simulations. Of course, this finding is not a guarantee that future estimates will have the same degree of accuracy.

The bottom line is that the evidence demonstrates that current valuations provide useful information in estimating future returns, as well as help us to understand how wide the potential dispersion around those estimates can be.


The evidence makes it clear that estimating future equity returns isn’t a simple task. If it were easy, we would be able to do what no one has yet been able to do well persistently—forecast stock market returns with a high precision.

Because we must develop financial plans without the benefit of a clear crystal ball, we should use the best tools available. However, when using these tools, the evidence demonstrates that we should have a healthy skepticism as to the accuracy of forecasts. We must be careful not to treat outcomes from models in a “deterministic” fashion. Instead, we should treat outcomes only as the mean of a very wide potential dispersion of possible outcomes.

The best example I can think of is that I’m not aware of anyone who in 1990 predicted that, through 2017, Japanese large-cap stocks would gain just 0.5% per year, producing a cumulative return of less than 15% over the 28-year period. When limiting the time frame to the period ending just a year earlier, in 2016, the annualized return would have been -0.3%, producing a cumulative loss of more than 7%.

Remember, another important takeaway is that your comprehensive investment plan should include options you will exercise if the equity risk premium turns out to be less than expected. You need to list actions you will take to prevent your plan from failing to meet its primary objective—having your assets outlive you.




In four of the five cases we examine here, both the annual and annualized realized returns were inside the acceptable range (in terms of the annualized returns, the one miss was by just 0.1 percentage point).

Larry Swedroe is the director of research for The BAM Alliance.   

This commentary originally appeared June 27 on ETF.com

This material and any opinions contained are derived from sources believed to be reliable, but its accuracy and the opinions based thereon are not guaranteed. The content of this publication is for general information only and is not intended to serve as specific financial, accounting or tax advice.  By clicking on any of the links above, you acknowledge that they are solely for your convenience, and do not necessarily imply any affiliations, sponsorships, endorsements or representations whatsoever by us regarding third-party Web sites. We are not responsible for the content, availability or privacy policies of these sites, and shall not be responsible or liable for any information, opinions, advice, products or services available on or through them. The opinions expressed by the author are their own and may not accurately reflect those of Beacon Hill Private Wealth LLC. This article is for general information only and is not intended to serve as specific financial, accounting or tax advice.

Past performance is no guarantee of future results. There is no guarantee investment strategies will be successful. Investing involves risks including possible loss of principal. Investors should talk to their financial advisor prior to making any investment decision. There is always the risk that an investor may lose money. A long-term investment approach cannot guarantee a profit.

© 2018, The BAM Alliance