Quant View -- Investing by the Numbers -- Archives: January '06 Work in Progress

Click on Topic to Go
 


January 2006
Fundamental Change
A New Look at P3's Underlying Stock Selection Formula

"If you run from a wolf, you may run into a bear."
-- Lithuanian Proverb

 

S DIFFICULT AS THEY ARE TO ENDURE bear markets do two very valuable things: First, they leave behind true buying opportunities as few, if any, stocks remain overpriced in their wake. Secondly, and perhaps even more importantly, bear markets teach investors hard lessons they should have already known.

Among them, are basics that are often forgotten in the giddiness of the preceding bull market. For example: Archive Index

  • Valuation really does matter.
  • Markets are, and will continue to be, cyclical.
  • High risk doesn't always result in high return.
  • Diversification is not a bad thing -- especially in the long-run.

Many new investors of the 1990s learned these lessons the hard way. After watching their portfolios soar for a decade, their gains dissipated in the ensuing bear market.

To a certain extent, quantitative Portfolio 3 is in the same boat. The idea was to create a model that would be comprised of stocks with the fundamental features most closely linked to performance. Using data from the S&P 500 from the decade of the '90s, we ran a multiple regression analysis (for more on how this works, see The Quantitative Approach) for one-year return versus seven fundamental factors (see The Starting Point). The resulting formula is P3's stock selection process.
OUR QUANT MODELS
Portfolio 3
  • Top 30 Stocks Based on Stepwise Regression Across All Stocks of the S&P 500
  • No Attempt is Made to Sector-Weight this Portfolio
  • Rebalanced Every 60 Days
  • Stocks Remain in the Portfolio Until Falling Below the Top 100
  • The Highest Rated Stocks Not Already in the Portfolio are Added When Existing Constituents are Removed
Portfolio 4
  • Top Stocks of Each Sector Based on Stepwise Regression of Each Individual Sector of the S&P 500
  • Number of Stocks Selected in Each Sector Determined by Current Sector-Weightings of the S&P 500
  • Rebalanced Every June and December
  • Stocks Remain in the Portfolio for 6 Months Unless Deleted for Special Circumstance e.g. Acquisition
  • Stocks Removed for Mergers and Acquisitions are Replaced by the Next Highest Rated Stocks in Their Specific Sector
  • Benchmark: S&P 500
Portfolio 5
  • Dynamic asset allocation model based on 9 different Growth/Value/Blend and Large/Mid/Small Cap styles as defined by Morningstar's "Stylebox"
  • Index SPDRs and I-Shares used to represent each component of the Stylebox
  • Stylebox sectors and weightings optimized using Ibbotson's Building Block methodology
  • Reallocated mid-first month of each calendar quarter
  • Benchmark: S&P 500
Portfolio 6
  • Dynamic asset allocation model based on 5 different stock and bond asset classes
  • Index SPDRs and I-Shares used to represent asset class
  • Classes are rebalanced using a mean-variance optimizing model
  • Reallocated mid-first month of each calendar quarter
  • Benchmarks: (1) Static asset allocation model: 25% Domestic Bonds, 48% Domestic Large Cap Stocks, 21% Domestic Small Cap Stocks, 6% Foreign Stocks, rebalanced quarterly
    (2) Buy-and-Hold model with same asset mix as (1), but no rebalancing.

As a quantitative model, there's no subjective input. The formula alone determines the holdings. Needless to say, the 2000-2002 bear market was difficult for P3 as the 1990s' growth-oriented model consistently relied upon over-priced favorites from the previous decade. No wonder it lost 78% -- that's not a typo -- between October 1, 2000 and September 30, 2002.

History will probably view the 1990s as an anomaly for investment return. The fundamental factors that produced market leaders during that time are equally anomalous. Too bad for P3.

 

Another Look
Judging from its bumpy ride over the past five years, P3's fate seems quite closely tied to that of large cap growth stocks. That's not a surprise given that was the category that dominating the market in the 1990s.

But it doesn't have to be that way. Knowing what we now know about the unique 1990s' market conditions and their effects on P3's regression formula, what if we re-ran the process using data from the last five years? Instead of encompassing an ever-increasing equity run-up, the period from July 1, 2000 through June 30, 2005 was almost evenly divided between bull and bear markets. No particular large cap style dominated the period so if fundamental factors are important in determining investment return, a new regression analysis should reveal which can best handle both up and down cycles.
Chart 1
P3 vs. S&P 500
July 1, 2000 - June 30, 2005
Graph -- P3 and the S&P 500, July 1, 2000 - June 30, 2005
Data Source: S&P ComStock, Quantview
P3 lost considerable ground to the S&P 500 when the bear market first began in late 2000 and early 2001. Although it actually beat the index in the later years, it was still unable to catch up. It clearly did better during the bull market that started in late 2002 than in the earlier bear market.

Before looking at the results, a few points need elaboration. First, the critical underlying assumption is that fundamental factors do influence return. A technician or a pure stock picker might not agree, but most investors do. That's why they spend their time poring over P/Es, Price-to-Book ratios, cash flows, and earnings statements. Rather than proving this relation, the regression study provides a way to test this assumption.

Which brings up the second point: Contrary to how it may at first appear, this is not data mining. One of the worst abuses of statistical analysis is the process of building a hypothesis based on patterns observed in historical data. This essentially turns the process on its head since statistical analysis is a means of testing hypotheses, not creating them.

In re-running P3's regression analysis with data from a different time period, we didn't look for new factors, but instead used the same as in the original study. We expected the resultant weightings to be different but only because both bull and bear conditions were represented. Ideally, this is what we would have liked to have had in the original study.

The third and final point concerns the means of testing the results. If you look back over the past five years to generate a regression formula for return and then simply apply it over the same five years, you'll obviously get wonderful results. How could you not? The approach is circular. The way to truly test the findings is out of sample, in a different time period.

That's what's been going on with P3. Its regression formula was based on data from the 1990s, but it was launched out of sample on July 1, 2000. What we've found is that the fundamental characteristics that allow stocks to outperform in a bull market fare quite poorly in a bear market. As you'll notice from Chart 1, P3 fell dramatically in 2000 at the start of the bear market. Although it's managed to beat the S&P 500 since 2002, it's never been able to dig itself out of the bear market hole.

In revisiting P3's regression model, we need to test the results outside the July 1, 2000 - June 30, 2005 period. There's only a few months to compare, but even so, you can begin to see some interesting patterns.

 

New Numbers
The first step was to create a new regression. Essentially what that amounts to is comparing different sets of data -- in this case annual return and the eight fundamental factors -- and finding the formula that comes closest to explaining their relationship. There's a lot of math and statistical theory behind this, but that's the general idea. (For a more detailed explanation of regression techniques, click here.)

While it's possible that each of the eight fundamental factors have a significant impact on investment return, they don't have to. In fact, they didn't, not in P3's initial regression nor in the new one. In both cases, the regression analysis started with all eight variables and then through a "stepwise" process, removed the ones that weren't statistically significant. The original as well as the revised results are summarized on Chart 2.

The only similarity between the two regressions is that both found Long-Term Debt to Capital to lack statistical significance. They differed on the significance of the remaining factors, and gave them different signs (positive or negative) when included in the final regression. What a difference a bear market makes.
Chart 2
FACTOR COEFFICIENTS
Original and Revised
FUNDAMENTAL FACTOR ORIGINAL REVISED
Return on Invested Capital -1.5531 0.2599
Long-Term Debt/Capital N/S N/S
Price/Book 0.0271 -0.0024
Price/Cash Flow 0.0261 -0.0053
Forward P/E 0.0032 N/S
Long-Term Earnings Growth Rate N/S 0.2781
P/E to LT Growth Rate (PEG Ratio) N/S -0.0096
Last Earnings Surprise 0.1452 N/S
Intercept -0.3386 0.1340
Adjusted R2 0.6524 0.3797
Data Source: Baseline

The weightings of the various factors illustrate the original regression's growth bias while the revised version puts more emphasis on traditional valuation. You can see this from the fact that the new regression uses negative coefficients for Price/Book, Price/Cash Flow, and the PEG ratio. With a negative coefficient, higher values for these factors result in lower stock ratings. In other words, the more "overvalued" a stock becomes, the lower the revised regression rates it.

This isn't the case with the original regression. In fact, the exact opposite holds true: Its positive coefficients for Price/Book, Price/Cash Flow, and Forward P/E reward stocks that trade at high valuations. This is the momentum approach that as so popular in the 1990s when stocks that were rising in value were the most likely to keep appreciating. While it worked well when almost all stocks were rising, Chart 1 clearly shows it didn't fare nearly as well when they sold off.
Chart 3
SECTOR WEIGHTS
June, August, and October 2005
   June 2005
Graph -- Sector Weights, P3, Alt-P3, and S&P 500, June 2005
   August 2005
Graph -- Sector Weights, P3, Alt-P3, and S&P 500, August 2005
   October 2005
Graph -- Sector Weights, P3, Alt-P3, and S&P 500, October 2005

The original regression shows a higher correlation between the fundamental factors and annual return. Correlation is measure of the strength of the relation given in by the regression equation. It ranges from +1 to -1. Series with a +1 correlation move in perfect tandem while those with -1 move in exact opposite ways. Those with 0 correlations aren't related at all. Since most stocks were moving in the same direction -- up -- in the 1990s, it stands to reason that the original regression would have a stronger correlation with return.

By squaring the correlation value, you arrive at the coefficient of determination, commonly referred to as R2. In this case, it represents the proportion of the total variation in the annual return explained by the variation in the fundamental factors. Because the original regression's correlation is higher, so is its R2. From Chart 2 you'll notice that it accounts for over 65% of the variation in return while the new regression only explains about 38%. Again this is understandable given how market conditions in the past five years have been much more changeable than they were in the decade of the 1990s.

The important question then is how do the two regressions compare when actually put into practice?

 

Head to Head
By December 2005, only five months have passed since the end of the new regression's sample period (June 30, 2005), so the test period is relatively short. Nevertheless, with P3 being reoptimized every two months, that still allows for three different optimizations to be compared. The results certainly aren't definitive, but they do point up the differences between the two.

P3 was reoptimized based on closing prices from June 15th, August 15th, and October 14th. Although the first date was still within the new regression's ("Alt-P3" for convenience) sample period, we used it to create a portfolio based on those closing prices, but effective July 1. We then compared portfolio composition and period returns for both versions of P3 from July 1 through November 30.

Chart 3 shows a comparison of the models' sector weightings in each of the reoptimizations. In each instance, Alt-P3 has less of a bias toward traditional growth sectors, particularly Technology and Healthcare. Even so, it's no more broadly-based than the actual P3 as both have representation in 8 of the 10 S&P sectors in two of the periods and are in 9 in the third. Neither regression has Telecom exposure in any of the three periods.
Chart 4
P3 AND ALT-P3 PERIODIC RETURNS
July 1, 2005 - November 30, 2005
Graph -- P3 and Alt-P3 Periodic Returns, July 1, 2005 - November 30, 2005
Data Source: Baseline, S&P ComStock, Quantview
Alt-P3 trailed the actual P3 in each of the three measurement periods as well as the over all five months. Even so, with the exception of the September - October period when stocks declined, it was ahead of the benchmark S&P 500.

With each successive reoptimization, Alt-P3 strays further from the index sector weightings. By the October period, its deviation from the S&P 500's weightings is greater than that of P3. This was somewhat unexpected since Alt-P3 has a broader focus than the more growth-oriented P3.

The periodic returns for the five months was more predictable. As shown on Chart 4, P3 bested both Alt-P3 and the benchmark S&P 500 for all three optimizations as well as the overall period. That's pretty understandable given that large cap growth (as measured by the S&P Barra Growth and Value Indexes) outperformed large cap value in each of the periods except September - October when both were unchanged. In this instance, a growth bias was helpful.

Nevertheless, Alt-P3's results are still encouraging. It was ahead of the index for two of the three optimization periods as well as the full five months. Tempering this promising start is the fact that the one period in which it didn't beat the S&P 500 was September - October when all stocks were down. This might suggest that like P3, it, too, will fall behind in a down market. The hope was that in virtue of being more broadly based, this problem would diminish.

Of course five months is an extremely short period to gauge anything about an equity model. That's why we only consider changes to our quantitative models on a three-year basis. Historically that's been long enough to cover both bull and bear periods so should provide a balanced overview.

The second three-year period will be up on June 30, 2006, P3's sixth anniversary. By then we'll have 12 months of data on Alt-P3. That's still a relatively short time, yet it may be sufficient to suggest substituting its regression for P3's original. That's a decision for next summer.

In the meantime, we'll continue to monitor the results from both. Just on the face of it, however, it's hard to believe that P3 couldn't benefit from a more broadly-based regression than one stemming from the anomalous market of the 1990s. Wasn't that one of the lessons of the equity bubble?


 

E-mail your comments.

Search this site! Just enter you key word or words:

 

PicoSearch

Get current quotes or follow your own custom portfolio, courtesy of E-Line Financials:
 

Search:TickerName
 

 
Homepage Return to Top