Intuition vs. formulas: simple algorithms are likely better

In “Thinking, Fast and Slow” (TFS, $2.99 for Kindle edition) Chapter 21 “Intuition vs. Formulas” author Daniel Kahneman cautions us against relying solely on intuition.  The chapter notes several examples of where simple formulas based on scoring of a handful of factors outperforms predictions by experts and their intuition:

1. Prediction of future price of Bordeaux wines.  A simple formula based on temperature, rain at harvest, and rain the prior winter was much more accurate than the intuition of wine experts.

2. Predicted grades of incoming freshmen at the end of the year.  A simple formula based on high school grades and one aptitude test was more accurate than the intuition of trained counselors who conducted 45 minute interviews and had access to more information.

3. Predicted marital stability.  Dawes’ research found stability is well predicted by a simple formula, frequency of lovemaking – frequency of quarreling.

4. Medical school admission and subsequent success, susceptibility to sudden infant death syndrome, and other examples are noted where simple formulas produce more accurate predictions that expert intuition.

Low-validity environments

In sum the research suggests “final decisions should be left to formulas, especially in low-validity environments.”  What exactly is a low-validity environment?  A low-validity environment is an environment where the outcome is not predicted correctly often.  In these environments human intuition is given too much weight over simple objective criteria with a known correlation to the outcome.

So what about intuition?

The TFS book and research referenced therein is not suggesting intuition should be totally disregarded.  There appears to be a couple scenarios where intuition matters:

1. When there is rare and decisive information not in the formula.  This is the “broken-leg” case.  When trying to predict whether or not someone goes to the movie a simple formula likely won’t have an input for the rare case of a broken leg.  However, a human using their intuition with that piece of information will make a better prediction.

2. When there is a “moderate validity” or “high validity” environment.  That is, when predictions based on intuition are known to correlate well with the outcome.

Scenario #1 offers a scenario where intuition should be used for the final decision: when there is new and decisive information.  Scenario #2 suggests that intuition should not be used as the final decision.  Rather, intuition should be used as one factor in the simple formula with all factors receiving equal weight.

Practical application: stock selection

Simple formulas based on scores of a handful of factors known to be correlated with the outcome can provide better predictive power.  Where can we apply this approach?  The Student Investment Fund at Sacramento State already partially implements the approach.  To screen stocks scores are assigned to each of seven factors and summed together[1].  This assigns equal weight to each factor.  From there students perform ratio analysis, Graham-Buffet analysis, and discounted cash flow analysis.  We currently do not look at technical indicators but should.  There should be a score for that as well.  The results of all analyses can be combined into an overall score.

Allow me to summarize one way to implement the simple formula approach to stock selection, the Sacramento State Student Investment Fund way:

  1. Quant score: this is simply the final score from the JO screen result.
  2. Fundamental score: after completing the ratio, Graham-Buffet, and DCF analyses assign a score on the same scale as the Quant score.
  3. Technical score: after looking at a number of technical indicators assign a score on the same scale as the Quant score.
  4. TOTAL = Quant + Fundamental + Technical
  5. Ignore your intuition and choose the alternative with the highest TOTAL [2]

Conclusion

I hope you found this post an interesting read.  I also hope you consider whether or not you overweight your own “expert” intuition in low validity environments.  🙂

 

Endnotes

[1] If you agree with the TFS argument, 7 is probably too many.

[2]  I don’t think we are at the “high validity” point where our intuition can accurately predict the outcome of superior risk adjusted future returns.  This is why I suggest ignoring intuition.  At best, you could include “Intuition score” in the TOTAL.

Rep. Jim Moran: ‘Members of Congress are underpaid’ | OnPolitics

Really? This reminds me of a point to ponder. In the private sector much focus is given to cutting the costs (pay) of workers. But when is cutting the cost (pay) of executives ever part of the discussion?

http://onpolitics.usatoday.com/2014/04/04/jim-moran-congress-underpaid/

How To Beat The Rigged, ‘Flash Boys’ Stock Market – Forbes

The message is similar to buying and selling cars. With cars, don’t deal with dealers. With stocks, don’t trade with high frequency algorithmic traders. In both cases reducing your transactions and holding long term is the individual’s best move.

http://www.forbes.com/sites/johnwasik/2014/04/02/how-to-beat-the-rigged-flash-boys-stock-market/

Bloomberg: U.S. Firms Hold Record $1.64 Trillion in Cash With Apple in Lead

Please read the entire article. There is actually some good news at the very end: $800B+ in capital spending and $300B+ in dividend payouts last year. That will help the money circulate a little bit. I wonder how much cash is generated annually to enable such large stockpiles and payouts…

From Bloomberg, Mar 31, 2014, 8:36:53 AM

U.S. companies outside of the finance industry are holding more cash on their balance sheets than ever, with $1.64 trillion at the end of 2013.

To read the entire article, go to http://www.bloomberg.com/news/2014-03-31/apple-leads-u-s-companies-holding-record-1-64-trillion.html
Sent from the Bloomberg iPhone application. Download the free application at http://itunes.apple.com/us/app/bloomberg/id281941097?mt=8

Bloomberg: Two Husbands Accused of Trading on Wives Overheard Talk

Already married to someone wealthy? Why not eavesdrop on their phone calls and trade on insider information? The rich must get richer I suppose. Or pay fines. I wonder if the couples are still married. I wonder what the husbands do for a living. Maybe the husbands did not work. That would allow time and energy for them to listen to their wives’ phone calls since they had nothing else to do. Maybe their wives did not give them a large enough allowance. Maybe they are just greedy. Or, all of the above. 🙂

From Bloomberg, Mar 31, 2014, 12:14:43 PM

Two California husbands who allegedly heard their executive wives discussing nonpublic information on the phone were sued for insider trading by the U.S. Securities and Exchange Commission.

To read the entire article, go to http://www.bloomberg.com/news/2014-03-31/two-husbands-accused-of-trading-on-wives-overheard-talk.html
Sent from the Bloomberg iPhone application. Download the free application at http://itunes.apple.com/us/app/bloomberg/id281941097?mt=8

2014 GAME IV Conference notes available

Guess where you can find a presentation (including YouTube video links) of my notes from the 2014 GAME IV conference?  That’s right, my website!  If you choose to view the YouTube videos please make sure you “like” them (if you do).  Also, you may want to subscribe to my YouTube channel to catch any new posts.

Investors sour on Candy Crush IPO’s first day

What model and assumptions were used to establish the $22.50/share price? What do you think is the value of KING? What model would you use?

http://www.usatoday.com/story/money/markets/2014/03/26/candy-crush-ipo-king/6901439/

Investors sour on Candy Crush IPO’s first day

IPO shares of King Digital Entertainment, maker of the massively popular Candy Crush mobile app, fell 11% in their first day of trading Wednesday.

The initial public offering, which debuted on the New York Stock Exchange under the symbol KING, declined $2.52, or 11%, to $19.98. The shares original price was set late Tuesday at $22.50 a share, which was at the midpoint of the expected range.

King is the latest disappointment in a much-hyped and widely watched tech IPO. Facebook’s IPO in May 2012 also opened weak and the stock rapidly declined in its first few months of trading. King’s IPO reception a big hit to confidence to tech investors, who were hoping this deal would be the one that signaled that the IPO market was open again to young tech companies

The weakness in the stock demonstrates while investors are eager to get their hands on IPOs this year, they’re still being selective and choosy. IPOs have popped 22%, on average, on their first days of trading, Renaissance says. To see King display a decline this early on shows that investors may be concerned about the company’s future growth, despite its success recently.

King Digital is the maker of the popular game for mobile phones called Candy Crush. The company is highly profitable, earning $567.6 million during the year ended Dec. 31, 2013. But investors are worried that Candy Crush could lose its attraction with investors soon, causing the company problems in maintaining growth. Many online and mobile gaming operators hit on popular games that captivate consumers’ attention for a few months, only to fade away and be replaced by another hit title.