Survivorship Bias

I have suggested reading You Are Not So Smart several times on this weblog. This week’s posting struck me as an obvious problem with human thinking so I thought I would share a bit of the analysis and suggest you read the entire article at You Are Not So Smart.

Simply put, survivorship bias is your tendency to focus on survivors instead of whatever you would call a non-survivor depending on the situation. Sometimes that means you tend to focus on the living instead of the dead, or on winners instead of losers, or on successes instead of failures. …

It is easy to do. After any process that leaves behind survivors, the non-survivors are often destroyed or rendered mute or removed from your view. If failures becomes invisible, then naturally you will pay more attention to successes. Not only do you fail to recognize that what is missing might have held important information, you fail to recognize that there is missing information at all.

You must remind yourself that when you start to pick apart winners and losers, successes and failures, the living and dead, that by paying attention to one side of that equation you are always neglecting the other. If you are thinking about opening a restaurant because there are so many successful restaurants in your hometown, you are ignoring the fact the only successful restaurants survive to become examples. Maybe on average 90 percent of restaurants in your city fail in the first year. You can’t see all those failures because when they fail they also disappear from view. As Nassim Taleb writes in his book The Black Swan, “The cemetery of failed restaurants is very silent.” Of course the few that don’t fail in that deadly of an environment are wildly successful because only the very best and the very lucky can survive. All you are left with are super successes, and looking at them day after day you might think it’s a great business to get into when you are actually seeing evidence that you should avoid it.

Advice

Survivorship bias pulls you toward bestselling diet gurus, celebrity CEOs, and superstar athletes. It’s an unavoidable tick, the desire to deconstruct success like a thieving magpie and pull away the shimmering bits. You look to the successful for clues about the hidden, about how to better live your life, about how you too can survive similar forces against which you too struggle. Colleges and conferences prefer speakers who shine as examples of making it through adversity, of struggling against the odds and winning. The problem here is that you rarely take away from these inspirational figures advice on what not to do, on what you should avoid, and that’s because they don’t know. Information like that is lost along with the people who don’t make it out of bad situations or who don’t make it on the cover of business magazines – people who don’t get invited to speak at graduations and commencements and inaugurations. The actors who traveled from Louisiana to Los Angeles only to return to Louisiana after a few years don’t get to sit next to James Lipton and watch clips of their Oscar-winning performances as students eagerly gobble up their crumbs of wisdom. In short, the advice business is a monopoly run by survivors, people who took damage in places anyone could be damaged and survive but who were lucky enough to never take a critical hit. As the psychologist Daniel Kahneman writes in his book Thinking Fast and Slow, “A stupid decision that works out well becomes a brilliant decision in hindsight.” The things a great company like Microsoft or Google or Apple did right are like the planes with bullet holes in the wings. The companies that burned all the way to the ground after taking massive damage fade from memory. Before you emulate the history of a famous company, Kahneman says, you should imagine going back in time when that company was just getting by and ask yourself if the outcome of its decisions were in any way predictable. If not, you are probably seeing patterns in hindsight where there was only chaos in the moment. He sums it up like so, “If you group successes together and look for what makes them similar, the only real answer will be luck.”

If you see your struggle this way, as partly a game of chance, then as Google Engineer Barnaby James writes on his blog, “skill will allow you to place more bets on the table, but it’s not a guarantee of success.” Thus, he warns, “beware advice from the successful.” Entrepreneur Jason Cohen, in writing about survivorship bias, points out that since we can’t go back in time and start 20 identical Starbucks across the planet, we can never know if that business model is the source of the chain’s immense popularity or if something completely random and out of the control of the decision makers led to a Starbucks on just about every street corner in North America. That means you should be skeptical of any book promising you the secrets of winning at the game of life through following any particular example.

It might seem disheartening, the fact that successful people probably owe more to luck than anything else, but only if you see luck as some sort of magic. Take off those superstitious goggles for a moment, and consider this: the latest psychological research indicates that luck is a long mislabeled phenomenon. It isn’t a force, or grace from the gods, or an enchantment from fairy folk, but the measurable output of a group of predictable behaviors. Randomness, chance, and the noisy chaos of reality may be mostly impossible to predict or tame, but luck is something else. According to psychologist Richard Wiseman, luck – bad or good – is just what you call the results of a human beings consciously interacting with chance, and some people are better at interacting with chance than others.

And added thought which evidence shows to be true:  this includes writers and especially what is taught in creative writing programs. Think about it: in a writing school you are not taught to be creative but rather to emulate  examples of success. By extrapolation, the best student at a writing school might be the writer who gets the worst grades. Survivorship bias is very much alive in the study of literature and writing and let’s not even think about television programming.

What are your thoughts on this?

Fill in your details below or click an icon to log in:

WordPress.com Logo

You are commenting using your WordPress.com account. Log Out /  Change )

Twitter picture

You are commenting using your Twitter account. Log Out /  Change )

Facebook photo

You are commenting using your Facebook account. Log Out /  Change )

Connecting to %s