Superforecasting: The Art and Science of Prediction


Philip E. Tetlock - 2015
    Unfortunately, people tend to be terrible forecasters. As Wharton professor Philip Tetlock showed in a landmark 2005 study, even experts’ predictions are only slightly better than chance. However, an important and underreported conclusion of that study was that some experts do have real foresight, and Tetlock has spent the past decade trying to figure out why. What makes some people so good? And can this talent be taught?   In Superforecasting, Tetlock and coauthor Dan Gardner offer a masterwork on prediction, drawing on decades of research and the results of a massive, government-funded forecasting tournament. The Good Judgment Project involves tens of thousands of ordinary people—including a Brooklyn filmmaker, a retired pipe installer, and a former ballroom dancer—who set out to forecast global events. Some of the volunteers have turned out to be astonishingly good. They’ve beaten other benchmarks, competitors, and prediction markets. They’ve even beaten the collective judgment of intelligence analysts with access to classified information. They are "superforecasters."   In this groundbreaking and accessible book, Tetlock and Gardner show us how we can learn from this elite group. Weaving together stories of forecasting successes (the raid on Osama bin Laden’s compound) and failures (the Bay of Pigs) and interviews with a range of high-level decision makers, from David Petraeus to Robert Rubin, they show that good forecasting doesn’t require powerful computers or arcane methods. It involves gathering evidence from a variety of sources, thinking probabilistically, working in teams, keeping score, and being willing to admit error and change course. Superforecasting offers the first demonstrably effective way to improve our ability to predict the future—whether in business, finance, politics, international affairs, or daily life—and is destined to become a modern classic.

Think Like a Freak


Steven D. Levitt - 2014
    Then came SuperFreakonomics, a documentary film, an award-winning podcast, and more.Now, with Think Like a Freak, Steven D. Levitt and Stephen J. Dubner have written their most revolutionary book yet. With their trademark blend of captivating storytelling and unconventional analysis, they take us inside their thought process and teach us all to think a bit more productively, more creatively, more rationally—to think, that is, like a Freak.Levitt and Dubner offer a blueprint for an entirely new way to solve problems, whether your interest lies in minor lifehacks or major global reforms. As always, no topic is off-limits. They range from business to philanthropy to sports to politics, all with the goal of retraining your brain. Along the way, you’ll learn the secrets of a Japanese hot-dog-eating champion, the reason an Australian doctor swallowed a batch of dangerous bacteria, and why Nigerian e-mail scammers make a point of saying they’re from Nigeria.Some of the steps toward thinking like a Freak:First, put away your moral compass—because it’s hard to see a problem clearly if you’ve already decided what to do about it.Learn to say “I don’t know”—for until you can admit what you don’t yet know, it’s virtually impossible to learn what you need to.Think like a child—because you’ll come up with better ideas and ask better questions.Take a master class in incentives—because for better or worse, incentives rule our world.Learn to persuade people who don’t want to be persuaded—because being right is rarely enough to carry the day.Learn to appreciate the upside of quitting—because you can’t solve tomorrow’s problem if you aren’t willing to abandon today’s dud.Levitt and Dubner plainly see the world like no one else. Now you can too. Never before have such iconoclastic thinkers been so revealing—and so much fun to read.

Everybody Lies: Big Data, New Data, and What the Internet Can Tell Us About Who We Really Are


Seth Stephens-Davidowitz - 2017
    This staggering amount of information—unprecedented in history—can tell us a great deal about who we are—the fears, desires, and behaviors that drive us, and the conscious and unconscious decisions we make. From the profound to the mundane, we can gain astonishing knowledge about the human psyche that less than twenty years ago, seemed unfathomable.Everybody Lies offers fascinating, surprising, and sometimes laugh-out-loud insights into everything from economics to ethics to sports to race to sex, gender and more, all drawn from the world of big data. What percentage of white voters didn’t vote for Barack Obama because he’s black? Does where you go to school effect how successful you are in life? Do parents secretly favor boy children over girls? Do violent films affect the crime rate? Can you beat the stock market? How regularly do we lie about our sex lives and who’s more self-conscious about sex, men or women?Investigating these questions and a host of others, Seth Stephens-Davidowitz offers revelations that can help us understand ourselves and our lives better. Drawing on studies and experiments on how we really live and think, he demonstrates in fascinating and often funny ways the extent to which all the world is indeed a lab. With conclusions ranging from strange-but-true to thought-provoking to disturbing, he explores the power of this digital truth serum and its deeper potential—revealing biases deeply embedded within us, information we can use to change our culture, and the questions we’re afraid to ask that might be essential to our health—both emotional and physical. All of us are touched by big data everyday, and its influence is multiplying. Everybody Lies challenges us to think differently about how we see it and the world.

Sway: The Irresistible Pull of Irrational Behavior


Ori Brafman - 2008
    Sway introduces us to the Harvard Business School professor who got his students to pay $204 for a $20 bill, the head of airline safety whose disregard for his years of training led to the transformation of an entire industry, and the football coach who turned conventional strategy on its head to lead his team to victory. We also learn the curse of the NBA draft, discover why interviews are a terrible way to gauge future job performance, and go inside a session with the Supreme Court to see how the world’s most powerful justices avoid the dangers of group dynamics.Every once in a while, a book comes along that not only challenges our views of the world but changes the way we think. In Sway, Ori and Rom Brafman not only uncover rational explanations for a wide variety of irrational behaviors but also point readers toward ways to avoid succumbing to their pull.

The Paradox of Choice: Why More Is Less


Barry Schwartz - 2004
    Whether we're buying a pair of jeans, ordering a cup of coffee, selecting a long-distance carrier, applying to college, choosing a doctor, or setting up a 401K, everyday decisions have become increasingly complex due to the overwhelming abundance of choice with which we are presented. In The Paradox of Choice, Barry Schwartz explains why too much of a good thing has proven detrimental to our psychological and emotional well-being. In accessible, engaging, and anecdotal prose, Schwartz explains how a culture that thrives on the availability of constantly evolving options can also foster profound dissatisfaction and self-blame in individuals, which can lead to a paralysis in decision making and, in some cases, depression. With the latest studies on how we make choices in our personal and professional lives, Schwartz offers practical advice on how to focus on the right choices, and how to derive greater satisfaction from choices that we do make.

Nudge: Improving Decisions About Health, Wealth, and Happiness


Richard H. Thaler - 2008
    Thaler, and Cass R. Sunstein: a revelatory look at how we make decisionsNew York Times bestsellerNamed a Best Book of the Year by The Economist and the Financial Times Every day we make choices—about what to buy or eat, about financial investments or our children’s health and education, even about the causes we champion or the planet itself. Unfortunately, we often choose poorly. Nudge is about how we make these choices and how we can make better ones. Using dozens of eye-opening examples and drawing on decades of behavioral science research, Nobel Prize winner Richard H. Thaler and Harvard Law School professor Cass R. Sunstein show that no choice is ever presented to us in a neutral way, and that we are all susceptible to biases that can lead us to make bad decisions. But by knowing how people think, we can use sensible “choice architecture” to nudge people toward the best decisions for ourselves, our families, and our society, without restricting our freedom of choice.

Predictably Irrational: The Hidden Forces That Shape Our Decisions


Dan Ariely - 2008
    We think we're making smart, rational choices. But are we?In a series of illuminating, often surprising experiments, MIT behavioral economist Dan Ariely refutes the common assumption that we behave in fundamentally rational ways. Blending everyday experience with groundbreaking research, Ariely explains how expectations, emotions, social norms, and other invisible, seemingly illogical forces skew our reasoning abilities.Not only do we make astonishingly simple mistakes every day, but we make the same "types" of mistakes, Ariely discovers. We consistently overpay, underestimate, and procrastinate. We fail to understand the profound effects of our emotions on what we want, and we overvalue what we already own. Yet these misguided behaviors are neither random nor senseless. They're systematic and predictable--making us "predictably" irrational.From drinking coffee to losing weight, from buying a car to choosing a romantic partner, Ariely explains how to break through these systematic patterns of thought to make better decisions. "Predictably Irrational" will change the way we interact with the world--one small decision at a time.

The Tipping Point: How Little Things Can Make a Big Difference


Malcolm Gladwell - 2000
    Just as a single sick person can start an epidemic of the flu, so too can a small but precisely targeted push cause a fashion trend, the popularity of a new product, or a drop in the crime rate. This widely acclaimed bestseller, in which Malcolm Gladwell explores and brilliantly illuminates the tipping point phenomenon, is already changing the way people throughout the world think about selling products and disseminating ideas.Gladwell introduces us to the particular personality types who are natural pollinators of new ideas and trends, the people who create the phenomenon of word of mouth. He analyzes fashion trends, smoking, children's television, direct mail, and the early days of the American Revolution for clues about making ideas infectious, and visits a religious commune, a successful high-tech company, and one of the world's greatest salesmen to show how to start and sustain social epidemics.

Scarcity: Why Having Too Little Means So Much


Sendhil Mullainathan - 2013
    Busy people fail to manage their time efficiently for the same reasons the poor and those maxed out on credit cards fail to manage their money. The dynamics of scarcity reveal why dieters find it hard to resist temptation, why students and busy executives mismanage their time, and why sugarcane farmers are smarter after harvest than before. Once we start thinking in terms of scarcity and the strategies it imposes, the problems of modern life come into sharper focus.Mullainathan and Shafir discuss how scarcity affects our daily lives, recounting anecdotes of their own foibles and making surprising connections that bring this research alive. Their book provides a new way of understanding why the poor stay poor and the busy stay busy, and it reveals not only how scarcity leads us astray but also how individuals and organizations can better manage scarcity for greater satisfaction and success.http://us.macmillan.com/scarcity/Send...

Noise: A Flaw in Human Judgment


Daniel Kahneman - 2021
    Suppose that different food inspectors give different ratings to indistinguishable restaurants — or that when a company is handling customer complaints, the resolution depends on who happens to be handling the particular complaint. Now imagine that the same doctor, the same judge, the same inspector, or the same company official makes different decisions, depending on whether it is morning or afternoon, or Monday rather than Wednesday. These are examples of noise: variability in judgments that should be identical.   In Noise, Daniel Kahneman, Cass R. Sunstein, and Olivier Sibony show how noise contributes significantly to errors in all fields, including medicine, law, economic forecasting, police behavior, food safety, bail, security checks at airports, strategy, and personnel selection. And although noise can be found wherever people make judgments and decisions, individuals and organizations alike are commonly oblivious to the role of chance in their judgments and in their actions.   Drawing on the latest findings in psychology and behavioral economics, and the same kind of diligent, insightful research that made Thinking, Fast and Slow and Nudge groundbreaking New York Times bestsellers, Noise explains how and why humans are so susceptible to noise in judgment — and what we can do about it.

The Signal and the Noise: Why So Many Predictions Fail—But Some Don't


Nate Silver - 2012
    He solidified his standing as the nation's foremost political forecaster with his near perfect prediction of the 2012 election. Silver is the founder and editor in chief of FiveThirtyEight.com. Drawing on his own groundbreaking work, Silver examines the world of prediction, investigating how we can distinguish a true signal from a universe of noisy data. Most predictions fail, often at great cost to society, because most of us have a poor understanding of probability and uncertainty. Both experts and laypeople mistake more confident predictions for more accurate ones. But overconfidence is often the reason for failure. If our appreciation of uncertainty improves, our predictions can get better too. This is the "prediction paradox": The more humility we have about our ability to make predictions, the more successful we can be in planning for the future.In keeping with his own aim to seek truth from data, Silver visits the most successful forecasters in a range of areas, from hurricanes to baseball, from the poker table to the stock market, from Capitol Hill to the NBA. He explains and evaluates how these forecasters think and what bonds they share. What lies behind their success? Are they good-or just lucky? What patterns have they unraveled? And are their forecasts really right? He explores unanticipated commonalities and exposes unexpected juxtapositions. And sometimes, it is not so much how good a prediction is in an absolute sense that matters but how good it is relative to the competition. In other cases, prediction is still a very rudimentary-and dangerous-science.Silver observes that the most accurate forecasters tend to have a superior command of probability, and they tend to be both humble and hardworking. They distinguish the predictable from the unpredictable, and they notice a thousand little details that lead them closer to the truth. Because of their appreciation of probability, they can distinguish the signal from the noise.

Abundance: The Future Is Better Than You Think


Peter H. Diamandis - 2012
    We will soon be able to meet and exceed the basic needs of every man, woman and child on the planet. Abundance for all is within our grasp. This bold, contrarian view, backed up by exhaustive research, introduces our near-term future, where exponentially growing technologies and three other powerful forces are conspiring to better the lives of billions. An antidote to pessimism by tech entrepreneur turned philanthropist, Peter H. Diamandis and award-winning science writer Steven Kotler. Since the dawn of humanity, a privileged few have lived in stark contrast to the hardscrabble majority. Conventional wisdom says this gap cannot be closed. But it is closing—fast. The authors document how four forces—exponential technologies, the DIY innovator, the Technophilanthropist, and the Rising Billion—are conspiring to solve our biggest problems. Abundance establishes hard targets for change and lays out a strategic roadmap for governments, industry and entrepreneurs, giving us plenty of reason for optimism.Examining human need by category—water, food, energy, healthcare, education, freedom—Diamandis and Kotler introduce dozens of innovators making great strides in each area: Larry Page, Steven Hawking, Dean Kamen, Daniel Kahneman, Elon Musk, Bill Joy, Stewart Brand, Jeff Skoll, Ray Kurzweil, Ratan Tata, Craig Venter, among many, many others.

Fooled by Randomness: The Hidden Role of Chance in Life and in the Markets


Nassim Nicholas Taleb - 2001
    The other books in the series are The Black Swan, Antifragile,and The Bed of Procrustes.

Adapt: Why Success Always Starts with Failure


Tim Harford - 2011
    People can use economics and they can use statistics and numbers to get at the truth and there is a real appetite for doing so. This is such a BBC thing to say--there’s almost a public service mission to be fulfilled in educating people about economics. When I wrote The Undercover Economist, it was all about my pure enthusiasm for the subject; the book is full of stuff I wanted to say and that is always the thing with the books: they are always such fun to write. Do you think that people these days are generally more economically literate? People are now aware of economics for various reasons. There are the problems with the economy--there is always more interest in economics when it is all going wrong. Where is the border line in your new book between economics and sociology? I don’t draw a border line, and particularly not with the new book. The Undercover Economist was basically all the cool economics I could think of and The Logic of Life was me investigating a particular part of economics. All of the references in The Logic of Life were academic economics papers that I had related--and hopefully made more fun. This new book, Adapt, is very different. I have started by asking what is wrong with the world, what needs fixing, how does it work--and if economics can tell us something about that (which it can) then I have used it. And if economics is not the tool that you need--if you need to turn to sociology or engineering or biology or psychology--I have, in fact, turned to all of them in this book. If that’s what you need, then that’s where I have gone. So I have written this book in a different way: I started with a problem and tried to figure out how to solve it. What specific subjects do you tackle? To be a bit more specific, the book is about how difficult problems get solved and I look at quick change; the banking crisis; poverty; innovation, as I think there is an innovation slow-down; and the war in Iraq. Also, I look at both problems in business and in everyday life. Those are the big problems that I look at--and my conclusion is that these sorts of problems only ever get solved by trial and error, so when they are being solved, they are being solved through experimentation, which is often a bottom-up process. When they are not being solved it is because we are not willing to experiment, or to use trial and error. Do you think companies will change to be much more experimental, with more decisions placed in the hands of employees? I don’t think that is necessarily a trend, and the reason is that the market itself is highly experimental, so if your company isn’t experimental it may just happen to have a really great, successful idea--and that’s fine; if it doesn’t, it will go bankrupt. But that said, it is very interesting to look at the range of companies who have got very into experimentation--they range from the key-cutting chain Timpson’s to Google; you can’t get more different than those two firms, but actually the language is very similar; the recruitment policies are similar; the way the employees get paid is similar. The “strap line” of the book is that “Success always starts with failure.” You are a successful author… so what was the failure that set you up for success? I was working on a book before The Undercover Economist… it was going to be a sort of Adrian Mole/Bridget Jones’ Diary-styled fictional comedy, in which the hero was this economist and through the hilarious things that happened to him, all these economic principles would be explained--which is a great idea--but the trouble is that I am not actually funny. Another example would be my first job as a management consultant… and I was a terrible management consultant. I crashed out after a few months. Much better that, than to stick with the job for two or three years-- a lot of people say you have got to do that to “show your commitment.” Taking the job was a mistake--why would I need to show my commitment to a mistake? Better to realise you made a mistake, stop and do something else, which I did. That idea that “failure breeds success” is central to most entrepreneurs. Do you think we need more of it in the UK? I think that the real problem is not failure rates in business; the problem is failure rates in politics. We need a much higher failure rate in politics. What actually happens is politicians--and this is true of all political parties--have got some project and they’ll say, “Right, we are going to do this thing,” and it is quite likely that idea is a bad idea--because most ideas fail; the world is complicated and while I don’t have the numbers for this, most ideas are, as it turns out, not good ideas. But they never collect the data, or whatever it is they need to measure, to find out where their idea is failing. So they have this bad idea, roll this bad idea out and the bad idea sticks, costs the country hundreds, millions, or billions of pounds, and then the bad idea is finally reversed by the next party on purely ideological grounds and you never find out whether it really worked or not. So we have this very, very low willingness to collect the data that would be necessary to demonstrate failure, which is the bit we actually need. To give a brief example: Ken Livingstone, as Mayor of London, came along and introduced these long, bendy buses. Boris Johnson came along and said, “If you elect me, I am going to get rid of those big bendy buses and replace them with double-decker buses.” He was elected and he did it, so… which one of them is right? I don’t know. I mean, isn’t that crazy? I know democracy is a wonderful thing and we voted for Ken Livingstone and we voted for Boris Johnson, but it would be nice to actually have the data on passenger injury rates, how quickly people can get on and off these buses, whether disabled people are using these buses… the sort of basic evidence you would want to collect. Based on that, are you a supporter of David Cameron’s “Big Society”, which in a sense favours local experimentation over central government planning? Well, I have some sympathy for the idea of local experimentation, but what worries me is that we have to have some mechanism that is going to tell you what is working and what is not--and there is no proposal for that. Cameron’s Tories seem to have the view that ‘if it is local then it will work.’ In my book, I have all kinds of interesting case studies of situations where localism really would have worked incredibly well, as in, say, the US Army in Iraq. But I have also got examples of where localism did not work well at all--such as a corruption-fighting drive in Indonesia. Is the new book, Adapt, your movement away from economic rationalist to management guru? Are you going to cast your eye over bigger problems? The two changes in Adapt are that I have tried to start with the problem, rather than saying, “I have got a hammer--I’m going to look for a nail.” I started with a nail and said, “Ok, look, I need to get this hammered in.” So I have started with the problem and then looked anywhere for solutions. And the second thing is that I have tried to do is write with more of a narrative. This is not a Malcolm Gladwell book, but I really admire the way that people like Gladwell get quite complex ideas across because they get you interested in the story; that is something that I have tried to do more of here. I am not too worried about it, because I know that I am never going to turn into Malcolm Gladwell--I am always going to be Tim Harford--but it doesn’t hurt to nudge in a certain direction. On Amazon, we recommend new book ideas to people: “If you like Tim Harford you may like…”, but what does Tim Harford also like? I read a lot of books, mostly non-fiction and in two categories: people who I think write a lot better than I do, and people who think about economics more deeply than I do. In the first category I am reading people like Michael Lewis, Kathryn Schulz (I loved her first book, Being Wrong), Malcolm Gladwell and Alain de Botton. In the second category, I read lots of technical economics books, but I enjoy Steven Landsburg, Edward Glaeser (who has a book out now which looks good), Bill Easterly… I don’t necessarily agree with all of these people! When I am not reading non-fiction, I am reading comic books or 1980s fantasy authors like Jack Vance.

Where Good Ideas Come from: The Natural History of Innovation


Steven Johnson - 2010
    But where do they come from? What kind of environment breeds them? What sparks the flash of brilliance? How do we generate the breakthrough technologies that push forward our lives, our society, our culture? Steven Johnson's answers are revelatory as he identifies the seven key patterns behind genuine innovation, and traces them across time and disciplines. From Darwin and Freud to the halls of Google and Apple, Johnson investigates the innovation hubs throughout modern time and pulls out the approaches and commonalities that seem to appear at moments of originality.