The Power of Experiments
Decision Making in a Data-Driven World
How organizations—including Google, StubHub, Airbnb, and Facebook—learn from experiments in a data-driven world.
Have you logged into Facebook recently? Searched for something on Google? Chosen a movie on Netflix? If so, you've probably been an unwitting participant in a variety of experiments—also known as randomized controlled trials—designed to test the impact of different online experiences. Once an esoteric tool for academic research, the randomized controlled trial has gone mainstream. No tech company worth its salt (or its share price) would dare make major changes to its platform without first running experiments to understand how they would influence user behavior. In this book, Michael Luca and Max Bazerman explain the importance of experiments for decision making in a data-driven world.
Luca and Bazerman describe the central role experiments play in the tech sector, drawing lessons and best practices from the experiences of such companies as StubHub, Alibaba, and Uber. Successful experiments can save companies money—eBay, for example, discovered how to cut $50 million from its yearly advertising budget—or bring to light something previously ignored, as when Airbnb was forced to confront rampant discrimination by its hosts. Moving beyond tech, Luca and Bazerman consider experimenting for the social good—different ways that govenments are using experiments to influence or “nudge” behavior ranging from voter apathy to school absenteeism. Experiments, they argue, are part of any leader's toolkit. With this book, readers can become part of “the experimental revolution.”
Hardcover$29.95 T | £25.00 ISBN: 9780262043878 232 pp. | 6 in x 9 in 4 figures
One of the great things about e-commerce is that it is far easier to run experiments online than offline. As more and more companies move online, they need to learn how to use this powerful tool. This book shows how to take advantage of experiments and how this will revolutionize business, both online and off.
Chief Economist, Google
This accessible and engaging book provides an excellent introduction to a subject that every young person entering the business world today should understand—experimentation. The case studies draw the reader into the challenges that arise in practice, highlighting issues ranging from bias to ethics to unintended consequences.
The Economics of Technology Professor, Stanford Graduate School of Business
Leaders who create an environment for taking calculated risks get better results. This book reminds us that systemic experimentation and calculated risk taking has built great companies and great societies alike.
former Governor of Massachusetts
Luca and Bazerman's The Power of Experiments will open your eyes about how to distill information from data.
Alvin E. Roth
Craig and Susan McCaw Professor of Economics, Stanford University; recipient of the 2012 Nobel Memorial Prize in Economics
So often we don't know what we don't know until we try—and the best form of trying is often an experiment. This book is a brilliant tour through the past, present, and future of experimentation, packed full of insight and examples. Read it and learn—I did.
author of The Undercover Economist and presenter of Cautionary Tales
When testing and experimentation is at the heart of a culture, a team or company can be more responsive and nimble, driving a better product and more growth alongside a better employee experience.
A tremendous achievement, and inspiring to boot. Leaders in government and industry take note: Luca and Bazerman's book will guide you to better decisions in this age of experiments.
Cass R. Sunstein
Robert Walmsley University Professor, Harvard Law School; coauthor of Nudge
Luca and Bazerman tell the fascinating story of the rise of experiments in the tech sector and beyond, and deliver a powerful message: experiments are transforming how businesses and governments make decisions. Going only by gut isn't enough—successful leaders need to move between data and decisions.
author of The Power of Habit and Smarter Faster Better
The authors have created a masterpiece, a manifesto showcasing the deepest revolution in the social sciences in the past twenty-five years—field experimentation. This book is a must-read for anyone interested in understanding policy, behavioral economics, technology, and life itself.
John A. List
Kenneth C. Griffin Distinguished Service Professor, University of Chicago