How do we know which social and economic policies work, which should be continued, and which should be changed? Jim Manzi argues that throughout history, various methods have been attemptedexcept for controlled experimentation. Experiments provide the feedback loop that allows us, in certain limited ways, to identify error in our beliefs as a first step to correcting them. Over the course of the first half of the twentieth century, scientists invented a methodology for executing controlled experiments to evaluate certain kinds of proposed social interventions. This technique goes by many names in different contexts (randomized control trials, randomized field experiments, clinical trials, etc.). Over the past ten to twenty years this has been increasingly deployed in a wide variety of contexts, but it remains the red-haired step child of modern social science. This is starting to change, and this change should be encouraged and accelerated, even though the staggering complexity of human society creates severe limits to what social science could be realistically expected to achieve. Randomized trials have shown, for example, that work requirements for welfare recipients have succeeded like nothing else in encouraging employment, that charter school vouchers have been successful in increasing educational attainment for underprivileged children, and that community policing has worked to reduce crime, but also that programs like Head Start and Job Corps, which might be politically attractive, fail to attain their intended objectives. Business leaders can also use experiments to test decisions in a controlled, low-risk environment before investing precious resources in large-scale changes the philosophy behind Manzi's own successful software company.
In a powerful and masterfully-argued book, Manzi shows us how the methods of science can be applied to social and economic policy in order to ensure progress and prosperity.
David Brooks, New York Times "[Manzi's] tour through the history of government learning is sobering, suggesting there may be a growing policy gap. The world is changing fast, producing enormous benefits and problems. Our ability to understand these problems is slow. Social policies designed to address them usually fail and almost always produce limited results. Most problems have too many interlocking causes to be explicable through modeling. Still, things don't have to be this bad. The first step to wisdom is admitting how little we know and constructing a trial-and-error process on the basis of our own ignorance. Inject controlled experiments throughout government. Feel your way forward. Fail less badly every day." Wall Street Journal "[O]ffers much to digest... Uncontrolled is at its most provocative...when Mr. Manzi considers the largely unmet potential of controlled experimentation to improve outcomes in social science and government policy... A vigorous book, pulsing with ideas." Arnold Kling, National Review "The ideas in this book are important... This is a provocative book for people who are interested in how social science relates to public policy." Forbes "One of Hayek's "old truths" is that individual freedom is an indispensible means to both human flourishing and material progress and that it is threatened by misguided government bureaucracy. We are fortunate to have it restated extraordinarily well in today's language in... Jim Manzi's Uncontrolled...His observations offer genuinely original insights into longstanding political and social problems." Tyler Cowen, Marginal Revolution "This is a truly stimulating book, about how methods of controlled experimentation will bring a new wave of business and social innovation." The American "This book is one of the most powerful challenges to progressive political impulses I've read in a while." Library Journal "If social scientists entrusted with informing policymakers utilize more experiments, Manzi argues, the policies they create will be more effective over the long term. Simply put, adopting a trial-and-error methodology can help businesses, policymakers, and society as a whole. Backed by numerous pertinent examples, Manzi's arguments are convincing. Recommended for anyone interested in policymaking or in how businesses make decisions." Booklist "This challenging book highlights the astounding advances in science and technology that have started to be used in social-program evaluations." Conor Friedersdorf, The Atlantic "If Uncontrolled were merely a restatement of the need for epistemic humility among wonks and legislators, interest in it might be confined to the right. The book is of broader interest, and may turn out to be important, because its author makes a compelling argument for an ideologically neutral method for improving policy, one that left and right might both plausibly embrace, even as it challenges both sides to rethink some of their reflexes... [Uncontrolled is] the rare political book that goes out of its way to raise the most powerful objections to its arguments and to point out the limits of the reform program that it recommends." The New Republic "In the first two thirds of his book, Manzi describes the historical development of the RFT [randomized field trial] and its philosophical basis, and includes a digression on the philosophy of science. The argument will be familiar to empiricists and philosophers, but it may interest a popular audience, and is well done and readable... A more ambitious argument emerges in the last part of the book. Manzi argues that the RFT - or more precisely, the overall approach to empirical investigation that the RFT exemplifies - provides a way of thinking about public policy. This is the most imaginative and interesting part of Manzi's book." Andrew Sullivan, The Daily Beast / The Dish "It's a fresh, dense and fascinating exploration of what the policy implications of a true 'conservatism of doubt' would mean. I hope it can jumpstart a conservative intellectual renaissance." Kirkus Reviews "A thoroughly argued, powerful study based on principles independent of the author's own conservative-libertarian views." Kenneth Silber, The Daily Beast "Jim Manzi's Uncontrolled is an intriguing investigation of the power, limits, and varieties of empirical knowledge... [A] substantial part of Uncontrolled's value is in its sharp thinking about how various disciplines seek reliable knowledge... Uncontrolled offers useful advice for navigating a hard-to-know world." Arnold Kling, National Review "The ideas in this book are important... This is a provocative book for people who are interested in how social science relates to public policy." The American Conservative "[A]s Jim Manzi persuasively argues in his insightful and well-written new book, Uncontrolled, humanity is terrible at foresight, and trial-and-error is the chief way humans develop reliable knowledge... In Uncontrolled, Manzi provides an incisive and highly readable account of how trial-and-error experimentation in science and free markets lessens human ignorance, uproots bias, and produces progress."