Their discussion ranges from the history of the field's intellectual foundations to the most recent developments and applications.Reinforcement learning, one of the most active research areas in artificial intelligence, is a computational approach to learning whereby an agent tries to maximize the total amount of reward it receives when interacting with a complex, uncertain environment. In Reinforcement Learning, Richard Sutton and Andrew Barto provide a clear and simple account of the key ideas and algorithms of reinforcement learning. Their discussion ranges from the history of the field's intellectual foundations to the most recent developments and applications. The only necessary mathematical background is familiarity with elementary concepts of probability.The book is divided into three parts. Part I defines the reinforcement learning problem in terms of Markov decision processes. Part II provides basic solution methods: dynamic programming, Monte Carlo methods, and temporal-difference learning. Part III presents a unified view of the solution methods and incorporates artificial neural networks, eligibility traces, and planning; the two final chapters present case studies and consider the future of reinforcement learning.

    Douglas Hubbard helps us create a path to know the answer to almost any question in business, in science, or in life . . . Hubbard helps us by showing us that when we seek metrics to solve problems, we are really trying to know something better than we know it now. How to Measure Anything provides just the tools most of us need to measure anything better, to gain that insight, to make progress, and to succeed." -Peter Tippett, PhD, M.D. Chief Technology Officer at CyberTrust and inventor of the first antivirus software "Doug Hubbard has provided an easy-to-read, demystifying explanation of how managers can inform themselves to make less risky, more profitable business decisions. We encourage our clients to try his powerful, practical techniques." -Peter Schay EVP and COO of The Advisory Council "As a reader you soon realize that actually everything can be measured while learning how to measure only what matters. This book cuts through conventional cliches and business rhetoric and offers practical steps to using measurements as a tool for better decision making. Hubbard bridges the gaps to make college statistics relevant and valuable for business decisions." -Ray Gilbert EVP Lucent "This book is remarkable in its range of measurement applications and its clarity of style. A must-read for every professional who has ever exclaimed, 'Sure, that concept is important, but can we measure it?'" -Dr. Jack Stenner Cofounder and CEO of MetraMetrics, Inc.

    . . worldwideEverybody's talking about the economy, but how can we, the people, understand what Wall Street or Washington knows--or say they know? Read "Economix."With clear, witty writing and quirky, accessible art, this important and timely graphic novel transforms "the dismal science" of economics into a fun, fact-filled story about human nature and our attempts to make the most of what we've got . . . and sometimes what our neighbors have got. "Economix "explains it all, from the beginning of Western economic thought, to markets free and otherwise, to economic failures, successes, limitations, and future possibilities. It's the essential, accessible guide to understanding the economy and economic practices. A must-read for every citizen and every voter.PRAISE FOR "ECONOMIX""It's simply phenomenal. You could read ten books on the subject and not glean as much information."-- David Bach founder of FinishRich Media; author of nine "New York Times" bestsellers, including "Debt Free for Life" and "The Automatic Millionaire" "Goodwin has done the seemingly impossible--he has made economics comprehensible "and" funny."-- Joel Bakan, author of "The Corporation" "The Pathological Pursuit of Profit and Power" "An amazing lesson in true-world economics Delightfully presented, powerful, insightful, and important information What a fun way to fathom a deep and often dark subject "-- John Perkins, author of "Hoodwinked" and the "New York Times" bestseller "Confessions of an Economic Hit Man" "Smart, insightful, clear, and as close to the truth as economics can get. The bonus: Who would have guessed that economics could be fun, and--here's the joy--really accessible? Goodwin roots us in history and fills us with common sense understanding. As he puts it early on, economics seems horribly complicated mostly because we're looking at it all at once. Broken down into its component pieces, it's relatively easy to understand. And a good understanding of economics is critical to maneuvering in the world today. If I were compiling a list of the 100 most important books you can read in a lifetime, this would be on it."--Stephen Petranek, editor-in-chief, Weider History magazines, former editor-in-chief of "Discover" magazine "Through a potent mix of comics and punchy, concise, accessible prose, Goodwin takes us on a provocative, exhaustively researched, and exceedingly engaging trip through our history and present day, creating an alternately hilarious and scary picture of where we are today as an economy-- and what it all means. More than that, Goodwin makes the arcane, understandable. If your mind either spins or slumbers at the thought of economics, read Goodwin's "Economix" and all will become clear. --Nomi Prins, author of "It Takes a Pillage: An Epic Tale of Power, Deceit, and Untold Trillions" ""Economix" is a lively, cheerfully opinionated romp through the historical and intellectual foundations of our current economy and our current economic problems. Goodwin has a knack for distilling complex ideas and events in ways that invite the reader to follow the big picture without losing track of what actually happened. Any reader wondering how our economy got to where it is today will find this a refreshing overview."--Timothy W. Guinnane, Philip Golden Bartlett Professor of Economic History, Yale University

    Sandel takes up one of the biggest ethical questions of our time: Isn't there something wrong with a world in which everything is for sale? If so, how can we prevent market values from reaching into spheres of life where they don't belong? What are the moral limits of markets?In recent decades, market values have crowded out nonmarket norms in almost every aspect of life. Without quite realizing it, Sandel argues, we have drifted from having a market economy to being a market society.In Justice, an international bestseller, Sandel showed himself to be a master at illuminating, with clarity and verve, the hard moral questions we confront in our everyday lives. Now, in What Money Can't Buy, he provokes a debate that's been missing in our market-driven age: What is the proper role of markets in a democratic society, and how can we protect the moral and civic goods that markets do not honor and money cannot buy?

    Sachs-one of the world's most respected economists and the author of The New York Times bestseller The End of Poverty- offers an urgent assessment of the environmental degradation, rapid population growth, and extreme poverty that threaten global peace and prosperity. Through crystalline examination of hard facts, Sachs predicts the cascade of crises that awaits this crowded planet-and presents a program of sustainable development and international cooperation that will correct this dangerous course. Few luminaries anywhere on the planet are as schooled in this daunting subject as Sachs, and this is the vital product of his experience and wisdom.

    You'll also learn how to make your programs interactive and how to test your code safely before adding it to a project. In the second half of the book, you'll put your new knowledge into practice with three substantial projects: a Space Invaders-inspired arcade game, data visualizations with Python's super-handy libraries, and a simple web app you can deploy online.As you work through Python Crash Course, you'll learn how to: Use powerful Python libraries and tools, including matplotlib, NumPy, and PygalMake 2D games that respond to keypresses and mouse clicks, and that grow more difficult as the game progressesWork with data to generate interactive visualizationsCreate and customize simple web apps and deploy them safely onlineDeal with mistakes and errors so you can solve your own programming problemsIf you've been thinking seriously about digging into programming, Python Crash Course will get you up to speed and have you writing real programs fast. Why wait any longer? Start your engines and code!

    Freedom, Sen argues, is both the end and most efficient means of sustaining economic life and the key to securing the general welfare of the world's entire population. Releasing the idea of individual freedom from association with any particular historical, intellectual, political, or religious tradition, Sen clearly demonstrates its current applicability and possibilities. In the new global economy, where, despite unprecedented increases in overall opulence, the contemporary world denies elementary freedoms to vast numbers—perhaps even the majority of people—he concludes, it is still possible to practically and optimistically regain a sense of social accountability. Development as Freedom is essential reading.

    But much of their work is based on assumptions that are untested generalizations at best, harmful misperceptions at worst.Abhijit Banerjee and Esther Duflo have pioneered the use of randomized control trials in development economics. Work based on these principles, supervised by the Poverty Action Lab, is being carried out in dozens of countries. Drawing on this and their 15 years of research from Chile to India, Kenya to Indonesia, they have identified wholly new aspects of the behavior of poor people, their needs, and the way that aid or financial investment can affect their lives. Their work defies certain presumptions: that microfinance is a cure-all, that schooling equals learning, that poverty at the level of 99 cents a day is just a more extreme version of the experience any of us have when our income falls uncomfortably low.This important book illuminates how the poor live, and offers all of us an opportunity to think of a world beyond poverty.Learn more at www.pooreconomics.com

    This long-awaited revision contains changes throughout the text. There are new implementations of most of the major programming systems in the book, including the interpreters and compilers, and the authors have incorporated many small changes that reflect their experience teaching the course at MIT since the first edition was published. A new theme has been introduced that emphasizes the central role played by different approaches to dealing with time in computational models: objects with state, concurrent programming, functional programming and lazy evaluation, and nondeterministic programming. There are new example sections on higher-order procedures in graphics and on applications of stream processing in numerical programming, and many new exercises. In addition, all the programs have been reworked to run in any Scheme implementation that adheres to the IEEE standard.

    The 11th edition of this text continues to build on four major marketing themes: building and managing profitable customer relationships, building and managing strong brands to create brand equity, harnessing new marketing technologies in the digital age, and marketing in a socially responsible way around the globe.

    Now, in an entertaining and accessible primer, he explains how the global economy actually works—in real-world terms. Writing with irreverent wit, a deep knowledge of history, and a disregard for conventional economic pieties, Chang offers insights that will never be found in the textbooks.Unlike many economists, who present only one view of their discipline, Chang introduces a wide range of economic theories, from classical to Keynesian, revealing how each has its strengths and weaknesses, and why  there is no one way to explain economic behavior. Instead, by ignoring the received wisdom and exposing the myriad forces that shape our financial world, Chang gives us the tools we need to understand our increasingly global and interconnected world often driven by economics. From the future of the Euro, inequality in China, or the condition of the American manufacturing industry here in the United States—Economics: The User’s Guide is a concise and expertly crafted guide to economic fundamentals that offers a clear and accurate picture of the global economy and how and why it affects our daily lives.

    But all too often, these numbers are wrong. This book is a lively guide to spotting bad statistics and learning to think critically about these influential numbers. Damned Lies and Statistics is essential reading for everyone who reads or listens to the news, for students, and for anyone who relies on statistical information to understand social problems.Joel Best bases his discussion on a wide assortment of intriguing contemporary issues that have garnered much recent media attention, including abortion, cyberporn, homelessness, the Million Man March, teen suicide, the U.S. census, and much more. Using examples from the New York Times, the Washington Post, and other major newspapers and television programs, he unravels many fascinating examples of the use, misuse, and abuse of statistical information.In this book Best shows us exactly how and why bad statistics emerge, spread, and come to shape policy debates. He recommends specific ways to detect bad statistics, and shows how to think more critically about "stat wars," or disputes over social statistics among various experts. Understanding this book does not require sophisticated mathematical knowledge; Best discusses the most basic and most easily understood forms of statistics, such as percentages, averages, and rates.This accessible book provides an alternative to either naively accepting the statistics we hear or cynically assuming that all numbers are meaningless. It shows how anyone can become a more intelligent, critical, and empowered consumer of the statistics that inundate both the social sciences and our media-saturated lives.

    Unfortunately, people tend to be terrible forecasters. As Wharton professor Philip Tetlock showed in a landmark 2005 study, even experts’ predictions are only slightly better than chance. However, an important and underreported conclusion of that study was that some experts do have real foresight, and Tetlock has spent the past decade trying to figure out why. What makes some people so good? And can this talent be taught?   In Superforecasting, Tetlock and coauthor Dan Gardner offer a masterwork on prediction, drawing on decades of research and the results of a massive, government-funded forecasting tournament. The Good Judgment Project involves tens of thousands of ordinary people—including a Brooklyn filmmaker, a retired pipe installer, and a former ballroom dancer—who set out to forecast global events. Some of the volunteers have turned out to be astonishingly good. They’ve beaten other benchmarks, competitors, and prediction markets. They’ve even beaten the collective judgment of intelligence analysts with access to classified information. They are "superforecasters."   In this groundbreaking and accessible book, Tetlock and Gardner show us how we can learn from this elite group. Weaving together stories of forecasting successes (the raid on Osama bin Laden’s compound) and failures (the Bay of Pigs) and interviews with a range of high-level decision makers, from David Petraeus to Robert Rubin, they show that good forecasting doesn’t require powerful computers or arcane methods. It involves gathering evidence from a variety of sources, thinking probabilistically, working in teams, keeping score, and being willing to admit error and change course. Superforecasting offers the first demonstrably effective way to improve our ability to predict the future—whether in business, finance, politics, international affairs, or daily life—and is destined to become a modern classic.

    It givessyntax and output for accomplishing many analyses through the mostrecent releases of SAS, SPSS, and SYSTAT, some not available insoftware manuals. The book maintains its practical approach, stillfocusing on the benefits and limitations of applications of a techniqueto a data set -- when, why, and how to do it. Overall, it providesadvanced students with a timely and comprehensive introduction totoday's most commonly encountered statistical and multivariatetechniques, while assuming only a limited knowledge of higher-levelmathematics.

    Polya, How to Solve It will show anyone in any field how to think straight. In lucid and appealing prose, Polya reveals how the mathematical method of demonstrating a proof or finding an unknown can be of help in attacking any problem that can be reasoned out--from building a bridge to winning a game of anagrams. Generations of readers have relished Polya's deft--indeed, brilliant--instructions on stripping away irrelevancies and going straight to the heart of the problem.