Their discussion ranges from the history of the field's intellectual foundations to the most recent developments and applications.Reinforcement learning, one of the most active research areas in artificial intelligence, is a computational approach to learning whereby an agent tries to maximize the total amount of reward it receives when interacting with a complex, uncertain environment. In Reinforcement Learning, Richard Sutton and Andrew Barto provide a clear and simple account of the key ideas and algorithms of reinforcement learning. Their discussion ranges from the history of the field's intellectual foundations to the most recent developments and applications. The only necessary mathematical background is familiarity with elementary concepts of probability.The book is divided into three parts. Part I defines the reinforcement learning problem in terms of Markov decision processes. Part II provides basic solution methods: dynamic programming, Monte Carlo methods, and temporal-difference learning. Part III presents a unified view of the solution methods and incorporates artificial neural networks, eligibility traces, and planning; the two final chapters present case studies and consider the future of reinforcement learning.

    Written more than two thousand years ago, the Tao Teh Ching, or -The Classic of the Way and Its Virtue, - is one of the true classics of the world of spiritual literature. Traditionally attributed to the legendary -Old Master, - Lao Tzu, the Tao Teh Ching teaches that the qualities of the enlightened sage or ideal ruler are identical with those of the perfected individual. Today, Lao Tzu's words are as useful in mastering the arts of leadership in business and politics as they are in developing a sense of balance and harmony in everyday life. To follow the Tao or Way of all things and realize their true nature is to embody humility, spontaneity, and generosity. John C. H. Wu has done a remarkable job of rendering this subtle text into English while retaining the freshness and depth of the original. A jurist and scholar, Dr. Wu was a recognized authority on Taoism and the translator of several Taoist and Zen texts and of Chinese poetry. This book is part of the Shambhala Pocket Library series. The Shambhala Pocket Library is a collection of short, portable teachings from notable figures across religious traditions and classic texts. The covers in this series are rendered by Colorado artist Robert Spellman. The books in this collection distill the wisdom and heart of the work Shambhala Publications has published over 50 years into a compact format that is collectible, reader-friendly, and applicable to everyday life.

    It has found adherents in Silicon Valley billionaires Ray Kurzweil and Peter Diamandis. Google has entered the picture, establishing a bio-tech subsidiary aimed at solving the problem of aging.In To Be a Machine, journalist Mark O'Connell takes a headlong dive into this burgeoning movement. He travels to the laboratories, conferences, and basements of today's foremost transhumanists, where he's presented with the staggering possibilities and moral quandaries of new technologies like mind uploading, artificial superintelligence, cryonics, and device implants.A contributor to Slate, The New Yorker, and The New York Times Magazine, O'Connell serves as a sharp and lively guide to the outer limits of technology in the twenty first century. In investigating what it means to be a machine, he offers a surprising, singular meditation on what it means to be human."

    Darrell Huff runs the gamut of every popularly used type of statistic, probes such things as the sample study, the tabulation method, the interview technique, or the way the results are derived from the figures, and points up the countless number of dodges which are used to fool rather than to inform.

    Only now are we coming to a fuller appreciation of the nature and role of myth in human history. In these five lectures originally prepared for Canadian radio, Claude Lévi-Strauss offers, in brief summations, the insights of a lifetime spent interpreting myths and trying to discover their significance for human understanding. The lectures begin with a discussion of the historical split between mythology and science and the evidence that mythic levels of understanding are being reintegrated in our approach to knowledge. In an extension of this theme, Professor Lévi-Strauss analyzes what we have called “primitive thinking” and discusses some universal features of human mythology. The final two lectures outline the functional relationship between mythology and history and the structural relationship between mythology and music.

    Simondon’s prolific intellectual curiosity led his philosophical and scientific reflections to traverse a variety of areas of research, including philosophy, psychology, the beginnings of cybernetics, and the foundations of religion. For Simondon, the human/machine distinction is perhaps not a simple dichotomy. There is much we can learn from our technical objects, and while it has been said that humans have an alienating rapport with technical objects, Simondon takes up the task of a true thinker who sees the potential for humanity to uncover life-affirming modes of technical objects whereby we can discover potentiality for novel, healthful, and dis-alienating rapports with them. For Simondon, by way of studying its genesis, one must grant to the technical object the same ontological status as that of the aesthetic object or even a living being. His work thus opens up exciting new entry points into studying the human’s rapport with its continually changing technical reality. This first complete English-language translation of Gilbert Simondon’s groundbreaking and influential work finally presents to Anglophone readers one of the pinnacle works of France’s most unique thinkers of technics.

    In Pittsburgh, a child welfare agency uses a statistical model to try to predict which children might be future victims of abuse or neglect.Since the dawn of the digital age, decision-making in finance, employment, politics, health and human services has undergone revolutionary change. Today, automated systems—rather than humans—control which neighborhoods get policed, which families attain needed resources, and who is investigated for fraud. While we all live under this new regime of data, the most invasive and punitive systems are aimed at the poor.In Automating Inequality, Virginia Eubanks systematically investigates the impacts of data mining, policy algorithms, and predictive risk models on poor and working-class people in America. The book is full of heart-wrenching and eye-opening stories, from a woman in Indiana whose benefits are literally cut off as she lays dying to a family in Pennsylvania in daily fear of losing their daughter because they fit a certain statistical profile.The U.S. has always used its most cutting-edge science and technology to contain, investigate, discipline and punish the destitute. Like the county poorhouse and scientific charity before them, digital tracking and automated decision-making hide poverty from the middle-class public and give the nation the ethical distance it needs to make inhumane choices: which families get food and which starve, who has housing and who remains homeless, and which families are broken up by the state. In the process, they weaken democracy and betray our most cherished national values.This deeply researched and passionate book could not be more timely.Naomi Klein: "This book is downright scary."Ethan Zuckerman, MIT: "Should be required reading."Dorothy Roberts, author of Killing the Black Body: "A must-read for everyone concerned about modern tools of inequality in America."Astra Taylor, author of The People's Platform: "This is the single most important book about technology you will read this year."

    Religion for Atheists suggests that rather than mocking religions, agnostics and atheists should instead steal from them – because they're packed with good ideas on how we might live and arrange our societies. Blending deep respect with total impiety, Alain (a non-believer himself) proposes that we should look to religions for insights into, among other concerns, how to:- build a sense of community- make our relationships last- overcome feelings of envy and inadequacy- escape the twenty-four hour media- go travelling- get more out of art, architecture and music- and create new businesses designed to address our emotional needs.For too long non-believers have faced a stark choice between either swallowing lots of peculiar doctrines or doing away with a range of consoling and beautiful rituals and ideas. At last, in Religion for Atheists, Alain has fashioned a far more interesting and truly helpful alternative.

    The Perennial Philosophy includes selections from Meister Eckhart, Rumi, and Lao Tzu, as well as the Bhagavad Gita, Tibetan Book of the Dead, Diamond Sutra, and Upanishads, among many others.

    If you use Python, even as a beginner, this book will teach you practical ways to build your own machine learning solutions. With all the data available today, machine learning applications are limited only by your imagination.You'll learn the steps necessary to create a successful machine-learning application with Python and the scikit-learn library. Authors Andreas Muller and Sarah Guido focus on the practical aspects of using machine learning algorithms, rather than the math behind them. Familiarity with the NumPy and matplotlib libraries will help you get even more from this book.With this book, you'll learn:Fundamental concepts and applications of machine learningAdvantages and shortcomings of widely used machine learning algorithmsHow to represent data processed by machine learning, including which data aspects to focus onAdvanced methods for model evaluation and parameter tuningThe concept of pipelines for chaining models and encapsulating your workflowMethods for working with text data, including text-specific processing techniquesSuggestions for improving your machine learning and data science skills

    A cyber-enigma with an enthusiastic following, it pops up in headlines and fuels endless media debate. You can apparently use it to buy anything from coffee to cars, yet few people seem to truly understand what it is. This raises the question: Why should anyone care about bitcoin?In The Age of Cryptocurrency, Wall Street journalists Paul Vigna and Michael J. Casey deliver the definitive answer to this question. Cybermoney is poised to launch a revolution, one that could reinvent traditional financial and social structures while bringing the world's billions of "unbanked" individuals into a new global economy. Cryptocurrency holds the promise of a financial system without a middleman, one owned by the people who use it and one safeguarded from the devastation of a 2008-type crash.But bitcoin, the most famous of the cybermonies, carries a reputation for instability, wild fluctuation, and illicit business; some fear it has the power to eliminate jobs and to upend the concept of a nation state. It implies, above all, monumental and wide-reaching change-for better and for worse. But it is here to stay, and you ignore it at your peril.Vigna and Casey demystify cryptocurrency-its origins, its function, and what you need to know to navigate a cyber-economy. The digital currency world will look very different from the paper currency world; The Age of Cryptocurrency will teach you how to be ready.

    The answers aren't easy -- just incredibly successful.

    Today, our entire modern way of life, from communication to commerce to conflict, fundamentally depends on the Internet. And the cybersecurity issues that result challenge literally everyone: politicians wrestling with everything from cybercrime to online freedom; generals protecting the nation from new forms of attack, while planning new cyberwars; business executives defending firms from once unimaginable threats, and looking to make money off of them; lawyers and ethicists building new frameworks for right and wrong. Most of all, cybersecurity issues affect us as individuals. We face new questions in everything from our rights and responsibilities as citizens of both the online and real world to simply how to protect ourselves and our families from a new type of danger. And yet, there is perhaps no issue that has grown so important, so quickly, and that touches so many, that remains so poorly understood.In Cybersecurity and CyberWar: What Everyone Needs to Know�, New York Times best-selling author P. W. Singer and noted cyber expert Allan Friedman team up to provide the kind of easy-to-read, yet deeply informative resource book that has been missing on this crucial issue of 21st century life. Written in a lively, accessible style, filled with engaging stories and illustrative anecdotes, the book is structured around the key question areas of cyberspace and its security: how it all works, why it all matters, and what can we do? Along the way, they take readers on a tour of the important (and entertaining) issues and characters of cybersecurity, from the "Anonymous" hacker group and the Stuxnet computer virus to the new cyber units of the Chinese and U.S. militaries. Cybersecurity and CyberWar: What Everyone Needs to Know� is the definitive account on the subject for us all, which comes not a moment too soon.What Everyone Needs to Know� is a registered trademark of Oxford University Press.

    Using high-speed photography, Dr. Masaru Emoto discovered that crystals formed in frozen water reveal changes when specific, concentrated thoughts are directed toward them. He found that water from clear springs and water that has been exposed to loving words shows brilliant, complex, and colorful snowflake patterns. In contrast, polluted water, or water exposed to negative thoughts, forms incomplete, asymmetrical patterns with dull colors. The implications of this research create a new awareness of how we can positively impact the earth and our personal health.

    Written by the man who started the adventure, Behind Deep Blue reveals the inside story of what happened behind the scenes at the two historic Deep Blue vs. Kasparov matches. This is also the story behind the quest to create the mother of all chess machines. The book unveils how a modest student project eventually produced a multimillion dollar supercomputer, from the development of the scientific ideas through technical setbacks, rivalry in the race to develop the ultimate chess machine, and wild controversies to the final triumph over the world's greatest human player.In nontechnical, conversational prose, Feng-hsiung Hsu, the system architect of Deep Blue, tells us how he and a small team of fellow researchers forged ahead at IBM with a project they'd begun as students at Carnegie Mellon in the mid-1980s: the search for one of the oldest holy grails in artificial intelligence--a machine that could beat any human chess player in a bona fide match. Back in 1949 science had conceived the foundations of modern chess computers but not until almost fifty years later--until Deep Blue--would the quest be realized.Hsu refutes Kasparov's controversial claim that only human intervention could have allowed Deep Blue to make its decisive, "uncomputerlike" moves. In riveting detail he describes the heightening tension in this war of brains and nerves, the "smoldering fire" in Kasparov's eyes. Behind Deep Blue is not just another tale of man versus machine. This fascinating book tells us how man as genius was given an ultimate, unforgettable run for his mind, no, not by the genius of a computer, but of man as toolmaker.