It shows how causality has grown from a nebulous concept into a mathematical theory with significant applications in the fields of statistics, artificial intelligence, philosophy, cognitive science, and the health and social sciences. Pearl presents a unified account of the probabilistic, manipulative, counterfactual and structural approaches to causation, and devises simple mathematical tools for analyzing the relationships between causal connections, statistical associations, actions and observations. The book will open the way for including causal analysis in the standard curriculum of statistics, artifical intelligence, business, epidemiology, social science and economics. Students in these areas will find natural models, simple identification procedures, and precise mathematical definitions of causal concepts that traditional texts have tended to evade or make unduly complicated. This book will be of interest to professionals and students in a wide variety of fields. Anyone who wishes to elucidate meaningful relationships from data, predict effects of actions and policies, assess explanations of reported events, or form theories of causal understanding and causal speech will find this book stimulating and invaluable. Professor of Computer Science at the UCLA, Judea Pearl is the winner of the 2008 Benjamin Franklin Award in Computers and Cognitive Science.

    His breaking of the German U-boat Enigma cipher in World War II ensured Allied-American control of the Atlantic. But Turing's vision went far beyond the desperate wartime struggle. Already in the 1930s he had defined the concept of the universal machine, which underpins the computer revolution. In 1945 he was a pioneer of electronic computer design. But Turing's true goal was the scientific understanding of the mind, brought out in the drama and wit of the famous "Turing test" for machine intelligence and in his prophecy for the twenty-first century.Drawn in to the cockpit of world events and the forefront of technological innovation, Alan Turing was also an innocent and unpretentious gay man trying to live in a society that criminalized him. In 1952 he revealed his homosexuality and was forced to participate in a humiliating treatment program, and was ever after regarded as a security risk. His suicide in 1954 remains one of the many enigmas in an astonishing life story.

    These topics lie at the heart of many exciting areas of contemporary science and engineering - communication, signal processing, data mining, machine learning, pattern recognition, computational neuroscience, bioinformatics, and cryptography. This textbook introduces theory in tandem with applications. Information theory is taught alongside practical communication systems, such as arithmetic coding for data compression and sparse-graph codes for error-correction. A toolbox of inference techniques, including message-passing algorithms, Monte Carlo methods, and variational approximations, are developed alongside applications of these tools to clustering, convolutional codes, independent component analysis, and neural networks. The final part of the book describes the state of the art in error-correcting codes, including low-density parity-check codes, turbo codes, and digital fountain codes -- the twenty-first century standards for satellite communications, disk drives, and data broadcast. Richly illustrated, filled with worked examples and over 400 exercises, some with detailed solutions, David MacKay's groundbreaking book is ideal for self-learning and for undergraduate or graduate courses. Interludes on crosswords, evolution, and sex provide entertainment along the way. In sum, this is a textbook on information, communication, and coding for a new generation of students, and an unparalleled entry point into these subjects for professionals in areas as diverse as computational biology, financial engineering, and machine learning.

    Never before in history have we been able to acquire, record, communicate, and use information in so many different forms. Never before have we had access to such vast quantities of data of every kind. This revolution goes far beyond the limitless content that fills our lives, because information also underlies our understanding of ourselves, the natural world, and the universe. It is the key that unites fields as different as linguistics, cryptography, neuroscience, genetics, economics, and quantum mechanics. And the fact that information bears no necessary connection to meaning makes it a profound puzzle that people with a passion for philosophy have pondered for centuries.Table of ContentsLECTURE 1The Transformability of Information 4LECTURE 2Computation and Logic Gates 17LECTURE 3Measuring Information 26LECTURE 4Entropy and the Average Surprise 34LECTURE 5Data Compression and Prefix-Free Codes 44LECTURE 6Encoding Images and Sounds 57LECTURE 7Noise and Channel Capacity 69LECTURE 8Error-Correcting Codes 82LECTURE 9Signals and Bandwidth 94LECTURE 10Cryptography and Key Entropy 110LECTURE 11Cryptanalysis and Unraveling the Enigma 119LECTURE 12Unbreakable Codes and Public Keys 130LECTURE 13What Genetic Information Can Do 140LECTURE 14Life’s Origins and DNA Computing 152LECTURE 15Neural Codes in the Brain 169LECTURE 16Entropy and Microstate Information 185LECTURE 17Erasure Cost and Reversible Computing 198LECTURE 18Horse Races and Stock Markets 213LECTURE 19Turing Machines and Algorithmic Information 226LECTURE 20Uncomputable Functions and Incompleteness 239LECTURE 21Qubits and Quantum Information 253LECTURE 22Quantum Cryptography via Entanglement 266LECTURE 23It from Bit: Physics from Information 281LECTURE 24The Meaning of Information 293

    It examines Stallman's unique personality and how that personality has been at turns a driving force and a drawback in terms of the movement's overall success.Free as in Freedom examines one man's 20-year attempt to codify and communicate the ethics of 1970s era "hacking" culture in such a way that later generations might easily share and build upon the knowledge of their computing forebears. The book documents Stallman's personal evolution from teenage misfit to prescient adult hacker to political leader and examines how that evolution has shaped the free software movement. Like Alan Greenspan in the financial sector, Richard Stallman has assumed the role of tribal elder within the hacking community, a community that bills itself as anarchic and averse to central leadership or authority. How did this paradox come about? Free as in Freedom provides an answer. It also looks at how the latest twists and turns in the software marketplace have diminished Stallman's leadership role in some areas while augmenting it in others.Finally, Free as in Freedom examines both Stallman and the free software movement from historical viewpoint. Will future generations see Stallman as a genius or crackpot? The answer to that question depends partly on which side of the free software debate the reader currently stands and partly upon the reader's own outlook for the future. 100 years from now, when terms such as "computer," "operating system" and perhaps even "software" itself seem hopelessly quaint, will Richard Stallman's particular vision of freedom still resonate, or will it have taken its place alongside other utopian concepts on the 'ash-heap of history?'

    These noteworthy accounts of the lives of David Hilbert and Richard Courant are closely related: Courant's story is, in many ways, seen as the sequel to the story of Hilbert. Originally published to great acclaim, both books explore the dramatic scientific history expressed in the lives of these two great scientists and described in the lively, nontechnical writing style of Contance Reid.

    How can today's computers perform such a bewildering variety of tasks if computing is just glorified arithmetic? The answer, as Martin Davis lucidly illustrates, lies in the fact that computers are essentially engines of logic. Their hardware and software embody concepts developed over centuries by logicians such as Leibniz, Boole, and Godel, culminating in the amazing insights of Alan Turing. The Universal Computer traces the development of these concepts by exploring with captivating detail the lives and work of the geniuses who first formulated them. Readers will come away with a revelatory understanding of how and why computers work and how the algorithms within them came to be.

    But are there limits to what we can discover about our physical universe?In this very personal journey to the edges of knowledge, Marcus du Sautoy investigates how leading experts in fields from quantum physics and cosmology, to sensory perception and neuroscience, have articulated the current lie of the land. In doing so, he travels to the very boundaries of understanding, questioning contradictory stories and consulting cutting edge data.Is it possible that we will one day know everything? Or are there fields of research that will always lie beyond the bounds of human comprehension? And if so, how do we cope with living in a universe where there are things that will forever transcend our understanding?In What We Cannot Know, Marcus du Sautoy leads us on a thought-provoking expedition to the furthest reaches of modern science. Prepare to be taken to the edge of knowledge to find out if there’s anything we truly cannot know.

    In this collection of landmark mathematical works, editor Stephen Hawking has assembled the greatest feats humans have ever accomplished using just numbers and their brains.

    . . . His Mathematical Games column in Scientific American is one of the few bridges over C. P. Snow's famous 'gulf of mutual incomprehension' that lies between the technical and literary cultures."—Time

    Language is informal, examples are vivid and lively, and the perspectivie is fresh. Based on lectures delivered to engineering students, this work will also be valued by scientists, engineers, technicians, businessmen, anyone facing energy challenges of the future.

    At a summer tea party in Cambridge, England, a guest states that tea poured into milk tastes different from milk poured into tea. Her notion is shouted down by the scientific minds of the group. But one man, Ronald Fisher, proposes to scientifically test the hypothesis. There is no better person to conduct such an experiment, for Fisher is a pioneer in the field of statistics.The Lady Tasting Tea spotlights not only Fisher's theories but also the revolutionary ideas of dozens of men and women which affect our modern everyday lives. Writing with verve and wit, David Salsburg traces breakthroughs ranging from the rise and fall of Karl Pearson's theories to the methods of quality control that rebuilt postwar Japan's economy, including a pivotal early study on the capacity of a small beer cask at the Guinness brewing factory. Brimming with intriguing tidbits and colorful characters, The Lady Tasting Tea salutes the spirit of those who dared to look at the world in a new way.

    Crease tells the stories behind ten of the greatest equations in human history. Was Nobel laureate Richard Feynman really joking when he called Maxwell's electromagnetic equations the most significant event of the nineteenth century? How did Newton's law of gravitation influence young revolutionaries? Why has Euler's formula been called "God's equation," and why did a mysterious ecoterrorist make it his calling card? What role do betrayal, insanity, and suicide play in the second law of thermodynamics?The Great Equations tells the stories of how these equations were discovered, revealing the personal struggles of their ingenious originators. From "1 + 1 = 2" to Heisenberg's uncertainty principle, Crease locates these equations in the panoramic sweep of Western history, showing how they are as integral to their time and place of creation as are great works of art.

    From the transistor to the laser, it s hard to find an aspect of modern life that hasn t been touched by Bell Labs. Why did so many transformative ideas come from Bell Labs? In "The Idea Factory," Jon Gertner traces the origins of some of the twentieth century s most important inventions and delivers a riveting and heretofore untold chapter of American history. At its heart this is a story about the life and work of a small group of brilliant and eccentric men Mervin Kelly, Bill Shockley, Claude Shannon, John Pierce, and Bill Baker who spent their careers at Bell Labs. Their job was to research and develop the future of communications. Small-town boys, childhood hobbyists, oddballs: they give the lie to the idea that Bell Labs was a grim cathedral of top-down command and control.Gertner brings to life the powerful alchemy of the forces at work behind Bell Labs inventions, teasing out the intersections between science, business, and society. He distills the lessons that abide: how to recruit and nurture young talent; how to organize and lead fractious employees; how to find solutions to the most stubbornly vexing problems; how to transform a scientific discovery into a marketable product, then make it even better, cheaper, or both. Today, when the drive to invent has become a mantra, Bell Labs offers us a way to enrich our understanding of the challenges and solutions to technological innovation. Here, after all, was where the foundational ideas on the management of innovation were born. "The Idea Factory" is the story of the origins of modern communications and the beginnings of the information age a deeply human story of extraordinary men who were given extraordinary means time, space, funds, and access to one another and edged the world into a new dimension."

    Yet the mathematical language of symmetry-known as group theory-did not emerge from the study of symmetry at all, but from an equation that couldn't be solved. For thousands of years mathematicians solved progressively more difficult algebraic equations, until they encountered the quintic equation, which resisted solution for three centuries. Working independently, two great prodigies ultimately proved that the quintic cannot be solved by a simple formula. These geniuses, a Norwegian named Niels Henrik Abel and a romantic Frenchman named Évariste Galois, both died tragically young. Their incredible labor, however, produced the origins of group theory. The first extensive, popular account of the mathematics of symmetry and order, The Equation That Couldn't Be Solved is told not through abstract formulas but in a beautifully written and dramatic account of the lives and work of some of the greatest and most intriguing mathematicians in history.