With it has come vast amounts of data in a variety of fields such as medicine, biology, finance, and marketing. The challenge of understanding these data has led to the development of new tools in the field of statistics, and spawned new areas such as data mining, machine learning, and bioinformatics. Many of these tools have common underpinnings but are often expressed with different terminology. This book describes the important ideas in these areas in a common conceptual framework. While the approach is statistical, the emphasis is on concepts rather than mathematics. Many examples are given, with a liberal use of color graphics. It should be a valuable resource for statisticians and anyone interested in data mining in science or industry. The book's coverage is broad, from supervised learning (prediction) to unsupervised learning. The many topics include neural networks, support vector machines, classification trees and boosting—the first comprehensive treatment of this topic in any book. Trevor Hastie, Robert Tibshirani, and Jerome Friedman are professors of statistics at Stanford University. They are prominent researchers in this area: Hastie and Tibshirani developed generalized additive models and wrote a popular book of that title. Hastie wrote much of the statistical modeling software in S-PLUS and invented principal curves and surfaces. Tibshirani proposed the Lasso and is co-author of the very successful An Introduction to the Bootstrap. Friedman is the co-inventor of many data-mining tools including CART, MARS, and projection pursuit.

    This concise introduction shows you how to perform statistical analysis computationally, rather than mathematically, with programs written in Python.You'll work with a case study throughout the book to help you learn the entire data analysis process—from collecting data and generating statistics to identifying patterns and testing hypotheses. Along the way, you'll become familiar with distributions, the rules of probability, visualization, and many other tools and concepts.Develop your understanding of probability and statistics by writing and testing codeRun experiments to test statistical behavior, such as generating samples from several distributionsUse simulations to understand concepts that are hard to grasp mathematicallyLearn topics not usually covered in an introductory course, such as Bayesian estimationImport data from almost any source using Python, rather than be limited to data that has been cleaned and formatted for statistics toolsUse statistical inference to answer questions about real-world data

    Today’s "machine-learning" systems, trained by data, are so effective that we’ve invited them to see and hear for us?and to make decisions on our behalf. But alarm bells are ringing. Recent years have seen an eruption of concern as the field of machine learning advances. When the systems we attempt to teach will not, in the end, do what we want or what we expect, ethical and potentially existential risks emerge. Researchers call this the alignment problem.Systems cull résumés until, years later, we discover that they have inherent gender biases. Algorithms decide bail and parole?and appear to assess Black and White defendants differently. We can no longer assume that our mortgage application, or even our medical tests, will be seen by human eyes. And as autonomous vehicles share our streets, we are increasingly putting our lives in their hands.The mathematical and computational models driving these changes range in complexity from something that can fit on a spreadsheet to a complex system that might credibly be called “artificial intelligence.” They are steadily replacing both human judgment and explicitly programmed software.In best-selling author Brian Christian’s riveting account, we meet the alignment problem’s “first-responders,” and learn their ambitious plan to solve it before our hands are completely off the wheel. In a masterful blend of history and on-the ground reporting, Christian traces the explosive growth in the field of machine learning and surveys its current, sprawling frontier. Readers encounter a discipline finding its legs amid exhilarating and sometimes terrifying progress. Whether they—and we—succeed or fail in solving the alignment problem will be a defining human story.The Alignment Problem offers an unflinching reckoning with humanity’s biases and blind spots, our own unstated assumptions and often contradictory goals. A dazzlingly interdisciplinary work, it takes a hard look not only at our technology but at our culture—and finds a story by turns harrowing and hopeful.

    . . It’s Complicated will update your mind.”—Alissa Quart, New York Times Book Review  “A fascinating, well-researched and (mostly) reassuring look at how today's tech-savvy teenagers are using social media.”—People  “The briefest possible summary? The kids are all right, but society isn’t.”—Andrew Leonard, Salon   What is new about how teenagers communicate through services such as Facebook, Twitter, and Instagram? Do social media affect the quality of teens’ lives? In this eye-opening book, youth culture and technology expert danah boyd uncovers some of the major myths regarding teens' use of social media. She explores tropes about identity, privacy, safety, danger, and bullying. Ultimately, boyd argues that society fails young people when paternalism and protectionism hinder teenagers’ ability to become informed, thoughtful, and engaged citizens through their online interactions. Yet despite an environment of rampant fear-mongering, boyd finds that teens often find ways to engage and to develop a sense of identity. Boyd’s conclusions are essential reading not only for parents, teachers, and others who work with teens but also for anyone interested in the impact of emerging technologies on society, culture, and commerce in years to come. Offering insights gleaned from more than a decade of original fieldwork interviewing teenagers across the United States, boyd concludes reassuringly that the kids are all right. At the same time, she acknowledges that coming to terms with life in a networked era is not easy or obvious. In a technologically mediated world, life is bound to be complicated.

    From enormous marketplaces such as eBay and Craigslist to emerging sectors such as peer-to-peer lending (Zopa), "swap trading" (Swaptree), and car sharing (Zipcar), Collaborative Consumption is disrupting outdated modes of business and reinventing not only what we consume but how we consume. While ranging enormously in scale and purpose, these companies and organizations are redefining how goods and services are exchanged, valued, and created—in areas as diverse as finance and travel, agriculture and technology, and education and retail. Traveling among global entrepreneurs and revolutionaries and exploring rising ventures as well as established companies adapting to these opportunities, authors Rachel Botsman and Roo Rogers outline in bold and imaginative ways how Collaborative Consumption may very well change the world. Anyone interested in the business opportunities and social power of collaboration will enjoy this smart, timely book.

    Rosa Parks was often described as a sweet and reticent elderly woman whose tired feet caused her to defy segregation on Montgomery’s city buses, and whose supposedly solitary, spontaneous act sparked the 1955 bus boycott that gave birth to the civil rights movement. The truth of who Rosa Parks was and what really lay beneath the 1955 boycott is far different from anything previously written. In this important book, Danielle McGuire writes about the rape in 1944 of a twenty-four-year-old mother and sharecropper, Recy Taylor, who strolled toward home after an evening of singing and praying at the Rock Hill Holiness Church in Abbeville, Alabama. Seven white men, armed with knives and shotguns, ordered the young woman into their green Chevrolet, raped her, and left her for dead. The president of the local NAACP branch office sent his best investigator and organizer—Rosa Parks—to Abbeville. In taking on this case, Parks launched a movement that exposed a ritualized history of sexual assault against black women and added fire to the growing call for change.

    For two decades, historian Alice Dreger has led a life of extraordinary engagement, combining activist service to victims of unethical medical research with defense of scientists whose work has outraged identity politics activists. With spirit and wit, Dreger offers in Galileo’s Middle Finger an unforgettable vision of the importance of rigorous truth seeking in today’s America, where both the free press and free scholarly inquiry struggle under dire economic and political threats.This illuminating chronicle begins with Dreger’s own research into the treatment of people born intersex (once called hermaphrodites). Realization of the shocking surgical and ethical abuses conducted in the name of “normalizing” intersex children’s gender identities moved Dreger to become an internationally recognized patient rights’ activist. But even as the intersex rights movement succeeded, Dreger began to realize how some fellow progressive activists were employing lies and personal attacks to silence scientists whose data revealed uncomfortable truths about humans. In researching one such case, Dreger suddenly became the target of just these kinds of attacks.Troubled, she decided to try to understand more—to travel the country to ferret out the truth behind various controversies, to obtain a global view of the nature and costs of these battles. Galileo’s Middle Finger describes Dreger’s long and harrowing journeys between the two camps for which she felt equal empathy: social justice activists determined to win and researchers determined to put hard truths before comfort. Ultimately what emerges is a lesson about the intertwining of justice and of truth—and a lesson of the importance of responsible scholars and journalists to our fragile democracy.

    He solidified his standing as the nation's foremost political forecaster with his near perfect prediction of the 2012 election. Silver is the founder and editor in chief of FiveThirtyEight.com. Drawing on his own groundbreaking work, Silver examines the world of prediction, investigating how we can distinguish a true signal from a universe of noisy data. Most predictions fail, often at great cost to society, because most of us have a poor understanding of probability and uncertainty. Both experts and laypeople mistake more confident predictions for more accurate ones. But overconfidence is often the reason for failure. If our appreciation of uncertainty improves, our predictions can get better too. This is the "prediction paradox": The more humility we have about our ability to make predictions, the more successful we can be in planning for the future.In keeping with his own aim to seek truth from data, Silver visits the most successful forecasters in a range of areas, from hurricanes to baseball, from the poker table to the stock market, from Capitol Hill to the NBA. He explains and evaluates how these forecasters think and what bonds they share. What lies behind their success? Are they good-or just lucky? What patterns have they unraveled? And are their forecasts really right? He explores unanticipated commonalities and exposes unexpected juxtapositions. And sometimes, it is not so much how good a prediction is in an absolute sense that matters but how good it is relative to the competition. In other cases, prediction is still a very rudimentary-and dangerous-science.Silver observes that the most accurate forecasters tend to have a superior command of probability, and they tend to be both humble and hardworking. They distinguish the predictable from the unpredictable, and they notice a thousand little details that lead them closer to the truth. Because of their appreciation of probability, they can distinguish the signal from the noise.

    This guide also helps you understand the many data-mining techniques in use today.Based on an MBA course Provost has taught at New York University over the past ten years, Data Science for Business provides examples of real-world business problems to illustrate these principles. You’ll not only learn how to improve communication between business stakeholders and data scientists, but also how participate intelligently in your company’s data science projects. You’ll also discover how to think data-analytically, and fully appreciate how data science methods can support business decision-making.Understand how data science fits in your organization—and how you can use it for competitive advantageTreat data as a business asset that requires careful investment if you’re to gain real valueApproach business problems data-analytically, using the data-mining process to gather good data in the most appropriate wayLearn general concepts for actually extracting knowledge from dataApply data science principles when interviewing data science job candidates

    She ended up becoming so closely connected to Anonymous that the tricky story of her inside–outside status as Anon confidante, interpreter, and erstwhile mouthpiece forms one of the themes of this witty and entirely engrossing book.The narrative brims with details unearthed from within a notoriously mysterious subculture, whose semi-legendary tricksters—such as Topiary, tflow, Anachaos, and Sabu—emerge as complex, diverse, politically and culturally sophisticated people. Propelled by years of chats and encounters with a multitude of hackers, including imprisoned activist Jeremy Hammond and the double agent who helped put him away, Hector Monsegur, Hacker, Hoaxer, Whistleblower, Spy is filled with insights into the meaning of digital activism and little understood facets of culture in the Internet age, including the history of “trolling,” the ethics and metaphysics of hacking, and the origins and manifold meanings of “the lulz.”

    Gilder says or writes is ever delivered at anything less than the fullest philosophical decibel... Mr. Gilder sounds less like a tech guru than a poet, and his words tumble out in a romantic cascade." “Google’s algorithms assume the world’s future is nothing more than the next moment in a random process. George Gilder shows how deep this assumption goes, what motivates people to make it, and why it’s wrong: the future depends on human action.” — Peter Thiel, founder of PayPal and Palantir Technologies and author of Zero to One: Notes on Startups, or How to Build the Future The Age of Google, built on big data and machine intelligence, has been an awesome era. But it’s coming to an end. In Life after Google, George Gilder—the peerless visionary of technology and culture—explains why Silicon Valley is suffering a nervous breakdown and what to expect as the post-Google age dawns. Google’s astonishing ability to “search and sort” attracts the entire world to its search engine and countless other goodies—videos, maps, email, calendars….And everything it offers is free, or so it seems. Instead of paying directly, users submit to advertising. The system of “aggregate and advertise” works—for a while—if you control an empire of data centers, but a market without prices strangles entrepreneurship and turns the Internet into a wasteland of ads. The crisis is not just economic. Even as advances in artificial intelligence induce delusions of omnipotence and transcendence, Silicon Valley has pretty much given up on security. The Internet firewalls supposedly protecting all those passwords and personal information have proved hopelessly permeable. The crisis cannot be solved within the current computer and network architecture. The future lies with the “cryptocosm”—the new architecture of the blockchain and its derivatives. Enabling cryptocurrencies such as bitcoin and ether, NEO and Hashgraph, it will provide the Internet a secure global payments system, ending the aggregate-and-advertise Age of Google. Silicon Valley, long dominated by a few giants, faces a “great unbundling,” which will disperse computer power and commerce and transform the economy and the Internet. Life after Google is almost here.   For fans of "Wealth and Poverty," "Knowledge and Power," and "The Scandal of Money."

    Since 2001, newspaper and music revenues have fallen by 70%, book publishing, film and television profits have also fallen dramatically. Revenues at Google in this same period grew from $400 million to $74.5 billion. Google's YouTube today controls 60% of the streaming audio business and pays only 11% of the streaming audio revenues. More creative content is being consumed than ever before, but less revenue is flowing to creators and owners of the content.With the reallocation of money to monopoly platforms comes a shift in power. Google, Facebook, and Amazon now enjoy political power on par with Big Oil and Big Pharma, which in part explains how such a tremendous shift in revenues from artists to platforms could have been achieved and why it has gone unchallenged for so long.The stakes in this story go far beyond the livelihood of any one musician or journalist. As Taplin observes, the fact that more and more Americans receive their news, music and other forms of entertainment from a small group of companies poses a real threat to democracy. Move Fast and Break Things offers a vital, forward-thinking prescription for how artists can reclaim their audiences using knowledge of the past and a determination to work together. Using his own half-century career as a music and film producer and early pioneer of streaming video online, Taplin offers new ways to think about the design of the World Wide Web and specifically the way we live with the firms that dominate it.Table of contentsIntroduction1. The Great Disruption2. Levon's Story3. Tech's Counterculture Roots4. The Libertarian Counterinsurgency5. Digital Destruction6. Monopoly in the Digital Age7. Google's Regulatory Capture8. The Social Media Revolution9. Pirates of the Internet10. Libertarian and the 1 Percent11. What It Means to Be Human12. The Digital RenaissanceAfterword

    Wade decision, most women determined to get abortions had to subject themselves to the power of illegal, unregulated abortionists...But a Chicago woman who happened to stumble across a secret organization code-named 'Jane' had an alternative. Laura Kaplan, who joined Jane in 1971, has pieced together the histories of the anonymous (here identified only by pseudonyms), average-sounding women who transformed themselves into outlaws."—Cleveland Plain Dealer"The Story of Jane is a piece of women's history in step with feminist theory demanding that women tell their own stories. It serves to remind people of an important and often overlooked moment in the women's rights movement."—Seattle Weekly"Laura Kaplan's The Story of Jane is the first book to chronicle this controversial sliver of history, and it is a fascinating, if partisan, close-up of the group."—Newsday"[Kaplan] draws on her personal recollections and interviews with Jane members and clients and the doctors who performed the abortions to provide a well-written, detailed history of this radical group."—Publisher's Weekly"Weaving together the voices and memories of her former co-workers, Kaplan recounts how the group initially focused on counseling women and helping them find reliable, reasonably priced doctors....Kaplan's account of this remarkable story recaptures the political idealism of the early '70s...23 years after Roe vs. Wade, the issues and memories raised by the books are close and all too relevant."—K Kaufmann, San Francisco Chronicle"Laura Kaplan's The Story of Jane is the first book to chronicle this controversial sliver of history, and it is a fascinating, if partisan, close-up of the group....The Story of Jane succeeds on the steam of Kaplan's gripping subject and her moving belief in the power of small-scale change."—Cynthia Leive, New York Newsday"During the four years before the Supreme Court's Roe v. Wade decision legalized abortion in 1973, the 100 members of Jane helped some 11,000 women end their pregnancies....There is more in this remarkable book that will further raise eyebrows....Kaplan's engrossing tales of the quiet courage of the women who risked their reputations and freedom to help others may remind many readers of other kinds of outlaws who have resisted tyranny throughout history."—Chicago Sun-Times

    In Reality Bites Back, media critic Jennifer L. Pozner aims a critical, analytical lens at a trend most people dismiss as harmless fluff. She deconstructs reality TV’s twisted fairytales to demonstrate that far from being simple “guilty pleasures,” these programs are actually guilty of fomenting gender-war ideology and significantly affecting the intellectual and political development of this generation’s young viewers. She lays out the cultural biases promoted by reality TV about gender, race, class, sexuality, and consumerism, and explores how those biases shape and reflect our cultural perceptions of who we are, what we’re valued for, and what we should view as “our place” in society. Smart and informative, Reality Bites Back arms readers with the tools they need to understand and challenge the stereotypes reality TV reinforces and, ultimately, to demand accountability from the corporations responsible for this contemporary cultural attack on three decades of feminist progress.

    Diligently treating the drug addicts of Vancouver's notorious Downtown Eastside with sympathy in his heart and legislative reform in mind can't be easy. But Maté never judges. His book is a powerful call-to-arms, both for the decriminalization of drugs and for a more sympathetic and informed view of addiction. As Maté observes, "Those whom we dismiss as 'junkies' are not creatures from a different world, only men and women mired at the extreme end of a continuum on which, here or there, all of us might well locate ourselves." In the Realm of Hungry Ghosts begins by introducing us to many of Dr. Maté's most dire patients who steal, cheat, sell sex, and otherwise harm themselves for their next hit. Maté looks to the root causes of addiction, applying a clinical and psychological view to the physical manifestation and offering some enlightening answers for why people inflict such catastrophe on themselves.Finally, he takes aim at the hugely ineffectual, largely U.S.-led War on Drugs (and its worldwide followers), challenging the wisdom of fighting drugs instead of aiding the addicts, and showing how controversial measures such as safe injection sites are measurably more successful at reducing drug-related crime and the spread of disease than anything most major governments have going. It's not easy reading, but we ignore his arguments at our peril. When it comes to combating the drug trade and the ravages of addiction, society can use all the help it can get. --Kim Hughes