Big Data and Positive Change in the Developing World: Challenges and Opportunities

Taylor, Linnet, Cowls, Josh, Schroeder, Ralph and Eric T. Meyer (2014). Big Data and Positive Change in the Developing World: Challenges and Opportunities. Policy & Internet 6 (4), pp. 418-444.

This paper is the product of a workshop that brought together practitioners, researchers, and data experts to discuss how big data is becoming a resource for positive social change in low- and middle-income countries (LMICs). We include in our definition of big data sources such as social media data, mobile phone use records, digitally mediated transactions, online news media sources, and administrative records. We argue that there are four main areas where big data has potential for promoting positive social change: advocacy; analysis and prediction; facilitating information exchange; and promoting accountability and transparency. These areas all have particular challenges and possibilities, but there are also issues shared across them, such as open data and privacy concerns. Big data is shaping up to be one of the key battlefields of our time, and the paper argues that this is therefore an opportune moment for civil society groups in particular to become a larger part of the conversation about the use of big data, since questions about the asymmetries of power involved are especially urgent in these uses in LMICs. Civil society groups are also currently underrepresented in debates about privacy and the rights of technology users, which are dominated by corporations, governments and nongovernmental organizations in the Global North. We conclude by offering some lessons drawn from a number of case studies that represent the current state-of-the-art.

What the Thornberry Affair tells us about politicians online

Published on the the LSE British Politics and Policy blog.

Many commentators have speculated what was going through the mind of Emily Thornberry, the shadow Attorney General, when she tweeted a picture of a terraced Rochester house draped in three England flags and a white van parked in the driveway, with the simple caption ‘Image from Rochester’. Continue reading “What the Thornberry Affair tells us about politicians online”

Big Data in the Humanities: lessons from papyrus and Instagram

I’m currently in Washington DC to attend the IEEE International Conference on Big Data. The first day is set aside for workshops, and I’ve just attended a really insightful one on ‘Big Humanities Data’. The diversity of work presented was immense, covering a huge sweep of history: from fragments of ancient Greek text to Instagram photos taken during the Ukraine revolution, via the Irish Rebellion of 1641 and the Spanish flu outbreak of a century ago. Nonetheless, certain patterns stuck out from many of most of the talks given. Continue reading “Big Data in the Humanities: lessons from papyrus and Instagram”

The Crowd in the Cloud? Three challenges for gauging public opinion online

Cowls, Josh (2014) The Crowd in the Cloud? Three challenges for gauging public opinion online. IPP2014: Crowdsourcing for Politics and Policy, September 2014, Oxford, UK.

Much excitement surrounds the use of social sources of big data – harvested from popular networking platforms like Twitter and Facebook, as well as other forms of socially generated data including Wikipedia edits and Google searches – in the pursuit of social scientific discovery. In this paper I assess the extent to which these newly available sources of socially-generated big data can tell us about public opinion in a society at large. I draw on data from a series of interviews conducted with researchers at the forefront of big data approaches to social science, in order to outline the opportunities and issues around this area of research. In my analysis I identify three challenges to the validity of online public opinion measurement – the reliability of the data collected, the representativeness of the ‘sample’ being analysed, and the replicability of this form of public opinion research – and suggest various ways in which these challenges can be met.

Big Data, Ethics, and the Social Implications of Knowledge Production

Schroeder, Ralph and Cowls, Josh (2014) Big Data, Ethics, and the Social Implications of Knowledge Production. Data Ethics Workshop, KDD@Bloomberg, August 24 2014, New York, NY, USA.

This position paper addresses current debates about data in general, and big data specifically, by examining the ethical issues arising from advances in knowledge production. Typically ethical issues such as privacy and data protection are discussed in the context of regulatory and policy debates. Here we argue that this overlooks a larger picture whereby human autonomy is undermined by the growth of scientific knowledge. To make this argument, we first offer definitions of data and big data, and then examine why the uses of data-driven analyses of human behaviour in particular have recently experienced rapid growth. Next, we distinguish between the contexts in which big data research is used, and argue that this research has quite different implications in the context of scientific as opposed to applied research. We conclude by pointing to the fact that big data analyses are both enabled and constrained by the nature of data sources available. Big data research will nevertheless inevitably become more pervasive, and this will require more awareness on the part of data scientists, policymakers and a wider public about its contexts and often unintended consequences.

Murder in the time of virality

careless-talk-costs-lives
(For today’s social media landscape, invert the megaphone)

That the beheading of journalist James Foley is ‘media’ is horrific. Whether it is ‘social’ falls on all of us.

I, like millions of others, learned about the death of journalist James Foley on social media. But it just so happened that the news was delivered to me in as sensitive and sombre a way as possible. Continue reading “Murder in the time of virality”

Social media and public opinion: what’s new?

I’m currently writing up a paper for submission to the Internet, Politics and Policy 2014 conference to be held by the OII in September. My paper – which draws substantially on interviews conducted as part of the Sloan Foundation-funded project of which I’m part – asks whether and to what extent the measurement of public opinion has been transformed by the new availability of socially-generated sources of big data, such as social media postings and search queries, and the tools which allow us to analyse them. Continue reading “Social media and public opinion: what’s new?”

Streisandfreude: how the right to be forgotten may become an excuse to be remembered

Copyright (C) 2002 Kenneth & Gabrielle Adelman, California Coastal Records Project, www.californiacoastline.org.
Barbara Streisand’s house in the hills, an image which survived legal efforts at suppression to give us ‘the Streisand effect’. Copyright (C) 2002 Kenneth & Gabrielle Adelman, California Coastal Records Project, http://www.californiacoastline.org.

The past fortnight saw the first ripples of reaction to the European Court of Justice’s assertion of a citizen’s ‘right to be forgotten’ online. Following the court’s ruling, Google began the implementation of a process whereby individuals can petition for the removal of links in search results to pages deemed objectionable.

Continue reading “Streisandfreude: how the right to be forgotten may become an excuse to be remembered”