Individual Submission Summary
Share...

Direct link:

Asia’s AI-Assisted Surveillance Industry: “Hello, How May I Spy for You Today?”

Sun, October 3, 10:00 to 11:30am PDT (10:00 to 11:30am PDT), TBA

Abstract

This paper examines the Artificial Intelligence (AI)-assisted surveillance marketplace that caters to governments in the Asia-Pacific. Current discussions on AI, surveillance, and human rights tend to focus on the largest tech corporations with the most expansive data infrastructures. It also is preoccupied with controversies that occur in the west. What has fallen out of the purview are the smaller companies based out from Europe and North America that sell surveillance-as-a-service to non-western governments.

Using archival and secondary data, Freedom of Information Act (FOIA) requests, and interviews, this paper presents a unique dataset of such corporations. The focus is on corporations that are not household names but are still veterans of the data industry, often operating in this space for more than a decade. Through several in-depth case studies and the physical mapping of the collaborations between these liminal companies and Asian governments, it disentangles some of the obscured power relations that surround these firms that regularly fly under the radar.

Amrute and Murillo (2020) highlighted the important work by feminist and postcolonial scholarship in examining the hidden labour of computing worlds which are often grouped under the heading of “outsourcing”. This work has focused on unearthing the least lucrative and most dangerous jobs overseas to peripheral communities, such as clickwork and content moderation. Building on this literature, I examine the flip-side of this: when western centres of power are the targets of “outsourcing” and when the South relies on the infrastructures, algorithms, and data pipelines that originate and are owned by the West. Both these kinds of outsourcing streams are ways that reproduces patterns of power and exacerbates “the designs from the point of view of a slim minority” (ibid). These under-examined, and under-regulated flows also often reifies and entrenches colonial dependencies and logics tied to the west.

It is important to examine the supply chain of today’s surveillance industry as there is immense agenda-setting powers in corporations that shape the supply and the demand, to some extent, for authorities around the world. This is also an urgent direction of inquiry because despite the long history of some of these companies, many of these intermediate corporations appear to lack rigorous human rights audit and close monitoring of contextual harms incurred when exporting their subscription-based services. This oversight has led to contentious deployment of surveillance systems against protesters in places such as Hong Kong and India. Likewise, serious concerns around data practices have emerged, which includes issues such as callous data leaks to the selling of voter data. As Aurora (2019) contends, certain community’s privacy is seen as more expendable than others. The opacity in such operations are further entrenched by the prioritization of client confidentiality, proprietary prerogatives to closed-source algorithms, and claims of infrastructural neutrality. Furthermore, citizens from these affected countries only have a limited remit to hold these corporations responsible, as these companies are situated in distant jurisdictions that these populations have little influence over.

Multiple pressing implications arise. First is the asymmetries that exists between regulation over domestic use of AI-assisted surveillance apparatus versus exported systems, particularly in western democracies with strong regulatory scaffolding for domestic issues. Here, corporate responsibilities to human rights are held to a different standard depending on the locality in question. Second, is the human rights violation that occur when non-western countries become testing grounds for the latest surveillance technologies. The backlash from such countries are drowned out in the larger international platform. Finally, it is vital to attend to the dependencies and inequities that are created, re-created and reified between these western corporations and non-western clients through the lending of infrastructures, opaque proprietary systems, and immense caches of data that ultimately are designed, calibrated and controlled by the west.

Author