Stay up to date with notifications from The Independent

Notifications can be managed in browser preferences.

Biased AI could worsen racial inequality, researchers say

Experts stress the need for a diverse demographic of developers

Nina Massey
Thursday 06 August 2020 04:50 EDT
Comments
AI has always embodied society's racial thinking, researchers said
AI has always embodied society's racial thinking, researchers said (Getty)

Your support helps us to tell the story

From reproductive rights to climate change to Big Tech, The Independent is on the ground when the story is developing. Whether it's investigating the financials of Elon Musk's pro-Trump PAC or producing our latest documentary, 'The A Word', which shines a light on the American women fighting for reproductive rights, we know how important it is to parse out the facts from the messaging.

At such a critical moment in US history, we need reporters on the ground. Your donation allows us to keep sending journalists to speak to both sides of the story.

The Independent is trusted by Americans across the entire political spectrum. And unlike many other quality news outlets, we choose not to lock Americans out of our reporting and analysis with paywalls. We believe quality journalism should be available to everyone, paid for by those who can afford it.

Your support makes all the difference.

The “whiteness” of artificial intelligence (AI) removes people of colour from the way humanity thinks about its technology-enhanced future, researchers argue.

University of Cambridge experts suggest current portrayals and stereotypes about AI risk creating a “racially homogenous” workforce of aspiring technologists, creating machines with bias baked into their algorithms.

The scientists say cultural depictions of AI as white need to be challenged, as they do not offer a “post-racial” future but rather one from which people of colour are simply erased.

According to the researchers from Cambridge's Leverhulme Centre for the Future of Intelligence (CFI), like other science fiction tropes, AI has always reflected racial thinking in society.

In the study published in the Philosophy and Technology journal, they argue there is a long tradition of racial stereotypes when it comes to extraterrestrials – from the “orientalised” alien of Ming the Merciless to the Caribbean caricature of Jar Jar Binks.

However, AI is portrayed as white because unlike species from other planets, it has attributes used to “justify colonialism and segregation” in the past, the researchers suggest.

Dr Kanta Dihal, who leads CFI's Decolonising AI initiative, said: “Given that society has, for centuries, promoted the association of intelligence with white Europeans, it is to be expected that when this culture is asked to imagine an intelligent machine, it imagines a white machine.

“People trust AI to make decisions. Cultural depictions foster the idea that AI is less fallible than humans.

“In cases where these systems are racialised as white, that could have dangerous consequences for humans that are not.”

The experts looked at recent research from a range of fields, including Human-Computer Interaction and Critical Race Theory, to demonstrate that machines can be racialised, and that this perpetuates “real world” racial biases.

This includes work on how robots are seen to have distinct racial identities, with black robots receiving more online abuse, and a study showing that people feel closer to virtual agents when they perceive shared racial identity.

Dr Dihal said: “One of the most common interactions with AI technology is through virtual assistants in devices such as smartphones, which talk in standard white middle-class English.

“Ideas of adding black dialects have been dismissed as too controversial or outside the target market.”

The researchers conducted their own investigation into search engines, and found that all non-abstract results for AI had either Caucasian features or were the colour white.

Co-author of the paper, Dr Stephen Cave, executive director of CFI, said: “Stock imagery for AI distils the visualisations of intelligent machines in western popular culture as it has developed over decades.

“From Terminator to Blade Runner, Metropolis to Ex Machina, all are played by white actors or are visibly white onscreen.

“Androids of metal or plastic are given white features, such as in I, Robot.

“Even disembodied AI – from HAL-9000 in 2001: A Space Odyssey to Samantha in Her – have white voices.

“Only very recently have a few TV shows, such as Westworld, used AI characters with a mix of skin tones.”

Dr Dihal added: “AI is often depicted as outsmarting and surpassing humanity.

“White culture can't imagine being taken over by superior beings resembling races it has historically framed as inferior.

“Images of AI are not generic representations of human – like machines – their whiteness is a proxy for their status and potential.”

Dr Dihal concluded: “The perceived whiteness of AI will make it more difficult for people of colour to advance in the field.

“If the developer demographic does not diversify, AI stands to exacerbate racial inequality.”

PA

Join our commenting forum

Join thought-provoking conversations, follow other Independent readers and see their replies

Comments

Thank you for registering

Please refresh the page or navigate to another page on the site to be automatically logged inPlease refresh your browser to be logged in