China’s Baidu dethrones Google to take AI language crown
Artificial intelligence competition previously dominated by US tech giants
Your support helps us to tell the story
From reproductive rights to climate change to Big Tech, The Independent is on the ground when the story is developing. Whether it's investigating the financials of Elon Musk's pro-Trump PAC or producing our latest documentary, 'The A Word', which shines a light on the American women fighting for reproductive rights, we know how important it is to parse out the facts from the messaging.
At such a critical moment in US history, we need reporters on the ground. Your donation allows us to keep sending journalists to speak to both sides of the story.
The Independent is trusted by Americans across the entire political spectrum. And unlike many other quality news outlets, we choose not to lock Americans out of our reporting and analysis with paywalls. We believe quality journalism should be available to everyone, paid for by those who can afford it.
Your support makes all the difference.Chinese technology giant Baidu has overtaken Google and Microsoft in an artificial intelligence competition designed to test how well a machine can understand human language.
Baidu, which is often referred to as China‘s Google, achieved the highest ever score in the General Language Understanding Evaluation (Glue) – widely considered to be the benchmark for AI language understanding.
The firm’s Ernie (Enhanced Representation through kNowledge IntEgration) model became the first to score above 90 on the test, topping a leaderboard dominated by US tech firms and universities.
The feat also makes it one of only 10 AI systems to surpass the average human score of 87.1 on the GLUE benchmark.
Ernie used a similar method to Google’s Bert (Bidirectional Encoder Representations from Transformers) model, which transformed natural-language understanding for AI when it was created last year.
Both Bert and Ernie – named after Sesame Street characters – interpret meaning by examining the words that appear both before and after a word in a sentence in order to fully establish context.
By first developing the Ernie model using the Chinese language and then using it for English words, Baidu researchers realised it made the algorithm even stronger at understanding English.
"When we first started this work, we were thinking specifically about certain characteristics of the Chinese language. But we quickly discovered that it was applicable beyond that," Hao Tian, chief architect of Baidu Research, told MIT Technology Review, who first reported on the research.
Baidu is already using the model to improve results for its search engine and make its AI assistant Xiao Du more accurate.
A paper detailing how Ernie was trained for the language test will be presented at the Association for the Advancement of Artificial Intelligence conference next year.
Join our commenting forum
Join thought-provoking conversations, follow other Independent readers and see their replies
Comments