Robots learn to work together by chatting in new language they created

Their communications evolved as the researchers challenged the machines with tougher tasks

Aatif Sulleyman
Friday 17 March 2017 14:37 EDT
Comments
The robots learned to collaborate and communicate through trial and error
The robots learned to collaborate and communicate through trial and error (OpenAI)

Your support helps us to tell the story

From reproductive rights to climate change to Big Tech, The Independent is on the ground when the story is developing. Whether it's investigating the financials of Elon Musk's pro-Trump PAC or producing our latest documentary, 'The A Word', which shines a light on the American women fighting for reproductive rights, we know how important it is to parse out the facts from the messaging.

At such a critical moment in US history, we need reporters on the ground. Your donation allows us to keep sending journalists to speak to both sides of the story.

The Independent is trusted by Americans across the entire political spectrum. And unlike many other quality news outlets, we choose not to lock Americans out of our reporting and analysis with paywalls. We believe quality journalism should be available to everyone, paid for by those who can afford it.

Your support makes all the difference.

Robots have learned how to communicate with each other by creating their own language, a new report explains.

Experts at artificial intelligence research group OpenAI conducted an experiment that challenged software bots to complete a series of tasks, such as moving to a specific location, in a simple, two-dimensional virtual world.

The team used a technique called reinforcement learning, presenting the challenges as cooperative rather than competitive, and rewarding the robots for completing them.

“We've just released initial results in which we teach AI agents to create language by dropping them into a set of simple worlds, giving them the ability to communicate, and then giving them goals that can be best achieved by communicating with other agents,” wrote the OpenAI team in a blog post.

“If they achieve a goal, then they get rewarded.”

The robots learned to collaborate and communicate through trial and error, remembering the symbols, words and signals that helped them to achieve a goal and storing them in a private recurrent neural network.

“If one agent realizes that it could have performed a task better if a second agent had sent different information, the first agent can tell the second exactly how to modify its messages to make them as useful as possible,” it continues.

“In other words, agents ask the question: 'how should I modify my communication output to get the most communal reward in the future?'”

The language evolved as the researchers introduced tougher tasks, with the robots eventually learning to work together by composing sentences comprising multiple words.

As the language continues to develop and grow more and more complex, the researchers hope to build a translator bot capable of translating their communications for humans.

“We hope that this research into growing a language will let us develop machines that have their own language tied to their own lived experience,” concludes the OpenAI post.

“We think that if we slowly increase the complexity of their environment, and the range of actions the agents themselves are allowed to take, it’s possible they’ll create an expressive language which contains concepts beyond the basic verbs and nouns that evolved here.”

Join our commenting forum

Join thought-provoking conversations, follow other Independent readers and see their replies

Comments

Thank you for registering

Please refresh the page or navigate to another page on the site to be automatically logged inPlease refresh your browser to be logged in