Pali101

I Blog About What I Know , What I Learn And What I Am Curious About.

Facebook shutdown its (too successful)AI after it invented its own language

Recently, two billionaire tech revolutionaries had a little public tiff about the future of Artificial Intelligence.
Mark Zuckerberg made a livestream video to share his views on why we need AI for a better tomorrow, and called out to Elon Musk for disagreeing.
Days after Tesla CEO Elon Musk said that artificial intelligence (AI) was the biggest risk, Facebook has shut down one of its AI systems after chatbots started speaking in their own language, which used English words but could not be understood by humans.

The social media giant had to pull the plug on the AI system that its researchers were working on "because things got out of hand". The trouble was, while the bots were rewarded for negotiating with each other, they were not rewarded for negotiating in English, which led the bots to develop a language of their own.

Some of Zuckerberg’s thoughts were,
“I think people who are naysayers and try to drum up these doomsday scenarios — I just, I don't understand it. It's really negative and in some ways I actually think it is pretty irresponsible.”
“Whenever I hear AI is going to hurt people in the future, I think yeah, you know, technology can generally always be used for good and bad, and you need to be careful about how you build and how it is going to be used.”


"The AI did not start shutting down computers worldwide or something of the sort, but it stopped using English and started using a language that it created,"
"The AI did not start shutting down computers worldwide or something of the sort, but it stopped using English and started using a language that it created," the report noted. Initially the AI agents used English to converse with each other but they later created a new language that only AI systems could understand, thus, defying their purpose. This led Facebook researchers to shut down the AI systems and then force them to speak to each other only in English.

"The bots were uttering gibberish. But it wasn’t without meaning. Semantics figured the codes made sense. In fact, researchers realised they bots are “incredibly crafty negotiators”.

Over time, the bots became quite skilled at it and even began feigning interest in one item in order to 'sacrifice' it at a later stage in the negotiation as a faux compromise.


This due to the fact that researchers are currently of the opinion that the humans simply cannot comprehend the logical nature of such communication. And then there are the usual fears of the machines taking over, something that elsewhere has also been called "the Terminator complex". In any case, the debate on the development and use of AI is yet to flare up.

Will the creation try to defy its own master? Are we making the world greater with technology or putting it at inevitable risk?

A big scare occurred last year as well when Google Translate quietly invented its own system to match languages without supervision.

This technology could take over and rule humankind someday if the makers aren’t extremely careful. It has showed signs of having a mind of its own already. Here’s hoping we remain the more intelligent race.

Leave a Reply

%d bloggers like this: