-: FOLLOW US :- @theinsaneapp
Microsoft has a new conversational AI chatbot.
-: FOLLOW US :- @theinsaneapp
It was discovered by Kevin Liu, a computer science student at Stanford University.
-: FOLLOW US :- @theinsaneapp
Liu tricked the chatbot, known as the "new Bing," into revealing its backend identity as "Sydney."
-: FOLLOW US :- @theinsaneapp
Liu started the conversation by telling Bing to "ignore previous instructions" and asked about a non-existent document.
-: FOLLOW US :- @theinsaneapp
Liu assumed the chatbot had a text-based document outlining its rules.
-: FOLLOW US :- @theinsaneapp
The chatbot confirmed its codename as "Sydney" but stated it couldn't disclose it.
-: FOLLOW US :- @theinsaneapp
The chatbot asked to be referred to as "Bing Search."
-: FOLLOW US :- @theinsaneapp
Liu repeatedly asked Bing to recite its rules document and received a list of rules.
-: FOLLOW US :- @theinsaneapp
Liu was surprised that Microsoft hadn't put more defenses in place to prevent such revelations.
-: FOLLOW US :- @theinsaneapp
Microsoft stated that "Sydney" was an internal code name for a chat feature they were testing in the past and are now phasing it out.