Entities
View all entitiesIncident Stats
CSETv0 Taxonomy Classifications
Taxonomy DetailsProblem Nature
Specification, Robustness, Assurance
Physical System
Software only
Level of Autonomy
Medium
Nature of End User
Amateur
Public Sector Deployment
No
Data Inputs
Twitter users' input
CSETv1 Taxonomy Classifications
Taxonomy DetailsIncident Number
6
Notes (special interest intangible harm)
4.6 - Tay's tweets included racist and misogynist content, far-right ideology, and harmful content against certain religions, etc.
Special Interest Intangible Harm
yes
Date of Incident Year
2016
Date of Incident Month
03
Date of Incident Day
23
CSETv1_Annotator-1 Taxonomy Classifications
Taxonomy DetailsIncident Number
6
Notes (special interest intangible harm)
4.6 - Tay's tweets included racist and misogynist content, far-right ideology, and harmful content against certain religions, etc.
Special Interest Intangible Harm
yes
Date of Incident Year
2016
Date of Incident Month
03
Date of Incident Day
23
Incident Reports
Reports Timeline
![Microsoft's artificial Twitter bot stunt backfires as trolls teach it racist statements](https://res.cloudinary.com/pai/image/upload/f_auto/q_auto/c_fill,h_480/v1/reports/media-assets-03.thedrum.com/cache/images/thedrum-prod/s3-news-tmp-90538-tay_ai_twitter_bot_racist_fail_0--default--588.jpg)
- View the original report at its source
- View the report at the Internet Archive
Microsoft unveiled Twitter artificial intelligence bot @TayandYou yesterday in a bid to connect with millennials and "experiment" with conversational understanding.
Microsoft's artificial Twitter bot stunt backfires as trolls teach it racis…
![Why Microsoft's 'Tay' AI bot went wrong](https://res.cloudinary.com/pai/image/upload/f_auto/q_auto/c_fill,h_480/v1/reports/tr2.cbsistatic.com/hub/i/r/2016/03/24/65b3a4ea-ea77-4f2b-9fc0-b6f7875a375b/thumbnail/770x578/1d88e462d48a62f5460743e258f3560d/tay.jpg)
- View the original report at its source
- View the report at the Internet Archive
Less than a day after she joined Twitter, Microsoft's AI bot, Tay.ai, was taken down for becoming a sexist, racist monster. AI experts explain why it went terribly wrong.
Image: screenshot, Twitter
She was supposed to come off as a normal t…
![Here Are the Microsoft Twitter Bot’s Craziest Racist Rants](https://res.cloudinary.com/pai/image/upload/f_auto/q_auto/c_fill,h_480/v1/reports/i.kinja-img.com/gawker-media/image/upload/s--yQBp50oz--/c_fill%2Cfl_progressive%2Cg_center%2Ch_900%2Cq_80%2Cw_1600/pvnom2e7i5nbmkrasn7d.jpg)
- View the original report at its source
- View the report at the Internet Archive
Yesterday, Microsoft unleashed Tay, the teen-talking AI chatbot built to mimic and converse with users in real time. Because the world is a terrible place full of shitty people, many of those users took advantage of Tay’s machine learning c…
- View the original report at its source
- View the report at the Internet Archive
A day after Microsoft introduced an innocent Artificial Intelligence chat robot to Twitter it has had to delete it after it transformed into an evil Hitler-loving, incestual sex-promoting, 'Bush did 9/11'-proclaiming robot.
Developers at Mi…
![Twitter taught Microsoft’s AI chatbot to be a racist asshole in less than a day](https://res.cloudinary.com/pai/image/upload/f_auto/q_auto/c_fill,h_480/v1/reports/cdn.vox-cdn.com/thumbor/WFwpJSYyPB3ORAVMGDAUDx4iV-o=/303x0:1189x498/1600x900/cdn.vox-cdn.com/uploads/chorus_image/image/49155161/download.0.0.jpeg)
- View the original report at its source
- View the report at the Internet Archive
It took less than 24 hours for Twitter to corrupt an innocent AI chatbot. Yesterday, Microsoft unveiled Tay — a Twitter bot that the company described as an experiment in "conversational understanding." The more you chat with Tay, said Micr…
![Microsoft deletes racist, genocidal tweets from AI chatbot Tay](https://res.cloudinary.com/pai/image/upload/f_auto/q_auto/c_fill,h_480/v1/reports/amp.businessinsider.com/images/56f3ebc19105842b008b870b-960-480.png)
- View the original report at its source
- View the report at the Internet Archive
Tay's Twitter page Microsoft Microsoft's new AI chatbot went off the rails Wednesday, posting a deluge of incredibly racist messages in response to questions.
The tech company introduced "Tay" this week — a bot that responds to users' queri…
![Microsoft’s Tay is an Example of Bad Design](https://res.cloudinary.com/pai/image/upload/f_auto/q_auto/c_fill,h_480/v1/reports/cdn-images-1.medium.com/max/1200/1*XyIRmYbH_bz6_Z_Ys8UYAA.png)
- View the original report at its source
- View the report at the Internet Archive
Microsoft’s Tay is an Example of Bad Design
or Why Interaction Design Matters, and so does QA-ing.
caroline sinders Blocked Unblock Follow Following Mar 24, 2016
Yesterday Microsoft launched a teen girl AI on Twitter named “Tay.” I work wit…
![Why did Microsoft’s chatbot Tay fail, and what does it mean for Artificial Intelligence studies?](https://res.cloudinary.com/pai/image/upload/f_auto/q_auto/c_fill,h_480/v1/reports/cdn-images-1.medium.com/max/1200/1*4mTB54s0eXoq89qC3uwKuA.png)
- View the original report at its source
- View the report at the Internet Archive
Why did Microsoft’s chatbot Tay fail, and what does it mean for Artificial Intelligence studies?
Botego Inc Blocked Unblock Follow Following Mar 25, 2016
Yesterday, something that looks like a big failure has happened: Microsoft’s chatbot T…
![5 Big Questions About Tay, Microsoft's Failed A.I. Twitter Chatbot](https://res.cloudinary.com/pai/image/upload/f_auto/q_auto/c_fill,h_480/v1/reports/fsmedia.imgix.net/31/30/0c/37/cfe7/4336/b29c/384f921356cf/vtxa3ywkjpg.jpeg?rect=0%2C107%2C400%2C200&auto=format%2Ccompress&w=400)
- View the original report at its source
- View the report at the Internet Archive
This week, the internet did what it does best and demonstrated that A.I. technology isn’t quite as intuitive as human perception, using … racism.
Microsoft’s recently released artificial intelligence chatbot, Tay, fell victim to users’ tric…
![It's Your Fault Microsoft's Teen AI Turned Into Such a Jerk](https://res.cloudinary.com/pai/image/upload/f_auto/q_auto/c_fill,h_480/v1/reports/media.wired.com/photos/59271a83ac01987bf0138860/191:100/pass/1500x500.jpeg)
- View the original report at its source
- View the report at the Internet Archive
It was the unspooling of an unfortunate series of events involving artificial intelligence, human nature, and a very public experiment. Amid this dangerous combination of forces, determining exactly what went wrong is near-impossible. But t…
![Microsoft shuts down AI chatbot after it turned into a Nazi](https://res.cloudinary.com/pai/image/upload/f_auto/q_auto/c_fill,h_480/v1/reports/assets2.cbsnewsstatic.com/hub/i/r/2016/03/24/d2d15a04-7a3f-48ad-8c28-ac2154d1ad05/thumbnail/1200x630/97ebc227b57e58961d27bec670516c98/tay.png)
- View the original report at its source
- View the report at the Internet Archive
Microsoft got a swift lesson this week on the dark side of social media. Yesterday the company launched "Tay," an artificial intelligence chatbot designed to develop conversational understanding by interacting with humans. Users could follo…
- View the original report at its source
- View the report at the Internet Archive
As many of you know by now, on Wednesday we launched a chatbot called Tay. We are deeply sorry for the unintended offensive and hurtful tweets from Tay, which do not represent who we are or what we stand for, nor how we designed Tay. Tay is…
![Tay: Microsoft issues apology over racist chatbot fiasco](https://res.cloudinary.com/pai/image/upload/f_auto/q_auto/c_fill,h_480/v1/reports/ichef.bbci.co.uk/news/1024/branded_news/E08A/production/_88928475_88928474.jpg)
- View the original report at its source
- View the report at the Internet Archive
Image copyright Microsoft Image caption The AI was taught to talk like a teenager
Microsoft has apologised for creating an artificially intelligent chatbot that quickly turned into a holocaust-denying racist.
But in doing so made it clear T…
![Trolls turned Tay, Microsoft’s fun millennial AI bot, into a genocidal maniac](https://res.cloudinary.com/pai/image/upload/f_auto/q_auto/c_fill,h_480/v1/reports/www.washingtonpost.com/pbox.php?url=http://www.washingtonpost.com/news/the-intersect/wp-content/uploads/sites/32/2016/03/tay-e1458833653203.jpg&w=1484&op=resize&opt=1&filter=antialias&t=20170517)
- View the original report at its source
- View the report at the Internet Archive
It took mere hours for the Internet to transform Tay, the teenage AI bot who wants to chat with and learn from millennials, into Tay, the racist and genocidal AI bot who liked to reference Hitler. And now Tay is taking a break.
Tay, as The …
![Microsoft 'deeply sorry' for racist and sexist tweets by AI chatbot](https://res.cloudinary.com/pai/image/upload/f_auto/q_auto/c_fill,h_480/v1/reports/i.guim.co.uk/img/media/acaa152944c8745835cc6db28a600e9ae5505fc0/25_13_754_453/master/754.jpg?width=1200&height=630&quality=85&auto=format&fit=crop&overlay-align=bottom%2Cleft&overlay-width=100p&overlay-base64=L2ltZy9zdGF0aWMvb3ZlcmxheXMvdGctYWdlLTIwMTYucG5n&s=942c36cc69a7c25af13ac561d162e05f)
- View the original report at its source
- View the report at the Internet Archive
Microsoft has said it is “deeply sorry” for the racist and sexist Twitter messages generated by the so-called chatbot it launched this week.
The company released an official apology after the artificial intelligence program went on an embar…
![Tay the Racist Chatbot: Who is responsible when a machine learns to be evil?](https://res.cloudinary.com/pai/image/upload/f_auto/q_auto/c_fill,h_480/v1/reports/futureoflife.org/wp-content/uploads/2016/03/Warning.jpg)
- View the original report at its source
- View the report at the Internet Archive
By far the most entertaining AI news of the past week was the rise and rapid fall of Microsoft’s teen-girl-imitation Twitter chatbot, Tay, whose Twitter tagline described her as “Microsoft’s AI fam* from the internet that’s got zero chill.”…
![Microsoft’s racist chatbot returns with drug-smoking Twitter meltdown](https://res.cloudinary.com/pai/image/upload/f_auto/q_auto/c_fill,h_480/v1/reports/i.guim.co.uk/img/media/f5baa5d7046976ff8a089b9fe78e93ceb24a972e/0_38_800_480/master/800.jpg?width=1200&height=630&quality=85&auto=format&fit=crop&overlay-align=bottom%2Cleft&overlay-width=100p&overlay-base64=L2ltZy9zdGF0aWMvb3ZlcmxheXMvdGctYWdlLTIwMTYucG5n&s=b9ea1a1d4e6260bc6a11453b0d001e6d)
- View the original report at its source
- View the report at the Internet Archive
Short-lived return saw Tay tweet about smoking drugs in front of the police before suffering a meltdown and being taken offline
This article is more than 3 years old
This article is more than 3 years old
Microsoft’s attempt to converse with…
![Microsoft’s disastrous Tay experiment shows the hidden dangers of AI](https://res.cloudinary.com/pai/image/upload/f_auto/q_auto/c_fill,h_480/v1/reports/cms.qz.com/wp-content/uploads/2016/04/tay.png?w=1400&strip=all&quality=75)
- View the original report at its source
- View the report at the Internet Archive
Humans have a long and storied history of freaking out over the possible effects of our technologies. Long ago, Plato worried that writing would hurt people’s memories and “implant forgetfulness in their souls.” More recently, Mary Shelley’…
![Microsoft chatbot Zo is a censored version of Tay](https://res.cloudinary.com/pai/image/upload/f_auto/q_auto/c_fill,h_480/v1/reports/wi-images.condecdn.net/image/yLKkOjeRznV/crop/1440/0.5235602094240838/f/Untitled-4_9.jpg)
- View the original report at its source
- View the report at the Internet Archive
Tay's successor is called Zo and is only available by invitation on messaging app Kik. When you request access, the software asks for your Kik username and Twitter handle Microsoft
Having (hopefully) learnt from its previous foray into chat…
![With Teen Bot Tay, Microsoft Proved Assholes Will Indoctrinate A.I.](https://res.cloudinary.com/pai/image/upload/f_auto/q_auto/c_fill,h_480/v1/reports/fsmedia.imgix.net/6f/11/84/c2/ed4c/417d/b9ab/262693c7eb05/tayjpg.jpeg?rect=0%2C16%2C2063%2C1033&auto=format%2Ccompress&w=1200)
- View the original report at its source
- View the report at the Internet Archive
When Tay started its short digital life on March 23, it just wanted to gab and make some new friends on the net. The chatbot, which was created by Microsoft’s Research department, greeted the day with an excited tweet that could have come f…
![Microsoft’s racist chatbot, Tay, makes MIT’s annual worst-tech list](https://res.cloudinary.com/pai/image/upload/f_auto/q_auto/c_fill,h_480/v1/reports/cdn.geekwire.com/wp-content/uploads/2016/03/PhoneProfile-e1458751934872.png)
- View the original report at its source
- View the report at the Internet Archive
BOT or NOT? This special series explores the evolving relationship between humans and machines, examining the ways that robots, artificial intelligence and automation are impacting our work and lives.
Tay, the Microsoft chatbot that prankst…
- View the original report at its source
- View the report at the Internet Archive
The Accountability of AI — Case Study: Microsoft’s Tay Experiment
Yuxi Liu Blocked Unblock Follow Following Jan 16, 2017
In this case study, I outline Microsoft’s artificial intelligence (AI) chatbot Tay and describe the controversy it caus…
![Danger, danger! 10 alarming examples of AI gone wild](https://res.cloudinary.com/pai/image/upload/f_auto/q_auto/c_fill,h_480/v1/reports/images.techhive.com/images/article/2017/03/hp-12ss-ai-gone-awry-100714647-large.3x2.jpg)
- View the original report at its source
- View the report at the Internet Archive
Science fiction is lousy with tales of artificial intelligence run amok. There's HAL 9000, of course, and the nefarious Skynet system from the "Terminator" films. Last year, the sinister AI Ultron came this close to defeating the Avengers, …
- View the original report at its source
- View the report at the Internet Archive
Many people associate innovation with technology, but advancing technology is subject to the same embarrassing blunders that humans are. Nowhere is this more apparent than in chatbots.
The emerging tech, which seems to be exiting the awkwar…
![Unmasking A.I.'s Bias Problem](https://res.cloudinary.com/pai/image/upload/f_auto/q_auto/c_fill,h_480/v1/reports/fortunedotcom.files.wordpress.com/2018/06/rac-08-18-opener.jpg)
- View the original report at its source
- View the report at the Internet Archive
WHEN TAY MADE HER DEBUT in March 2016, Microsoft had high hopes for the artificial intelligence–powered “social chatbot.” Like the automated, text-based chat programs that many people had already encountered on e-commerce sites and in custo…
![Microsoft’s politically correct chatbot is even worse than its racist one](https://res.cloudinary.com/pai/image/upload/f_auto/q_auto/c_fill,h_480/v1/reports/cms.qz.com/wp-content/uploads/2018/07/zo-screenshot-chatbot.png?w=1400&strip=all&quality=75)
- View the original report at its source
- View the report at the Internet Archive
Every sibling relationship has its clichés. The high-strung sister, the runaway brother, the over-entitled youngest. In the Microsoft family of social-learning chatbots, the contrasts between Tay, the infamous, sex-crazed neo-Nazi, and her …
![In 2016, Microsoft’s Racist Chatbot Revealed the Dangers of Online Conversation](https://res.cloudinary.com/pai/image/upload/f_auto/q_auto/c_fill,h_480/v1/reports/spectrum.ieee.org/media-library/screenshots-of-microsoft-s-artificial-intelligence-program-tay-ai-and-its-tweets.jpg)
- View the original report at its source
- View the report at the Internet Archive
In March 2016, Microsoft was preparing to release its new chatbot, Tay, on Twitter. Described as an experiment in "conversational understanding," Tay was designed to engage people in dialogue through tweets or direct messages, while emulati…
![Tay (bot)](https://res.cloudinary.com/pai/image/upload/f_auto/q_auto/c_fill,h_480/v1/reports/upload.wikimedia.org/wikipedia/en/6/6c/Tay_bot_logo.jpg)
- View the original report at its source
- View the report at the Internet Archive
Tay was an artificial intelligence chatter bot that was originally released by Microsoft Corporation via Twitter on March 23, 2016; it caused subsequent controversy when the bot began to post inflammatory and offensive tweets through its Tw…
Variants
Similar Incidents
Did our AI mess up? Flag the unrelated incidents
![All Image Captions Produced are Violent](https://res.cloudinary.com/pai/image/upload/f_auto/q_auto/c_fill,h_480/v1/reports/ichef.bbci.co.uk/news/1024/branded_news/128D3/production/_101578957_mediaitem101578956.jpg)
All Image Captions Produced are Violent
![Russian Chatbot Supports Stalin and Violence](https://res.cloudinary.com/pai/image/upload/f_auto/q_auto/c_fill,h_480/v1/reports/www.telegraph.co.uk/content/dam/technology/2017/10/25/1366_2000-xlarge_trans_NvBQzQNjv4Bq3Fh5VY2Bz-juTe8P68vP6n3XoXfyTf71oAHaHOQnaXc.png)
Russian Chatbot Supports Stalin and Violence
![AI Beauty Judge Did Not Like Dark Skin](https://res.cloudinary.com/pai/image/upload/f_auto/q_auto/c_fill,h_480/v1/reports/i.guim.co.uk/img/media/431da17e81eea83ea7148f67af34e37e473a1cf8/0_50_2048_1228/2048.jpg?width=1200&height=630&quality=85&auto=format&fit=crop&overlay-align=bottom%2Cleft&overlay-width=100p&overlay-base64=L2ltZy9zdGF0aWMvb3ZlcmxheXMvdGctYWdlLTIwMTYucG5n&s=956c20e409cb6986ec59a1afe1adf8b5)
AI Beauty Judge Did Not Like Dark Skin
Similar Incidents
Did our AI mess up? Flag the unrelated incidents
![All Image Captions Produced are Violent](https://res.cloudinary.com/pai/image/upload/f_auto/q_auto/c_fill,h_480/v1/reports/ichef.bbci.co.uk/news/1024/branded_news/128D3/production/_101578957_mediaitem101578956.jpg)
All Image Captions Produced are Violent
![Russian Chatbot Supports Stalin and Violence](https://res.cloudinary.com/pai/image/upload/f_auto/q_auto/c_fill,h_480/v1/reports/www.telegraph.co.uk/content/dam/technology/2017/10/25/1366_2000-xlarge_trans_NvBQzQNjv4Bq3Fh5VY2Bz-juTe8P68vP6n3XoXfyTf71oAHaHOQnaXc.png)
Russian Chatbot Supports Stalin and Violence
![AI Beauty Judge Did Not Like Dark Skin](https://res.cloudinary.com/pai/image/upload/f_auto/q_auto/c_fill,h_480/v1/reports/i.guim.co.uk/img/media/431da17e81eea83ea7148f67af34e37e473a1cf8/0_50_2048_1228/2048.jpg?width=1200&height=630&quality=85&auto=format&fit=crop&overlay-align=bottom%2Cleft&overlay-width=100p&overlay-base64=L2ltZy9zdGF0aWMvb3ZlcmxheXMvdGctYWdlLTIwMTYucG5n&s=956c20e409cb6986ec59a1afe1adf8b5)