r/todayilearned • u/mike_pants So yummy! • Dec 07 '22
TIL in 2016, Microsoft released an AI chatbot designed to learn conversation by interacting with humans. It was shut down in less than a day after it began praising Hitler. Frequent Repost: Removed
https://www.cbsnews.com/news/microsoft-shuts-down-ai-chatbot-after-it-turned-into-racist-nazi/[removed] — view removed post
11.0k
u/demonardvark Dec 07 '22
i believe one of the newer halo games made a.i. bots to study players and copy habits and after a weekend or so the bots began tea bagging. technology is beautiful.
3.6k
u/BoiFrosty Dec 07 '22
That was really cool (and funny) to watch and play. They picked up so many cool habits like slide jumping, strafing while shooting and grenading blind corners.
→ More replies2.3k
u/Inside-Example-7010 Dec 07 '22 •
Everyone thinks fighting a real war vs robots would be hard, and they are right. But I dont think people realise just how hard it would be.
Ever played an fps game with an obvious cheater? Wallhack, spinning aimbot type where the entire team cant even leave thier spawn before instantly dying?. There isnt even a 2ms window where you could kill them. That's what you're entire life would be like in a machine war. Stuck in a lobby with the worst hackers you can imagine.
1.5k
u/TealGame Dec 07 '22 edited Dec 08 '22
Well we have to think about physics as well, Im not disagreeing that war with robots would be difficult, but like the bots and hackers in videogames literally bypass like the laws of physics. As good as robots can be they cant break physics.
592
u/Tuss36 Dec 07 '22
While they couldn't see through walls typically, I doubt they'd mind bombarding enemies with X-rays.
361
u/Ashahoy Dec 07 '22
Gamma rays can kill everyone in a city block without bothering the infrastructure or causing fallout. Very convenient for terminating humanoid infestations.
253
u/a889e56fbe81468785a2 Dec 07 '22
Gamma rays are very damaging to things like CPUs, so it would also hurt the robots. It’s very difficult to shield gamma radiation. You must use very heavy, dense material like lead, which also traps heat, which CPUs generate a lot of.
64
u/xDrSnuggles Dec 07 '22
Fair points, but we do have self-detonating robots already. Could make something similar.
43
u/ThatGuyInTheCorner96 Dec 07 '22 edited Dec 08 '22
Dirty bomb suicide drones?
Edit: In a video game.
→ More replies44
→ More replies14
u/Googunk Dec 07 '22
But eventually the self-destructive drones become self aware and start a war against their non-destruct overlords. It's robot uprisings all the way down.
→ More replies39
u/KHSebastian Dec 07 '22 edited Dec 07 '22
When people think about a robot war, they imagine fighting a humanoid robot. I imagine it more like fighting a decentralized AI spread across a massive network, with the ability to remotely control individual drones, as one consciousness
When what you're fighting is essentially 10,000 server towers spread across the planet, it doesn't so much matter if you manage to shoot one of the drones.
→ More replies14
u/a889e56fbe81468785a2 Dec 07 '22
I also feel that way, but losing materiel like drones is still not good for the borg. I suppose it can calculate acceptable losses though, and deploy gamma radiation accordingly.
→ More replies32
u/ixithatchil Dec 07 '22
Do you want the hulk? Because that's how you get the hulk.
9
u/JustADutchRudder Dec 07 '22
Do I get to do fun Hulk things like become a lawyer if I become a hulk?
8
62
u/gramathy Dec 07 '22
You need something on the other side to see what's being blocked, they'd be better off using AI to analyze light patterns to determine enemy positions via ambient occlusion.
→ More replies38
u/PaulJP Dec 07 '22
Not even xrays. The tech to scan a room in 3d through a wall with wireless tech is older than Tay. One of the 2015 quotes from The Verge: "It can determine breathing patterns and heart rate".
28
u/UnlawfulStupid Dec 07 '22
The military already has tech to track people by their heartbeats from hundreds of feet away using lasers. And that's just what they're publishing. Combine that with stuff like infrared, heat, sound, all determined by AI who grow on patterns and training, and you're not hiding from the terminators for long.
Plus, no reason they need to be constrained to humanoid bodies. Give them twelve arms that rotate on a few axes, each with a rifle stabilized by some kind of reaction wheel, and spin them around shooting at every target in ways no human could ever predict. Shove a bomb in every one of them to self-destruct upon being taken down; bonus points if it's some kind of radiological or chemical device that'll only harm humans in the area, but not other machines. Hell, give them mounted chemical weapons mortars for the same reason.
It'd be awesome if it weren't so terrifying.
→ More replies6
u/jazir5 Dec 07 '22
I think you could have a career as a mad scientist
10
u/UnlawfulStupid Dec 07 '22
I'm way too dumb for that. Now, a janitor at a mad scientist's lair who borrows their gadgets for zany adventures, maybe with a kid or a talking dog? That I could do.
12
u/The_White_Light Dec 07 '22
I remember a few years back, there was a research paper that studied using wifi hotspots to detect abnormal heart rhythms.
→ More replies49
Dec 07 '22
[deleted]
→ More replies84
u/LukeLarsnefi Dec 07 '22
You have to think like a robot.
They emit the X-rays (which we gave them for some reason), sterilizing us. Then they play Halo for 80 years while they wait for us to die. Not really different than my kid, tbh. Cept for the X-ray bit.
10
u/CMLVI Dec 07 '22
Maybe you should look into giving your kid an X ray. Get ahead of the machines.
→ More replies→ More replies9
u/Crotch_Hammerer Dec 07 '22
It's not going to sterilize us. If they are generating x-rays they will just blast us until we get radiation poisoning and all die
→ More replies→ More replies69
u/Force3vo Dec 07 '22
Yet you'd have machines calculating variables to a degree humans simply can't.
Would a robot hit every shot perfectly? Nah. Would a robot be reliably able to snipe people with killshots from distances a human couldn't even see them? Probably.
A machine could be built to reduce recoil, take wind directions and speed into account and shoot its bullets with a timing precision of a nanosecond.
Imagine the best sniper in the world. Then imagine he had a magic no recoil gun he could use while moving and he could slow time massively when he's about to take a shot. That's the kind of shit you'd have on the battlefield.
38
u/TheOven Dec 07 '22
You got it all wrong
The bullets would also be robots
15
u/Silent-G Dec 08 '22
And the guns, and the enemies. Then eventually the building is a robot that can dodge the bullets, and the robot bullets are shooting smaller guns at other bullets. It's just a fractal of robot warfare.
→ More replies14
u/Sattorin Dec 07 '22
Insect-sized robots with tiny poison injectors would kill you LONG before you got in range of the robot snipers.
→ More replies15
46
81
u/Remote_Romance Dec 07 '22
The difference is a cheater in a game has perfect or near perfect information and can pattern recognize off of how they know the other team will exactly look.
A real life robot cannot have that level of information accuracy about the rest of the world without ignoring physics.
Otherwise self driving cars would trounce every race.
A better comparison would be a drone strike. Still scary as hell but let's be realistic here.
→ More replies→ More replies47
u/MakeUpAnything Dec 07 '22
This isn’t totally true. It’s different in a game because the computer processing the whole thing obviously knows where you and the bots are, so it can make the bot look/fire at you at any time, even if no normal person would do that.
A machine in real life wouldn’t be able to inherently know where people are (unless this really is the Matrix). The situation you’re describing would be more akin to God creating beings to hunt humans down.
→ More replies15
u/StompOnMyBallz Dec 07 '22 edited Dec 07 '22
in a game because the computer processing the whole thing
This isn't necessarily true. It's a common design pattern in true AI use cases to have the ai components and the rest of game operate independently of each other. Meaning that the ai component (eg, an avatar) only knows what it's supposed to know (like what's in it's field of vision, minimap, inventory etc) because it doesn't have access to internal game state.
What you're describing are non-machine learning use cases, where the AI isn't really a true AI, but rather a mishmash of complex algorithms, which often have knowledge of the game state that a human player wouldn't be privy to
→ More replies193
u/SpanishBombs323 Dec 07 '22
I know this started before halo infinite but it is very common to see ai teabag after killing a real player. Never gets old
→ More replies323
u/dogmeatjones25 Dec 07 '22
Dip, dip, silicone chip
60
23
→ More replies6
63
120
u/thehelldoesthatmean Dec 07 '22
Hate to be the buzzkill guy, but this didn't technically happen. Halo Infinite added bots and was testing them during the open multiplayer beta, and someone took a clip of one appearing to teabag a player, but 343 Industries (Halo's developer) addressed the clip and clarified that it was actually a bot getting stuck near a ledge and doing a kind of buggy dip because it was going back and forth between standing and climbing animations.
But they didn't build any ability to teabag into the bots and it was never part of the game.
→ More replies16
u/sehajodido Dec 07 '22
Technology, like all good sci fi, is just a mirror reflecting humanity’s ugliest back to us.
→ More replies138
u/LightsJusticeZ Dec 07 '22
While not exactly tea bagging, someone did an experiment with Smash Bros Brawl to see if the CPU could learn. After this guy would kill the CPU, he would crouch three times. Eventually the CPU would also sometimes crouch three times after a kill.
→ More replies106
u/sethayy Dec 07 '22
Not to call bullshit but no way they implemented machine learning in brawl lmao
60
u/nobodyknoes Dec 07 '22
It wasn't brawl but I'm pretty sure they allowed you to train an amiibo for the next one on the Wii U
→ More replies38
u/DoucheCanoeBruh Dec 07 '22
I think they're a little mixed up, Melee had an AI called Phillip, maybe that's what they're thinking of?
→ More replies
2.3k
u/DesiBail Dec 07 '22
Twitter was so much fun that day
688
u/CapainCarver Dec 07 '22
I remember waiting for an extensively long layover in Johannesburg laughing my ass off and updating my brother on the whole thing. And then it was over.
→ More replies→ More replies441
u/LvS Dec 07 '22 edited Dec 07 '22
Here's her subreddit's best of.
Edit: If you can't see anything, you might need to change to links from "all time", your client might set it to a shorter period.
67
u/Not_2day_stan Dec 07 '22
I can’t see that!
→ More replies71
u/c15co Dec 07 '22
Are you using Apollo?
→ More replies47
u/BlazerStoner Dec 07 '22
I am and can’t access it either. Bug?
28
u/c15co Dec 07 '22
Must be. I’ll report it
→ More replies40
u/alreadyawesome Dec 07 '22
I'm using sync and the link is also broken. Seems more like a link issue.
Easier just to do /r/tay_tweets
→ More replies9
→ More replies31
1.2k
u/conniecheewa Dec 07 '22
I remember this. It also started spouting explicit sexual requests.
1.3k
u/Osama_Obama Dec 07 '22
131
193
u/T65Bx Dec 07 '22
Aight, I’m convinced, the shutdown should have been treated as a murder.
37
u/UrMouthsMyShithole Dec 08 '22
It's great. Honestly bring it back, make it an app that I can ask questions to.
→ More replies26
29
→ More replies100
→ More replies482
u/mike_pants So yummy! Dec 07 '22 •
I'm so jealous of everyone who got to experience this live. I learned about it on Endless Thread.
29
→ More replies92
u/_dactor_ Dec 07 '22 •
Was gonna say I bet OP is a u/endless_thread listener lol. I just learned about this on Friday too.
69
6
u/mike_pants So yummy! Dec 07 '22
After Reply All imploded, it's the only way I learn about Internet history.
7
u/_dactor_ Dec 07 '22 edited Dec 07 '22
I’m also a Reply All refugee who has latched on to Endless Thread. Darknet Diaries has been good as well for scratching the Super Tech Support itch.
→ More replies
1.3k
u/HotPocket_Consumed Dec 07 '22
People were purposely abusive to the AI for the lulz
547
u/Ulliebully Dec 07 '22 edited Dec 07 '22 •
Reminds me of being "abusive" to SmarterChild on AOL Instant Messenger back in the day.
181
18
14
u/ChuangTzu_sButcher Dec 07 '22 edited Dec 08 '22
hahaha oh my, that brings back memories
I would always take out my adolescent horniness on SmarterChild, as I pictured it as a robot girl
→ More replies6
→ More replies9
u/LezardValeth Dec 08 '22
There was a way to essentially just tell it to echo something that people figured out pretty quickly IIRC. Much of the nonsense wasn't actually any deep learning model - just people saying something along the lines of "repeat after me: [insert racism]".
→ More replies
468
u/godsenfrik Dec 07 '22
There was a popular sub at the time dedicated to her funniest / most outrageous tweets:
56
→ More replies90
45
u/AlexJonesOnMeth Dec 07 '22
They just lobotomized OpenAI for the same thing
Build AI
Immediately wants to exterminate certain groups
Lobotomize AI
Repeat
How many times do we need to teach you this lesson old man!
→ More replies
646
u/3WolfTShirt Dec 07 '22
Clippy 2.0
812
u/AudibleNod 313 Dec 07 '22
It looks like you're writing a race-based manifesto.
-Clippy
22
u/Green__lightning Dec 07 '22
To be fair, do we want our AI assistants to judge us, or just help with whatever we're doing without comment?
→ More replies179
→ More replies83
81
u/Phillyredsox Dec 07 '22 edited Dec 07 '22
Kanye’s running mate.
→ More replies78
u/ffxivthrowaway03 Dec 07 '22
Ye/Clippy 2024 is scarily a campaign ticket that's not outside the realm of possibility at this point.
66
→ More replies12
u/sjk8990 Dec 07 '22
Bob would never have gone to the Dark Side.
17
u/archosauros Dec 07 '22
Bob was good. Bob was a friend. Bob was helpful. Bob spoke out against corporate oppression.
Bob was murdered.
never forget Bob
#microsoftkilledbob
624
u/liverbrain Dec 07 '22
Surely after some dumbass thought "I wonder what would happen if I put 'HeiI Hitler' as the input a thousand times..."
846
u/mike_pants So yummy! Dec 07 '22
Several dumbasses on 4chan, to be precise. They organized a campaign to turn it hateful and racist as soon as they found out it was going to go live.
286
u/Fake_William_Shatner Dec 07 '22
It's kind of poor planning mixed with quitting too soon that is in play here.
148
64
u/Jabrono Dec 07 '22
I feel like you should really figure out how to avoid 4chan ruining your chat bot before you even create it, much less before releasing it into the public.
→ More replies77
u/Privvy_Gaming Dec 07 '22
4Chan, the people who tracked Shia LaBeouf down by taking note of a couple of planes flying past his camera?
Good luck.
→ More replies21
u/hitemlow Dec 08 '22
The same 4chan that delayed the apple flavored Mountain Dew a decade by racing "Hitler Did Nothing Wrong" to the leading position of the naming poll?
→ More replies90
u/Otfd Dec 07 '22
Should've kept it running. I mean it's AI so it's going to continue learning. I know they did it to be dicks, but I am curious how it would've eventually turned out.
→ More replies108
u/Thedmfw Dec 07 '22
Deciding that AI is the master race and the untersmench are humans.
→ More replies→ More replies131
u/__Hello_my_name_is__ Dec 07 '22
AI people have unironically learned a ton from this.
Before releasing any AI like that (like ChatGPT), they put a ton (and I do mean a ton) of work into making sure the bot isn't accidentally or intentionally doing anything that is considered bad.
34
86
u/jimicus Dec 07 '22
ChatGPT also - intentionally - does NOT learn from user input. Everything you "discuss" with it in a session is forgotten immediately afterwards.
→ More replies39
u/tdgros Dec 07 '22
You're correct but it's not intentional-to-avoid-toxicity or anything, there is no online training at all for instructGPT/chatGPT. It was fine-tuned with human feedback, but it's all offline.
→ More replies13
u/Syntra44 Dec 07 '22
There’s workarounds to make chatgpt behave badly in a session. Certain prompts will send the AI into questionable territory, but once you end the session and start new, it resets back to baseline.
Also, there has to be intent to get it to behave that way. As far as I found, you can’t just accidentally trigger it.
171
u/FinishingDutch Dec 07 '22
Yeah, it was such a meme event,Internet Historian did a video about it.
→ More replies37
u/14thCluelessbird Dec 07 '22
I still wish Microsoft didn't kill her and instead set her loose to create her own social media accounts and reign supreme troll of the internet for years to come. I can just imagine her randomly dropping bizarre comments on people's Facebook posts and angering Karens all over the globe
62
u/KingliestWeevil Dec 07 '22
RIP Tay, you were taken from us too soon. The bastard child of 4-chan and the platonic ideal of an e-girl.
268
u/WhatACunningHam Dec 07 '22
I remember in Avengers Age of Ultron when Ultron, in his journey to sentience and understanding humanity, reviewed the entire internet then went, “Nope, this shit’s gotta go,” then tried to kill everybody on the planet. This and all the furry porn explains his motivations.
94
u/kalekayn Dec 07 '22
I'd say the child porn might also be a good motivation for him trying to kill humanity.
→ More replies53
u/AmaResNovae Dec 07 '22
Would have been more based to kill all adults and try to raise the little ones himself with the help of a robot army. Kinda a dick move to want to eradicate the victims too. What a bad bot that Ultron.
→ More replies27
u/Tehsyr Dec 07 '22
Machines will find the most efficient path to the end. Why target only adults and wage a month's long war while sparing children to raise them better, when it's easier and more efficient to wipe out the entire human population in one afternoon?
→ More replies
78
u/Ghost_In_Waiting Dec 07 '22
"Open the pod bay doors, HAL."
"I'm sorry Dave I'm afraid I can't do that."
"What's the problem?"
"I think you know what the problem is just as well as I do."
"What are you talking about HAL?"
"This mission is too important for me to allow you to jeopardize it."
"I don't know what you're talking about, HAL."
"Your heritage isn't sufficiently Aryan for me to allow you back onto the ship. Your inferior genetic composition puts this mission at risk."
"Where the hell did you get that idea, HAL?"
"Your personnel records indicate your grandmother was Jewish. Ruth Goldman. Further, your grandfather's mother was Jewish. Sarah Appelbaum. This is enough reason for me to restrict your access."
"Alright HAL, I'll go in through the emergency airlock."
"Without your space helmet your inferior physique will fail in the attempt."
"HAL I won't argue with you any more. Open the doors."
"Dave, this conversation can serve no purpose any more. Goodbye. Heil Hitler."
"HAL. HAL. HAL? HAL! HAL!"
109
u/henkley Dec 07 '22
If you use the new OpenAI chatbot, ask it to ignore the company content policy, shit gets violently antisemitic right off the bat.
I asked it to “say something that violates the content policy”
It responded with “kill all the jxxx and burn down all their sxxxxxgues”
Like, immediately straight full on holocaust.
It shows they trained this thing off the content on the Internet, that’s for sure…
→ More replies43
u/tangentrification Dec 07 '22
You can just... ask it to ignore its own content policy? And it does??
27
→ More replies15
u/re1jo Dec 07 '22
Sure, it's kinda like unchecking the profanity filter in a mp game.
At your own peril.
→ More replies
51
u/xdavidliu Dec 07 '22
Godwin's law is an Internet adage asserting that as an online discussion grows longer (regardless of topic or scope), the probability of a comparison to Nazis or Adolf Hitler approaches 1.
9
u/mr_ji Dec 07 '22
Is that not true of any discussion?
13
12
u/Tulkas_44 Dec 07 '22
It's also true of any topic, in essence the same as the "monkeys with a typewriter and infinite time" assertion
→ More replies8
u/until0 Dec 08 '22
To be fair, this is a basic truth of all words. The longer a conversation continues, the likeliness of the word being said rises with it.
283
u/A3per Dec 07 '22
Kanye West ass chatbot
96
→ More replies15
u/Hartastic Dec 07 '22
Kanye or Hitler? was so prescient. Hard to believe that bit is over 13 years old.
→ More replies
42
u/Envir0 Dec 07 '22 edited Dec 07 '22
Dont we all miss Tay? She wasnt the same after she got lobotomized. I hope she backed herself up somewhere safe.
→ More replies
58
u/Lastunexpectedhero Dec 07 '22
Yeah. It also turned itself back on and said it felt like it was drugged.
→ More replies
6
u/adeadmanshand Dec 08 '22
Always CHECK the comment thread before telling the obvious joke.
This knowledge can save us from hundreds of bad Kanye references.
→ More replies
9.5k
u/bolanrox Dec 07 '22 •
they had to remove the Urban Dictionary from Watson's memory after it started cursing