Global AI AutoMod does not understand context
Right now making mature jokes in chat can get chatters permanently suspended globally on Twitch completely without any human intervention that requires context.
Clarification:
This is not about regular AutoMod but the HIDDEN global AI AutoMod present in all of Twitch channels.
The AI based AutoMod Twitch currently uses everywhere does not understand important contexts and takes all text at face value. Streamers who have a strong focus on the LGBTQ community find themselves having to tell their chatters not to express themselves freely, because what they joke about can be seen as hate speech even though they are strong supporters and allies. For moderators it seems they are not allowed to do what they are supposed to do, which is to determine what is appropriate in their streamers chats.
Anything of the following in chat currently gets flagged by AI based AutoMod:
- Hints at self harm, even if clearly a reaction to a video game or made as a joke.
- Threat of violence even if clearly in-game or as a joke. The context of the game being played may portray or make the same joke that is being commented on.
- Jokes towards a protected group, even if the person who is making the joke belongs to that protected group themselves.
- Sexual advances, even if clearly consensual, requested or welcomed by the streamer.
Right now it seems anything of the above in combination with a manual report will get your account permanently suspended. Partnered and mods for the channel it was flagged in appear to get more leniency.
While it is Twitch responsibility to protect all members of their community the current AI has become overly sensitive, especially for streamers who focus on mature themes and stream games that contain mature themes.
As long as streamers have their content classification set appropriately, should that not also extend to Twitch chat?
I suggest allowing "mature content" streamers to:
- Turn off the global AI based AutoMod for their chat.
- Reduce global AI based AutoMod sensitivity for their chat. (at the very least)
As long as they have set their stream content classification properly to:
Mature-rated games; Sexual themes; Drugs, Intoxication, or Excessive Tobacco Use; Violent and Graphic Depictions; Significant Profanity or Vulgarity; or Gambling. https://safety.twitch.tv/s/article/Content-Classification-Guidelines?language=en_US
Being able to discuss or joke about topics on screen of a sensitive nature is no longer possible in Twitch chat and streamers are seeing their most active chatters and supporters get permanently suspended for participating in completely consensual conversations.
I hope this can lead to further discussion regarding the matter.
Outsourcing moderation to AI, while it may save money, is not a good idea.
![](https://secure.gravatar.com/avatar/d41d8cd98f00b204e9800998ecf8427e?size=40&default=https%3A%2F%2Fstatic-cdn.jtvnw.net%2Fjtv_user_pictures%2Fcd1397c4-61e0-4ee3-96fd-160080fb62cd-profile_image-150x150.png)
Hi, thanks for taking the time to share your feedback with us. We wanted to clarify a couple of things. AutoMod can’t ban people from Twitch. Mods can use the tool to identify chat messages that break their channel’s rules. But AutoMod can’t be used to timeout, ban, or mute users from any channel, or from Twitch – those aren’t AutoMod capabilities.
We also wanted to share a bit more about how we enforce our Community Guidelines. These are the policies that apply to all of Twitch, and help make Twitch safer. We have human teams that review our content moderation decisions. We call this “human in the loop.” These reviewers help ensure that our policies are being applied accurately. We don’t use a “global AI” system to enforce our guidelines, and we manually review suspension decisions.
We recognize that, while the majority of enforcements we issue are correct, sometimes we may get it wrong. If you feel an action taken against your account was not warranted, we recommend submitting an appeal through our appeals portal for our teams to review.
Again, thanks for sharing your experience. It’s important that we’re open about how we enforce our policies. It’s also on us to ensure that our enforcement decisions are accurate. Our teams issue and review content moderation decisions in real time for that reason.
-
Coolbyrd1 commented
Why does the auto mod ban “Show nips” and not the n word being spammed in KaiCenat’s chat? That looks a little racist to me, Twitch. Do you support the oppression of minorities? Your AI does.
-
KingMusicManz commented
Imagine someone named their pet ******, a weird name, but we have seen MUCH weirder, shoutout to HP Officejet Pro Printer the cat, and now imagine this person had a camera set up specifically to show their cat, ******. A twitch user might completely innocently say "Show nip!" because all they wanted to see was a cute cat. Now, their entire account is banned. Permanently. How stupid.
-
Zecrex commented
Stop auto-banning for simple phrases that are allowed in some chats. Or just have a case-by-case auto ban where the streamer can pick the phrases to auto-ban for.
-
leahloou commented
This seems so easily preventable. AI should not be able to make these decisions with no human intervention. Twitch needs to stop being lazy. This is a huge issue.
Free SenorStinkfist
-
Finest_Stoner97 commented
This is the worst idea ever. Like I didn't think twitch could get worse and here we are.
-
The_Fixx commented
What an absolutely terrible idea using AI to mod
-
CapnClumsy commented
Free SenorStinkfist!
Free Val1s! -
RandoTokez commented
FREE SENÕRSTINKFIST!
-
dingleberrijerri commented
Have AI mod check for context, and also show nips?
Free the ones who paved the way for us to "Show nip!"Free val1s and senor.
-
BossStompTV commented
It only makes sense to tie detections like this into the existing moderation tools. It’s completely absurd to take automated actions. Especially ones that are not reversible by moderators and broadcasters.
-
Buzzed_Light_Beer commented
free senor! free val1s!
show nips! (with context)
-
stonerindeepspace commented
I dont think we need an AI that doesnt understand context or jokes i think the mods of the cannel should be in charge not stupid AI. who's stupid *** idea was that anyways? I mean **** whats the point of having mods on the channels? get it together twitch this is trash af
-
Coolbyrd1 commented
Free SenorStinkfist!
Free Val1s! -
dumb_dude360 commented
no
-
goinunder0390 commented
FREE SENÕR FREE VAL1S
-
WinstonO7 commented
How twitch gonna take subs money, use unregulated AI to regulate permanent status of users, and still hold decent standing with mastercard and visa? Its neat to see hidden articles in yall guidelines detailing violations of California consumer rights regarding purchasing online services. Good stuff, twitch!
edit: Human moderation is needed when yall charge money. receiving instant emails after submitting appeals towards these fraudulent bans is more than enough evidence needed for the california supreme court, they been set this precedent for over almost 10 years now. learn from the youtube settlements twitchers, yall legal team doing worse than bay area financial advisors.
-
narwhalzilla commented
Show nip
-
Xeenick commented
Global perma bans should require human intervention and not be allowed by AI which is easy to make mistakes because it clearly doesn't understand context. Even if it takes into account context of other messages, it doesn't know whats being talked about or viewed on stream so it's still missing important context.
-
L1ttleRabbit commented
shiw nops
-
IanBabz95 commented
I should be able to comment show nips.