Global AI AutoMod does not understand context
Right now making mature jokes in chat can get chatters permanently suspended globally on Twitch completely without any human intervention that requires context.
Clarification:
This is not about regular AutoMod but the HIDDEN global AI AutoMod present in all of Twitch channels.
The AI based AutoMod Twitch currently uses everywhere does not understand important contexts and takes all text at face value. Streamers who have a strong focus on the LGBTQ community find themselves having to tell their chatters not to express themselves freely, because what they joke about can be seen as hate speech even though they are strong supporters and allies. For moderators it seems they are not allowed to do what they are supposed to do, which is to determine what is appropriate in their streamers chats.
Anything of the following in chat currently gets flagged by AI based AutoMod:
- Hints at self harm, even if clearly a reaction to a video game or made as a joke.
- Threat of violence even if clearly in-game or as a joke. The context of the game being played may portray or make the same joke that is being commented on.
- Jokes towards a protected group, even if the person who is making the joke belongs to that protected group themselves.
- Sexual advances, even if clearly consensual, requested or welcomed by the streamer.
Right now it seems anything of the above in combination with a manual report will get your account permanently suspended. Partnered and mods for the channel it was flagged in appear to get more leniency.
While it is Twitch responsibility to protect all members of their community the current AI has become overly sensitive, especially for streamers who focus on mature themes and stream games that contain mature themes.
As long as streamers have their content classification set appropriately, should that not also extend to Twitch chat?
I suggest allowing "mature content" streamers to:
- Turn off the global AI based AutoMod for their chat.
- Reduce global AI based AutoMod sensitivity for their chat. (at the very least)
As long as they have set their stream content classification properly to:
Mature-rated games; Sexual themes; Drugs, Intoxication, or Excessive Tobacco Use; Violent and Graphic Depictions; Significant Profanity or Vulgarity; or Gambling. https://safety.twitch.tv/s/article/Content-Classification-Guidelines?language=en_US
Being able to discuss or joke about topics on screen of a sensitive nature is no longer possible in Twitch chat and streamers are seeing their most active chatters and supporters get permanently suspended for participating in completely consensual conversations.
I hope this can lead to further discussion regarding the matter.
Outsourcing moderation to AI, while it may save money, is not a good idea.
Hi, thanks for taking the time to share your feedback with us. We wanted to clarify a couple of things. AutoMod can’t ban people from Twitch. Mods can use the tool to identify chat messages that break their channel’s rules. But AutoMod can’t be used to timeout, ban, or mute users from any channel, or from Twitch – those aren’t AutoMod capabilities.
We also wanted to share a bit more about how we enforce our Community Guidelines. These are the policies that apply to all of Twitch, and help make Twitch safer. We have human teams that review our content moderation decisions. We call this “human in the loop.” These reviewers help ensure that our policies are being applied accurately. We don’t use a “global AI” system to enforce our guidelines, and we manually review suspension decisions.
We recognize that, while the majority of enforcements we issue are correct, sometimes we may get it wrong. If you feel an action taken against your account was not warranted, we recommend submitting an appeal through our appeals portal for our teams to review.
Again, thanks for sharing your experience. It’s important that we’re open about how we enforce our policies. It’s also on us to ensure that our enforcement decisions are accurate. Our teams issue and review content moderation decisions in real time for that reason.
-
Silence_FP
commented
AI isn’t even needed to simply create a blanket ban for individual words. Get better developers if they can’t create a script for you.
-
oprahsinger34
commented
******** twitch for being midget retards
-
D0ctorCool
commented
it is garbage. Kill it now
-
lewc1fer
commented
im a bisexual and im furious
-
merfolkEX
commented
What a terrible idea.
-
lukasbit93
commented
Free senor
-
AaronPaulKramer
commented
NO NO NO NO please NOOOOO
-
JeanBahn
commented
This is absolutely absurd and a huge overstep of boundaries by twitch.
-
marthiocart
commented
Automod AI violates the entire purpose of the internet, for humans to communicate to other humans
-
danimalrex
commented
Context matters
-
WubbysGoose
commented
1984
-
prisonfingers
commented
Please turn it off, I have friends and family getting banned and it is ruining lives.
-
FINXCO
commented
Mass banning people for jokes at face value without context is wrong. wubby7
-
Valythe
commented
This is awful. Twitch is trying to ruin the platform again.
-
ProfessorButt
commented
DO NOT DO THIS!
-
secretly_a_skeksis
commented
Free Senor Stinkfist
-
nick_mastro_
commented
this sucks
-
OdinOrdure
commented
AI is still known for making very egregious mistakes, even when finely tuned for just a single purpose.
Implementing this sort of system to scan chats while taking control out of the hands of streamers and moderators was a foolish decision.
-
BulkyPigeon
commented
This is a horrible feature. Chats have moderators for a reason, some AI overwatcher without the ability to know context is such a dystopian concept. Idk how they thought this would go over well, but this absolutely obliterates the twitch chat experience.
-
thedoodler303
commented
Literally 1984