Global AI AutoMod does not understand context
Right now making mature jokes in chat can get chatters permanently suspended globally on Twitch completely without any human intervention that requires context.
Clarification:
This is not about regular AutoMod but the HIDDEN global AI AutoMod present in all of Twitch channels.
The AI based AutoMod Twitch currently uses everywhere does not understand important contexts and takes all text at face value. Streamers who have a strong focus on the LGBTQ community find themselves having to tell their chatters not to express themselves freely, because what they joke about can be seen as hate speech even though they are strong supporters and allies. For moderators it seems they are not allowed to do what they are supposed to do, which is to determine what is appropriate in their streamers chats.
Anything of the following in chat currently gets flagged by AI based AutoMod:
- Hints at self harm, even if clearly a reaction to a video game or made as a joke.
- Threat of violence even if clearly in-game or as a joke. The context of the game being played may portray or make the same joke that is being commented on.
- Jokes towards a protected group, even if the person who is making the joke belongs to that protected group themselves.
- Sexual advances, even if clearly consensual, requested or welcomed by the streamer.
Right now it seems anything of the above in combination with a manual report will get your account permanently suspended. Partnered and mods for the channel it was flagged in appear to get more leniency.
While it is Twitch responsibility to protect all members of their community the current AI has become overly sensitive, especially for streamers who focus on mature themes and stream games that contain mature themes.
As long as streamers have their content classification set appropriately, should that not also extend to Twitch chat?
I suggest allowing "mature content" streamers to:
- Turn off the global AI based AutoMod for their chat.
- Reduce global AI based AutoMod sensitivity for their chat. (at the very least)
As long as they have set their stream content classification properly to:
Mature-rated games; Sexual themes; Drugs, Intoxication, or Excessive Tobacco Use; Violent and Graphic Depictions; Significant Profanity or Vulgarity; or Gambling. https://safety.twitch.tv/s/article/Content-Classification-Guidelines?language=en_US
Being able to discuss or joke about topics on screen of a sensitive nature is no longer possible in Twitch chat and streamers are seeing their most active chatters and supporters get permanently suspended for participating in completely consensual conversations.
I hope this can lead to further discussion regarding the matter.
Outsourcing moderation to AI, while it may save money, is not a good idea.
Hi, thanks for taking the time to share your feedback with us. We wanted to clarify a couple of things. AutoMod can’t ban people from Twitch. Mods can use the tool to identify chat messages that break their channel’s rules. But AutoMod can’t be used to timeout, ban, or mute users from any channel, or from Twitch – those aren’t AutoMod capabilities.
We also wanted to share a bit more about how we enforce our Community Guidelines. These are the policies that apply to all of Twitch, and help make Twitch safer. We have human teams that review our content moderation decisions. We call this “human in the loop.” These reviewers help ensure that our policies are being applied accurately. We don’t use a “global AI” system to enforce our guidelines, and we manually review suspension decisions.
We recognize that, while the majority of enforcements we issue are correct, sometimes we may get it wrong. If you feel an action taken against your account was not warranted, we recommend submitting an appeal through our appeals portal for our teams to review.
Again, thanks for sharing your experience. It’s important that we’re open about how we enforce our policies. It’s also on us to ensure that our enforcement decisions are accurate. Our teams issue and review content moderation decisions in real time for that reason.
-
darkershadow96
commented
This is such a dumb idea. Let streamers moderate their own chat. AI is not going to work here.
-
Phil8Show_
commented
Moronic idea, be better
-
FrostedFerrets
commented
If you don't want mature words used on your platform, stop allowing them on Twitch. Don't punish users for doing something on your platform that could be solved in a way that keeps your userbase/communities intact.
-
float_like_a_butterfly741
commented
Stop taking the easy way out Twitch. This does not work.
-
byterun
commented
Use code wubby on gamersupps
-
Du6e
commented
Free Senor
-
Wizzy01_
commented
this is horrible. just let streamers choose what words they want banned and just have it so those messages just dont get sent in the first place
-
BeardInMySoup
commented
Poor execution. Plenty of bans that aren't TOS and lack context.
-
Parscuit
commented
Free Senor
-
Steponaitis_
commented
I don't understand how something that is proven to have numerous faults and an inability to determine, account for or notice context; to be implemented. Twitch once again showing no common sense.
-
turrdle
commented
Global AI AutoMod is terrible. i would hope that the streamers i watch would move to a less oppressive platform unless twitch finds a better solution.
-
DickieWeedle
commented
What the **** are you doing twitch, you arent even looking at the appeals
-
Villainoftheyear
commented
Clown behavior idea
-
creativename75
commented
Yea this is a terrible idea, why did this even get brought to the table?
-
bone_apple_Pete
commented
AI mod is stupid. AI appeal reviews is abysmally stupid.
-
druzzdo
commented
AI modding... terrible idea
-
johnlonghorn
commented
Ridiculous
-
rawWwRrr
commented
AI cannot understand communication as diverse as it is found in Twitch chat to understand the context to correctly determine whether moderation is warranted or not, especially when that language is in reaction to something happening on stream in real time. Worst idea ever to hand off moderation efforts to AI.
-
Alkaline_Lemon
commented
Turn this off
-
Superfry666
commented
Wubby7