I watched a streamer playing "Super Seducer" recently. Some of the things we, chat, were typing, OMFG, they look really bad out of context. But if you know what the streamer just said, and what was on screen, and what the character just said, it's perfectly understandable. But an automod would absolutely slay that person

This sounds like a really bad idea to let AI moderate to this extent...

Free Shoepert!

AI auto-mod should be opt-in or channel owner/mods should be allowed to overturn/petition the auto-modding.

Wow, this needs more attention, I know many people who got suspended because of this AI's sensitivity and Twitch needs to do something about it, like multiple accounts are being banned while they did not mean any serious violation. Dumb idea, Twitch. Be better.

There's value in the AI mod, but it should be channel-based bans and it should be opt-in or opt-out. There should be a way to turn off the AI mod. The AI mod doesn't know the context, it doesn't know what the steamer said. It is incredibly stupid to ban an account for a joke with no malicious intent.

People who have been banned say that they weren't given a clear indication of what exactly they were being banned for. So if you're too afraid to show people exactly what they're being banned for by the AI mod, why does the AI Mod have the power to ban accounts site-wide in the first place?

the jabroni_mike chat will turn into a desert if this goes through

I certainly agree with the conclusion here. There is no way for AI to accurately discern what is inappropriate, based on one or two sentences. I think the responsibility for moderating that type of content should rest solely with the channel's moderators. If nothing else, what appears to be improper posting should be brought to the attention of the channel before anything permanent is done.

Wow, this is not okay! I didn't realize that Twitch had a global auto mod in every channel that could take private action against viewers without the channel owner being notified. This would explain why some people have just disappeared and never came back in the middle of a conversation about something that could be seen as hitting one of these lack of context moments discussing important topics.

I will share this with my audience and ask them to upvote this so hopefully it gets Twitches attention. However, since it's a uservoice page and not a Twitch official page I doubt they will listen regardless of the number of signatures unless people start bombarding them on social media and official support channels.

If you have a manager for your partnered Twitch channel then please contact them and let them know that this isn't okay. If they feel something like this needs to exist then it needs to have humans at the helm looking at the video and making the call on context or at the very least employ a GPT trained on multiple lingual contexts that takes the closed captions said around the time of the chat the message and compares it in that reference frame with what was posted in chat to make the final call.

This is a terrible way to moderate the platform. The AI is missing a lot of important context, and is 100% going to wrongfully ban many people. Twitch, please let the moderators of each channel do their jobs.

this issue just happened to me, I am a fairly small creator with only 400 followers, but when I got an email explaining that my account's chat connection was "automatically temporarily flagged to prevent abuse" I logged into the appeal portal, but there was nothing to appeal, so I am at a loss for what my next steps could be.

doubt twitch will even look at this but I hope they do

I'd love to be as blunt as possible about my feelings towards this "feature" but I wont because I'm not a fan of getting banned for words not directed at any individual or group so you'll have to use your imagination: This is utterly redacted

A global "bot" would be nice. but a Global "AI" is not the answer. the tech is NOT at the stage where it can be reliable. assuming "reliable" is defined as an overly aggressive fail safe that bans people regardless of language nuance.

AI is STILL too far out for something to be helpful. we are talking tech that is at least 5 to 10 years in dev time. assuming we even have the Video cards to even process this data. even IF a company has this processing power to do this task, its going to cost way too much to do it now. A flagging bot that is managed by twitch staff is the current answer for what you need.

This website continues to make the most out of touch business decisions, it's almost like they want to kill the site off. If you want to make money, this is not how you do it.

Here it is:
"Spirit AI" using "proactive" technology. I fear this has backfired.
Quote from 2022 blog post:

"Fortifying the technology that detects harmful text of all kinds on Twitch.

We recently completed the acquisition of Spirit AI, a leading natural language processing company who will help us continue to refine AutoMod and other proactive detection for catching harmful text or phrases sent on Twitch."

https://safety.twitch.tv/s/article/An-Update-on-Our-Work-to-Stamp-out-Targeted-Hate?language=en_US

I was wondering why I got a 7 day ban randomly for unsolicited sexual advances. Seems making a joke about a 'twitch 7 day vacation' is now ban worthy. Appeal was denied in 20minutes after giving context so that might be from a bot too, or an employee who was active at 2am pst on a Saturday surely. Either way insane to think this is a global ban without any user triggering it. Or if users can trigger it you can target ban people making similar jokes even knowing the context. Why have automods ban keywords in chat if you can receive a global ban for it anyways? Just a dumb system

Using AI to automod is a catastrophically stupid idea. Let the moderators keep control of their chats, and if users are flouting the ToS, they can be reported and banned.

I find it inane that people are being banned automatically for comments that are perfectly fine in the context of the chat and/or the stream's culture (both of which operating within ToS, mind you), while a channel I moderate has a ban evading user with literally over 200 accounts who comes back within a minute of being banned. Several people have manually reported him, yet he's there every single stream.

Why are real bad actors allowed to exist, while innocent people are being banned by an automod that is incapable of understanding context? Are you trying to drive people toward Kick? I do not even have a Kick account, but developments such as this only encourage me to make one.

The queer community is one of the most targeted by this, nearly every week there is a person that has been banned from obviously something that isn't warranted. People are purposely reporting members of queer streams even when they know they are innocent, its purely being used in these communities as another way to harass and silence queer voices that are already diminished. It really does say something when a queer person gets banned for purely existing. Let mods dictate what is tolerable in communities and maybe focus on streamers and communities that harass those that aren't straight white men.

People have been abusing the automod to get innocent chatters banned. It does not understand context and the appeals process also is not very helpful. It should at least show the message that was reported and just not repeated Twitch ToS terms. I have seen at least 10 innocent chatters banned from abuse of the system. This includes 10 year old banned accounts from when we still had Justin.tv. These people are harassing accounts in LGBTQIA+ communities. What is the point of an AI moderator scanning chats with no context or intention when there are channel moderators in streams?? I'd honestly rather dodge homophobia and racism on Kick if this isn't fixed.

People will abuse this and have innocent chatters banned. They harass entire communities and they can't be stopped because of how easy it is to abuse this. Twitch can afford human mods to review these reports.