multiple audio channels
Streams should be able to encode audio into separate audio channels, so that users can independently mix/select audio for each channel. For example, one channel could be music, another could be the streamer's voice, and another for the game/application's audio. In this example, if you were already playing music that you wanted to listen to, you could disable the streamer's music. Or, if you have trouble hearing the streamer's voice, you could turn that up. Or, if you don't want to hear the streamer or music, you could mute them and just listen to the game. I think it would also have a secondary benefit that you could independently remove audio channels in cases of copyright violation, so that the rest of the vod is still good even if there happened to be flagged music on one channel.

-
Atomic_Flower commented
Sometimes when watching a streamer play a game, I can't hear their voice. I am hard of hearing so to be able to turn down the game volume or turn up the streamer's voice volume would help tremendously. I do think it should be up to the streamer to implement this feature. The volume may be fine for others but not for everyone.
-
nextgentoas commented
It would be amazing if there was a plugin that differentiates the music from the actual volume of the stream. In this way you can still watch the stream but you can listen to your own music. I haven't wachted streamers numerous times because i found their music really bad.
If you were watching a game you would still hear the streamers voice and the sounds of the game but not the music. In this way you can either choose your own music or that of the streamer.
-
jony_fulcos commented
Hola gente de www.twitch.tv, ayer estaba mirando un stream, y el streamer dijo "voy a poner esta canción pero me va a saltar copyright"
Entonces se me ocurrió la idea de que podrían agregar a la plataforma una opción que obligatoriamente el streamer separe la pista de música ya sea (Spotify o su reproductor de música) para que las personas que lo estén viendo puedan apagar la música con un botón y seguir escuchando a su stremer favorito.
Esto lo sugiero por que hay muchas personas que ayudan a su Streamer favoritos a subir momentos importantes a otras plataformas, entonces evitarían problemas de copyright.
-
embrs commented
after viewing NMP streams i think it would be cool if streamers could split TTS to another audio track too, so I can lower/mute it and not have to listen
-
necauqua commented
The year is 2035.
Twitch still did not implement the feature that would allow VOD friends to hear what the streamer is saying despite the entire stream being muted by copyright claims, or to control/mute the background music (or the streamer) - that Twitch already has all the infrastructure for, since RTSP has that and OBS has complete support for multiple audio tracks as well.
-
Bucketsmith commented
Implement streaming with multiple, separate audio tracks.
This is all going to sound more complicated and advanced than it really is, so bear with me as I explain it.
Summary:
Viewers would have a single volume slider in the same way as it has always been implemented. It functions as a 'master volume'.
When clicked on a button, an 'audio control panel' would open.
This panel would show multiple volume sliders. One for each audio source or 'track' that the viewer is hearing, and that the streamer is uploading.
One for music, one for streamers' voice/microphone, one for game audio, one for voicechat, etc.Background:
'Tracks' in this context means the datastream inside the complete file(container) as it is being sent to Twitch.
A container file (mp4, mkv, mov, etc) contains at least one video track and one audio track, but it *can* contain many more. Think of it as a zipfile.
For example, when you download legitimate films, some videos(which are container files) have a video, audio and subtitle text file as a datastream inside the container. That is why you would see subtitles automatically play in those videos.The technology is already possible and partially implemented by way of the 'VOD track' option in Twitch and capture software. (You select which audio is put into a second audio track, and only that track is used by Twitch servers to make your VOD, as opposed to your livestream.)
This feature gives several benefits for all parties involved, that offset the relatively marginal increase in throughput data for Twitch. I say marginal, because audio data is much smaller than video data.
Example usecases:
A. A viewer plays a recently released, popular game. They frequently watch a specific streamer that is streaming the same game.
The streamer gives commentary on the game, similar to a podcast.
The viewer does not wish to spoiler themselves on the game, but still wishes to hear their thoughts and opinions on the game.
They can mute game audio, but keep hearing the streamer, whilst the viewer keeps playing the game simultaneously.B. A streamer is not as tech savvy and is having audio balancing issues.
Viewers are having a lot of trouble hearing the streamer clearly , since the game audio or music drowns out their voice. Or the volume on alerts is shockingly loud.
Viewers can raise the volume of the streamer's voice, and/or lower the volume of the game/music/alerts.C. A viewer wants to see gameplay of a specific game, possibly a popular newly released game.
The viewer is not interested in the commentary of the streamer, and they find it hard to search for a streamer to their liking.
The viewer mutes the streamers voice, and keeps the game audio on.D. A streamer is playing a game and has music on.
A viewer enjoys the streamer and their gameplay, but not the music.
The viewer can mute the music but keep the rest intact.The rundown:
- Streamers get more control over how their audio comes into the stream for their viewers
In a general sense, being able to give more customizable audio experience to viewers minimizes audio issues and annoyances and improves service and community growth
- Removing and managing problematic copyrighted audio becomes much easier
Especially when properly set up on separate track in streaming/capture software, assuming fair usage, emphasis can lie on the specific track(s) that have issues.
- Removing copyrighted audio does not compromise the other audio tracks E.g. mic/self-voice, game audio, voicechat will not have to be muted or altered and it becomes much more straight forward to mute portions of the selected tracks, and can even pave the way to be able to edit in replacement audio.
This applies to both livestream and VODs.
- Viewers get more control over how their audio is managed
Viewers can customize their own experience and streamers become less dependent on the broad availability of different viewer audio setups.
If viewers can get more control over the audio, there are less frustrations for all parties involved.
If a game is too loud, viewers no longer have to complain to the streamer in most cases. Streamers would currently have to pause what they are doing and this stops the flow of entertainment. With this suggested development, these moments become much rarer as viewers can mitigate the issue themselves.
- Viewers can selectively turn off(zero volume) an audio track that the streamer is uploading
For example, to turn off the music the streamer is putting out, or selectively turning on or off microphone, game audio and voice chat audio when watching a multi-stream.
- Opens up a possibility for more behind-the-scenes data/telemetry
This gives streamers more insight and feedback on how viewers experience the stream's audio setup by seeing when and what tracks viewers control/mute.
- Paves the way for game developers to give the option to output multiple audio tracks as well
To further control audio levels, and fight problematic copyrighted mus -
bjorn_the_red commented
Bump! Many streamers would say "Listen to our music if you want to be a part of our community", but if this is an *optional* feature, it wouldn't prevent them from enforcing that - and would open other streamers to making their own music optional.
It would be up to the streamer to allow or not allow to mute the music.
Additionally, an extended version of this would let the viewer choose the volume of each channel the streamer defines - no more "the game is too loud" or "the mic is too quiet" - each viewer would be able to adjust that themselves.
And if the mic was broadcasted in a separate channel, it'd allow automatic transcription for the deaf and hard-of-hearing people, which would not work otherwise.
-
ActorAaronBooth commented
I am constantly thinking about this idea and considering Twitch already allows streamers to have music and other audio on a separate track (so copyrighted music doesn't play on VODs and clips), why not simply allow a toggle for the viewer to only hear the one feed like VOD-mode audio or something). When I am trying to mod multiple streams at once, I usually have to mute all but one because 2-3 songs playing over each other at the same time just makes it pointless. Being able to cut the music from all of the streams I have open and only hearing the streamer's voice would be unbelievably helpful, especially since the system already allows streamers to split the audio. Even if it was just a mod-view only feature (at least at first) it would greatly help those that keep chats on the site a safe place. It's something that would be so easy for Twitch to implement that I'm actually surprised it has yet to be done.
-
VerbittertesGemurmel commented
I want to add to this idea: Whenever I watch a streamer who is playing the same game as I am I'd like to be able to mute their ingamesound channel. Same principle. The ingamesound of the streamer can be confusing if you play along. But I'd really like to be able to listen to their commentary.
-
zefcowboy commented
If the streamer could also have a separate audio channel for music that would allow viewers to switch off the streamers music if they wanted to. For example sometimes the user wants to watch a stream but listen to his own music, or the user wants to play a bit of guitar whilst watching a stream.
-
Ka11zer commented
I don't think obs lets you stream multi channel audio
-
httpStatusOK commented
I would definitely spend more time on twitch. It happened many times, when I close the stream only because music was incompatible with my taste.
-
TheLigmaFoundation commented
I have a problem where I get a song stuck in my head for literally days. I'd like to be able to watch streams and mute the music as you suggest. This is by far and away the biggest feature request I have.
-
MEGA_R6 commented
Integrate Spotify or another music app with a wide range of songs within the stream so users can adjust its volumen independently from the game or voice of the streamer.
-
sm0ke_d commented
Streamer have to put music in separate channel so I can optionally mute and unmute it by button.
If streamer config audio this way then new mute icon appears near normal mute. -
codiogo commented
Duplicate of https://twitch.uservoice.com/forums/923368-video-features/suggestions/38395720-multiple-audio-channels
I would upvote this as well, but Twitch limits voting..... asdf. -
solid__rl commented
Bump!! Could also be integrated with the existing music track DMCA stuff so that streamers don't get flagged unnecessarily
-
epic__1 commented
It would be great to be able to control the volumes of a streamers game volume, and caster separately. Example: ESL_CSGO their caster volume is loud and the in game volume is low.
-
MightyFish_ commented
+
was about to write exactly same thing. I enjoy watching streams while I'm playing myself but I prefer to play listening my own playlist, very often I have to make a choice - Spotify or Twitch.
It shouldn't be hard to implement such option (even if it would be a paid option like TwitchTurbo) since most of streamers steam music separately and they don't include it in VODs. -
KolliGaming commented
I think streamers should have option to stream audio channels seperately, so viewers could change their volume according to own preferences. Sometimes you just want to chill to music or focus on the game. Also sometimes it just plain hard to hear what streamers have to say if they have adjusted volume levels badly. I think there should be default volume levels adjusted by streamer and then you could change them