multiple audio channels
Streams should be able to encode audio into separate audio channels, so that users can independently mix/select audio for each channel. For example, one channel could be music, another could be the streamer's voice, and another for the game/application's audio. In this example, if you were already playing music that you wanted to listen to, you could disable the streamer's music. Or, if you have trouble hearing the streamer's voice, you could turn that up. Or, if you don't want to hear the streamer or music, you could mute them and just listen to the game. I think it would also have a secondary benefit that you could independently remove audio channels in cases of copyright violation, so that the rest of the vod is still good even if there happened to be flagged music on one channel.
-
Bucketsmith commented
Implement streaming with multiple, separate audio tracks.
This is all going to sound more complicated and advanced than it really is, so bear with me as I explain it.
Summary:
Viewers would have a single volume slider in the same way as it has always been implemented. It functions as a 'master volume'.
When clicked on a button, an 'audio control panel' would open.
This panel would show multiple volume sliders. One for each audio source or 'track' that the viewer is hearing, and that the streamer is uploading.
One for music, one for streamers' voice/microphone, one for game audio, one for voicechat, etc.Background:
'Tracks' in this context means the datastream inside the complete file(container) as it is being sent to Twitch.
A container file (mp4, mkv, mov, etc) contains at least one video track and one audio track, but it *can* contain many more. Think of it as a zipfile.
For example, when you download legitimate films, some videos(which are container files) have a video, audio and subtitle text file as a datastream inside the container. That is why you would see subtitles automatically play in those videos.The technology is already possible and partially implemented by way of the 'VOD track' option in Twitch and capture software. (You select which audio is put into a second audio track, and only that track is used by Twitch servers to make your VOD, as opposed to your livestream.)
This feature gives several benefits for all parties involved, that offset the relatively marginal increase in throughput data for Twitch. I say marginal, because audio data is much smaller than video data.
Example usecases:
A. A viewer plays a recently released, popular game. They frequently watch a specific streamer that is streaming the same game.
The streamer gives commentary on the game, similar to a podcast.
The viewer does not wish to spoiler themselves on the game, but still wishes to hear their thoughts and opinions on the game.
They can mute game audio, but keep hearing the streamer, whilst the viewer keeps playing the game simultaneously.B. A streamer is not as tech savvy and is having audio balancing issues.
Viewers are having a lot of trouble hearing the streamer clearly , since the game audio or music drowns out their voice. Or the volume on alerts is shockingly loud.
Viewers can raise the volume of the streamer's voice, and/or lower the volume of the game/music/alerts.C. A viewer wants to see gameplay of a specific game, possibly a popular newly released game.
The viewer is not interested in the commentary of the streamer, and they find it hard to search for a streamer to their liking.
The viewer mutes the streamers voice, and keeps the game audio on.D. A streamer is playing a game and has music on.
A viewer enjoys the streamer and their gameplay, but not the music.
The viewer can mute the music but keep the rest intact.The rundown:
- Streamers get more control over how their audio comes into the stream for their viewers
In a general sense, being able to give more customizable audio experience to viewers minimizes audio issues and annoyances and improves service and community growth
- Removing and managing problematic copyrighted audio becomes much easier
Especially when properly set up on separate track in streaming/capture software, assuming fair usage, emphasis can lie on the specific track(s) that have issues.
- Removing copyrighted audio does not compromise the other audio tracks E.g. mic/self-voice, game audio, voicechat will not have to be muted or altered and it becomes much more straight forward to mute portions of the selected tracks, and can even pave the way to be able to edit in replacement audio.
This applies to both livestream and VODs.
- Viewers get more control over how their audio is managed
Viewers can customize their own experience and streamers become less dependent on the broad availability of different viewer audio setups.
If viewers can get more control over the audio, there are less frustrations for all parties involved.
If a game is too loud, viewers no longer have to complain to the streamer in most cases. Streamers would currently have to pause what they are doing and this stops the flow of entertainment. With this suggested development, these moments become much rarer as viewers can mitigate the issue themselves.
- Viewers can selectively turn off(zero volume) an audio track that the streamer is uploading
For example, to turn off the music the streamer is putting out, or selectively turning on or off microphone, game audio and voice chat audio when watching a multi-stream.
- Opens up a possibility for more behind-the-scenes data/telemetry
This gives streamers more insight and feedback on how viewers experience the stream's audio setup by seeing when and what tracks viewers control/mute.
- Paves the way for game developers to give the option to output multiple audio tracks as well
To further control audio levels, and fight problematic copyrighted mus -
bjorn_the_dead commented
Bump! Many streamers would say "Listen to our music if you want to be a part of our community", but if this is an *optional* feature, it wouldn't prevent them from enforcing that - and would open other streamers to making their own music optional.
It would be up to the streamer to allow or not allow to mute the music.
Additionally, an extended version of this would let the viewer choose the volume of each channel the streamer defines - no more "the game is too loud" or "the mic is too quiet" - each viewer would be able to adjust that themselves.
And if the mic was broadcasted in a separate channel, it'd allow automatic transcription for the deaf and hard-of-hearing people, which would not work otherwise.
-
ActorAaronBooth commented
I am constantly thinking about this idea and considering Twitch already allows streamers to have music and other audio on a separate track (so copyrighted music doesn't play on VODs and clips), why not simply allow a toggle for the viewer to only hear the one feed like VOD-mode audio or something). When I am trying to mod multiple streams at once, I usually have to mute all but one because 2-3 songs playing over each other at the same time just makes it pointless. Being able to cut the music from all of the streams I have open and only hearing the streamer's voice would be unbelievably helpful, especially since the system already allows streamers to split the audio. Even if it was just a mod-view only feature (at least at first) it would greatly help those that keep chats on the site a safe place. It's something that would be so easy for Twitch to implement that I'm actually surprised it has yet to be done.
-
VerbittertesGemurmel commented
I want to add to this idea: Whenever I watch a streamer who is playing the same game as I am I'd like to be able to mute their ingamesound channel. Same principle. The ingamesound of the streamer can be confusing if you play along. But I'd really like to be able to listen to their commentary.
-
zefcowboy commented
If the streamer could also have a separate audio channel for music that would allow viewers to switch off the streamers music if they wanted to. For example sometimes the user wants to watch a stream but listen to his own music, or the user wants to play a bit of guitar whilst watching a stream.
-
Ka11zer commented
I don't think obs lets you stream multi channel audio
-
httpStatusOK commented
I would definitely spend more time on twitch. It happened many times, when I close the stream only because music was incompatible with my taste.
-
TheLigmaFoundation commented
I have a problem where I get a song stuck in my head for literally days. I'd like to be able to watch streams and mute the music as you suggest. This is by far and away the biggest feature request I have.
-
MEGA_R6 commented
Integrate Spotify or another music app with a wide range of songs within the stream so users can adjust its volumen independently from the game or voice of the streamer.
-
sm0ke_d commented
Streamer have to put music in separate channel so I can optionally mute and unmute it by button.
If streamer config audio this way then new mute icon appears near normal mute. -
codiogo commented
Duplicate of https://twitch.uservoice.com/forums/923368-video-features/suggestions/38395720-multiple-audio-channels
I would upvote this as well, but Twitch limits voting..... asdf. -
solid__rl commented
Bump!! Could also be integrated with the existing music track DMCA stuff so that streamers don't get flagged unnecessarily
-
epic__1 commented
It would be great to be able to control the volumes of a streamers game volume, and caster separately. Example: ESL_CSGO their caster volume is loud and the in game volume is low.
-
MightyFish_ commented
+
was about to write exactly same thing. I enjoy watching streams while I'm playing myself but I prefer to play listening my own playlist, very often I have to make a choice - Spotify or Twitch.
It shouldn't be hard to implement such option (even if it would be a paid option like TwitchTurbo) since most of streamers steam music separately and they don't include it in VODs. -
KolliGaming commented
I think streamers should have option to stream audio channels seperately, so viewers could change their volume according to own preferences. Sometimes you just want to chill to music or focus on the game. Also sometimes it just plain hard to hear what streamers have to say if they have adjusted volume levels badly. I think there should be default volume levels adjusted by streamer and then you could change them
-
embrs commented
This would be a great feature, its already implemented that the streamer can send a separate audio channel for music. It would be nice if the viewer could lower the music volume locally or mute it entirely if they want to play their own music instead
But why stop with that, having a voice and game stream would allow you to rebalance the audio. Maybe it provides feedback to the streamer if most of their viewers have game volume reduced that their audio levels might need fixing.
There would need to be incentive for the streamer to set this up, and there could be. What if this feature was tied to twitch turbo and available on channels you are subbed to. But the benefit for the streamer could be that either they get an extra 20% from a turbo viewer subbing or that being turbo subbed reduces the cost of subs by $1/£1 so that they are more likely to sub (streamer still gets the same amount for it), I think this could drive more sales of twitch turbo and that is also direct revenue reducing twitches dependance on ads. Is turbo not significantly better per viewer than the pennies twitch might get from an ad impression? This would mean turbo could give viewers a significantly better viewing experience
My biggest gripe with streams overall is it is hard for a streamer to get their audio right all the time, Id be happy to pay for a feature where I can fix it locally rather than hope the streamer notices while getting my ears blasted by endless explosions and gunfire in a game while they have their mic turned so low it could be an ASMR stream
If implemented there would be benefits for everyone, twitch, the streamer, but most importantly the viewer.
-
liquidfire00 commented
Exactly, not everybody have the same taste of music. Even being able to volume down the music that streamer wishes to listen, would be cool. We don't even need to choose the music on Twitch.
-
wtexasr commented
Hello, there is an idea with a choice of audio streams. In Dota2, commentators muffle the sound. It would be great if there were 2 threads with no commentators. The fact is that you can watch the stream with music. With two audio streams, you could watch the stream accompanied by music.
In the twitch player settings, add a choice of audio streams.
-
we_are_happy_plants commented
That would be awesome in full support widepeepoHappy!
-
Storyx commented
@kevinodoo, it doesn't, OBS just gives you the ability to send an audio track through a different channel which isn't recorded on the vod.