Don't raid people who are not watching the stream they're coming from.
When ever I have paused a stream, and left the tab open. It has every single time been irritating when i am raided into a new channel. Sometimes i am on mobile and use up all my mobile data without knowing, sometimes I pause a stream and leave the PC before i go to bed, and then wake up because i've been raided into some stream. Or im inside a game and i don't know where the sound is coming from and have to go through my 20-30 some tabs in the middle of a game.
When I have paused the stream, from which i am being raided into a new one. I think almost no one enjoys that happening. Except perhaps the people who get some fake inflated views.