I keep "show moderation actions" turned on (adds ban/timeout/delete buttons next to names in chat) in the two channels I moderate.

The other day I accidentally banned someone while on the chat emote menu, with a simple jiggled-mouse misclick. Turns out the tiny sliver of ban button visible on the left side of the emote/bit panels works just fine.
I don't care whether I see it, I just don't think it should be usable. In my opinion, the only functional ban buttons should be ones with chat displayed next to them.
I can't imagine any reason a person would reasonably mean to ban someone behind there, when you can't see who's posting or what they said.

(Just in case it's relevant, I do most of my modding from my PC, browser is Firefox)