It has to be in the address bar as the icon changes depending on the website you visit. This is not easily possible with regular toolbar icons.

Messing with other stuff on websites is a common problem. There is no way around this. Maybe you want to have a look at my other "Toggle website colors" Add-on which uses a Firefox builtin feature and often provides better results. But, of course, it will operate globally and not per tab.