That's by design. This addon was meant to be simple and work similar to how muting a tab works. If you need to always mute certain sites, there are other addons that can do that.