Just want to report that doing a full "Wipe Out And Reset" under "Settings" completely solved the memory leak/build-up issue! Some weird UI issues (affecting other Firefox addons as well) also disappeared after the reset.

(Hopefully more Firefox users are able to figure this out, or they might think it's an issue with a Firefox update & switch browsers... >.<)