Can't import HUGE GIGANTIC blacklist. Help?

[Craig]

I have a HUUUUUUUUUUUUUUUUUUUUUUUUUUUUUUUUUUUUUUUUUUUUUUUUUUUUUUGE blacklist that I want to import, but I'm not sure how to get it in there. The JavaScript line was too big for Firefox to accept. Is there another way to import this list? Maybe through SQLite? Where are the list of sites physically stored in the Firefox settings?

I tried posting it here, but it's too big for your forums too I guess. So here's a snippit. The real thing is like this, but 2,500 lines long.

Code: Select all

pref('noscript.untrusted', 'fr.a2dfp.net m.fr.a2dfp.net ad.a8.net asy.a8ww.net acezip.net www.acezip.net phpadsnew.abac.com banners.absolpublisher.c'
                         + 'om tracking.absolstats.com adv.abv.bg bimg.abv.bg www2.a-counter.kiev.ua track.acclaimnetwork.com accuserveadsystem.com '
                         + 'www.accuserveadsystem.com gtb5.acecounter.com gtb19.acecounter.com gtcc1.acecounter.com gtp1.acecounter.com wgc1.acecoun'
                         + 'ter.com acestats.com www.acestats.com achmedia.com ads.active.com am1.activemeter.com www.activemeter.com ads.activepowe'
                         + 'r.net stat.active24stats.nl ad2games.com cms.ad2click.nl ads.ad2games.com as.ad611.com banner.ad.nu cl21.v4.adaction.se '
                         + 'www.adagencypro.com ads.adap.tv tag1.adaptiveads.com www.adbanner.ro vad.adbasket.net adbard.net web.adblade.com ad.pop1'
                         + '.adbn.ru ad.top1.adbn.ru ad.rich1.adbn.ru www.adblick.com adserv.adbonus.com www.adbonus.com james.adbutler.de www.adbut'
                         + 'ler.de adc2.adcentriconline.com adcp.adcentriconline.com bell.adcentriconline.com content.adcentriconline.com media.adce'
                         // ...
                         + 's.com isafeantivirus.com isaferantivirus.com isafe-antivirus.com isafeantivir.com isafeantiviruspro.com files.msas2009dl'
                         + '.com rusexportal.com traff.asia');

[Tom T.]

Where are the list of sites physically stored in the Firefox settings?

In your profile, in prefs.js file. You should edit that only with all instances of Firefox closed -- and make a backup copy first, just in case. A damaged file will cause problems.

Find user_pref("noscript.untrusted". You don't need any JavaScript to edit this; just edit it as you would any other text file.
Be sure to leave exactly one blank space between entries.

I'm not aware of any size limit on the prefs.js file.

Let us know if this works for you.

[craig]

That's what I'm saying I tried already. It didn't work.

I tried the user prefs.js. I tried the global all.js. I tried the plugin's very own prefs.js. And I've tried using a config file (which uses the defaultPref() function).


Here is the full list: http://xp.xpdnc.org/temp/noscript_blacklist.js

[therube]

You do realize that all of those sites are by default already "blocked".
(That all sites, except for a given few, are blocked unless you specifically Allow a site.)
It is only a UI "issue" (if you will) that you will see them as "available" to be Allowed.

but 2,512 lines long, 3467,738 characters or so

All those entries need to be on a single line.

I see. That is formatted to be re-imported.
Worked here. Took about 2 minutes to import on my end.
Left me with quite a sizable prefs.js.


Now does it do anything?
I may have imported it incorrectly. But if not, then I think it is being loaded to the wrong place.
It is loading into capability.policy.maonoscript.sites, where it looks like it should be in noscript.untrusted (I think).


And is it feasible?
Opening NoScript Options now takes a couple minutes (going as I'm typing so I'll have to see if it finally loads - yes).


Appears the list should be one domain per line proceed by an [UNTRUSTED] tag at the beginning of the section.

Code: Select all

[UNTRUSTED]
0.r.msn.com
005.free-counter.co.uk
006.free-counter.co.uk
008.free-counter.co.uk
008.free-counters.co.uk
00fun.com
032439.com
061606084448.c.mystat-in.net
08search.com
090906042103.c.mystat-in.net
092706152958.c.mystat-in.net
093qpeuqpmz6ebfa.com
098765.com
0d7292.r.axf8.net

Maybe it has to do with the multiple Import/Export boxes?

Looks like depending on what format the IMPORT is in & depending upon which IMPORT button you click determines where (into which Preference) the imported data is stored.

It is certainly confusing (me).

I believe your ".js" file will not import via the Whitelist Import button.
But will import via the "global" Import button.
And with that it gets put (incorrectly for what you would want) into capability.policy.maonoscript.sites.

If you have an Exported list, via the Whitelist Export button (so that othere is one domain per line)
Then a subsequent Import, again via the Whitelist Import button proceeds much faster.

(My naming may be incorrect, but ...)

[craig]

I understood that all of these sites are already blocked by default. The idea here was that I didn't want the little yellow bar showing up every time. For the same reason that Vista and Windows 7's UAC thing is a load of crap, actually: it's bad policy to get users in the habit of clicking "OK" or "allow" or "yes" to any and all security prompts. NoScript unintentionally encourages this behavior by blocking everything, much in the same way that UAC does.

So I'd rather have all of those sites already put into the untrusted category so that users aren't asked what to do with them.


I'll do some toying around with the import feature. I have all of those sites in an array so I can quickly change them all to be on a new line or format a new import file however I want. Hopefully once it goes, I don't experience the sluggishness that you're talking about. That would be unfortunate.

[Tom T.]

I understood that all of these sites are already blocked by default. The idea here was that I didn't want the little yellow bar showing up every time.

That's easy. NoScript Menu > Options > Notifications > Uncheck "Show message about blocked scripts." OK > done. You'll never see the little yellow bar again.

You''ll still know that things that are not in your Untrusted list are being blocked, by the color change of the NS logo from blue to partially red or all red, It's there for you, but not nearly so distracting as the pop-up bar. FWIW, I agree with you, and disabled it on mine.

For the same reason that Vista and Windows 7's UAC thing is a load of crap, actually: it's bad policy to get users in the habit of clicking "OK" or "allow" or "yes" to any and all security prompts. NoScript unintentionally encourages this behavior by blocking everything, much in the same way that UAC does.

Agree here also, as regards UAC. Once you've disabled the pop-up, the only way they'll be visible is if the user opens the NS menu -- which is useful if you ever change your mind and want to allow, or temporarily allow, a non-whitelisted script. So putting the entire world in the Untrusted list isn't necessary.

The only area of difference is that the NoScript Quick Start Guide and NoScript FAQ do *not* encourage users to allow every prompt; on the contrary, these guides warn users to be wary of third parties, ad agencies, unknown sites and script sources, etc.

So I'd rather have all of those sites already put into the untrusted category so that users aren't asked what to do with them.

I'll do some toying around with the import feature. I have all of those sites in an array so I can quickly change them all to be on a new line or format a new import file however I want. Hopefully once it goes, I don't experience the sluggishness that you're talking about. That would be unfortunate.

I'm hoping that with the above changes, you won't need to import the entire huge list. If there's anything else that would make it more to your taste, please leet us know. It's pretty customizable. Cheers.