anudeepnd / whitelist Goto Github PK

bethesda.net is incorrectly blocked on this list
Match found in https://raw.githubusercontent.com/CHEF-KOCH/Canvas-fingerprinting-pages/master/Canvas.txt:

Bethesda is a legit gaming company - https://en.wikipedia.org/wiki/Bethesda_Softworks

I think that bethseda.net is the domain that should be blocked instead (s and e transposed)?

Thanks

Matt

https://discourse.pi-hole.net/t/commonly-whitelisted-domains/212

This domain interferes with the facebook messenger app, at least on the iPhone.

The above domain is responsible for all the images on aliexpress.com. Before whitelisting it, I couldn't see any image, after that all image appeared.

Hi @anudeepND

https://www.ucas.com/ is the UK University application website, and track.ucas.com is the section for students to follow their application.

It matches the regex.list entry ^track(ers?|ing)?[0-9]*[-.] by https://github.com/mmotti/pihole-regex that I've implemented.
Thanks
Matt

Theses hosts are in https://hosts-file.net/ad_servers.txt, but they need to be accessed to watch something on amazon prime video.

Could you add them ? (fls-eu.amazon.com and fls-na.amazon.com )

tradetracker.net is used by the referal site https://www.cashbackxl.nl/

In the whitelist, there is a non-breaking space at the end of line 154 for s2.youtube.com

s2.youtube.com

This causes issues when using Teleporter to import a backup with this line in its whitelist.

Found in https://reddestdream.github.io/Projects/MinimalHosts/etc/MinimalHostsBlocker/minimalhosts (on first block of v.firebog.net)

This is not tracking, but https://en.wikipedia.org/wiki/Online_Certificate_Status_Protocol server

Match found in https://hosts-file.net/emd.txt:
openload.co
www.openload.co

Airthings Dashboard for the Wave Radon detector appears to require https://cdn.ravenjs.com, it was blocked by some common lists.

Blocking this domain seems to be crashing GTAOnline on PC since March, unblocking the domain fixed it for people at GTAForums and my mates plus myself.

prod.telemetry.ros.rockstargames.com

It is in NoTrack from https://firebog.net/.

Hello,

I noticed today that one of my podcasts has not been updated in some time. Looking into it more it seems that it was unable to contact the server. After whitelisting feeds.feedburner.com, the podcast was able to update again. Perhaps this is a false positive?

The site res.cloudinary.com is used for image distribution. It is blocked by the following on my PiHole

Exact matches for res.cloudinary.com found in:
https://adblock.mahakala.is
https://hostsfile.mine.nu/hosts0.txt
https://tspprs.com/dl/cl1
https://tspprs.com/dl/phishing

White-listing it allowed for the images on (in my case) bookings.gatwickairport.com to be shown correctly. Please can you confirm and white-list if appropriate?

Thanks

Matt

Hello,

Would you consider adding pro.fontawesome.com and use.fontawesome.com to your whitelist? I have issues with them being blocked at https://github.com/jawz101/MobileAdTrackers/issues/5

I just tried running your script on a fresh CentOS 7 OS. This fails (or does not run de deduplication part of the script) because gawk is an old version on CentOS (and is not updated yet in the repositories). this means that gawk -i inplace '!a[$0]++' /etc/pihole/whitelist.txt will not run or work.

I have figured out that running awk '!seen[$0]++' /etc/pihole/whitelist.txt does work however. Maybe you can use this in the script for all distributions or add an if/switch for CentOs?

the following domains are needed for netflix to working correctly

can you please add this to optional-list.txt

api-global.netflix.com
ichnaea.netflix.com
appboot.netflix.com
secure.netflix.com

Adding partners.webmasterplan.com to the whitelist fixed mydealz.de for me.
Maybe this could be an addition ?

Thanks !

$ pihole -q hosts-file.net
Match found in list.18.adblock.mahakala.is.domains:
hosts-file.net

I had to whitelist the following domain in order to watch videos on the Amazon Firestick Adult Swim app:
amd.cdn.turner.com

It is blocked in one of the default pi-hole lists:
https://raw.githubusercontent.com/StevenBlack/hosts/master/hosts

Ran through the referrals.txt whitelist and some are still blocked. Found out that I needed to add www. in front of the domain that was blocked. In addition, found that cj.dotomi.com was another domain that Slickdeals linked to. Forked the text file and added changes. Let me know if you can't see them.

need to whitelist npr-news.streaming.adswizz.com if you want to listen to the morning news podcast

fyi this will play sponsor clip before your news

Match found in https://raw.githubusercontent.com/StevenBlack/hosts/master/hosts:
npr-news.streaming.adswizz.com

Hi there!

I've used your whitelist as a starting point to be customized, thanks for it!

I've found those additions as quite useful in my environment (generic services, MS Office 365 related domains, plugins and cdns used by many websites), maybe they are useful also to others.

Thanks!
Nicolò

google.com
yahoo.com
microsoft.com
skype.com
uservoice.com
linkedin.com
reddit.com
vimeo.com
youtube.com
pinterest.com
facebook.com
wordpress.com
wp.com
github.io
github.com
bing.com
wikipedia.org
facebook.net
fbcdn.net
t.co
twimg.com
gstatic.com
google-analytics.com
googletagmanager.com
googlesyndication.com
googleadservices.com
office.com
office.net
microsoftonline.com
onedrive.com
outlook.com
sharepoint.com
live.com
onmicrosoft.com
onestore.ms
gfx.ms
sfx.ms
aspnetcdn.com
s-microsoft.com
office365.com
microsoftonline-p.com
msocdn.com
akamaihd.net
akamaized.net
jquery.com
crisp.chat
tawk.to
drift.com
driftt.com
intercom.io
leadchampion.com
trialfire.com
amazonaws.com
imgix.net
sumome.com
sumo.com
bufferapp.com
filament.io
sharethis.com
addthis.com
unsplash.com
cloudfront.net
criteo.net
criteo.com
hotjar.com
onesignal.com
getsitecontrol.com
jsdelivr.net
openx.net

Hello, requesting addition:

ota-downloads.nvidia.com

Without it, nvidia shield tv (and probably other nvidia devices) can't download updates.

When typing into YouTube, search suggestions usually pop up as you're typing. Unfortunately, a lot of block lists (two of them from Wally's site actually) has

clients1.google.com

In the list. While I'm sure there is more to this domain, one of its functions is search suggestions. Feel free to add this one to the optional lists (or global ones) if you wish.

xkms.xbolive.com should be xkms.xboxlive.com

I had to whitelist dev.virtualearth.net in order to select a store location on costco.com. It appears to be related to Bing maps. I found it blocked in the WIndowsSpyBlocker list along with a few other Virtual Earth domains that may need to be unblocked as well.

dev.virtualearth.net
ecn.dev.virtualearth.net
t0.ssl.ak.dynamic.tiles.virtualearth.net
t0.ssl.ak.tiles.virtualearth.net

cf-st.sc-cdn.net should be whitelisted, since it is required for Snapchat stories and picture embeds to load.

Hi, please can you add www.synology.com to the whitelist - needed for Synology NAS

Match found in https://v.firebog.net/hosts/Airelle-trc.txt:
www.synology.com

Thanks

Matt

PS Love your work - appreciated

click.linksynergy.com is used for some ebates sites.

I had to whitelist this domain in order to download a pdf attachment from Facebook messenger.
cdn.fbsbx.com

Initial Googling of the domain screams "virus," but I'm not so sure that's the case.

pihole -q secure.avangate.com
Match found in Whitelist (Added it manually now because needed to do payment)
secure.avangate.com
Match found in list.49.tspprs.com.domains:
secure.avangate.com

I think i got this block list from
https://github.com/StevenBlack/hosts

archive.org and web.archive.org are both blocked by the tspprs list. So it would be nice to have on the whitelist script

In optional-list.txt you add the site company and that give a much better overview then in referral-sites.txt & whitelist.txt.

It would be nice if you can create the lists in the better format so we know which sites are for that domain

unable to login to the web client of groupme (https://web.groupme.com/signin) without first whitlisting: d2wy8f7a9ursnm.cloudfront.net
-- | --

First off thanks for giving me the idea to store my White List for Pihole on GitHub.

I copy pasted your curl command into my GitHub page and it did not work as I expected. I expected it to overwrite my old whitelist.txt file

What it actually did was append the list to my old list and doubled the size with the same info I had before.

In your curl command at the end is " >> /etc/pihole/whitelist.txt " # this appends the text to the end

I had to change mine to " > /etc/pihole/whitelist.txt " # this overwrites the whole file

your's >>

mine >

Your whitelist will get huge if you do this often.

This domain is for the Akamai CDN.

HI
To see video's on news site www.nos.nl we need static.chartbeat.com as whitelisted.

Thanks for the good work!
Jack

The sort part in whitelist.sh's duplicate remove part returns an "error" shown in the image below.

The tests we perform as individuals with out knowing what lists a Pi-hole user has on a blocklist or whitelist and weather they want to make it Public?

I test my lists locally first with what I have been able to find and run a Yacy Search Engine to crawl a site to depth of 6.

I had a Google blackout. see https://discourse.pi-hole.net/t/do-we-need-a-developer-blocklist-for-individuals-who-maintain-lists/5381
The ripple effect like a bolt of lightning.
I have Whitelisted and published back to github in a record of 11 mins of me knowing about it.

#I used most of @WaLLy3K lists on my first list attempt. I have a second list.

Found in some android tracking blocklists, it's also google allo/hangouts endpoint: https://github.com/avaidyam/Parrot/wiki/Allo-Endpoints

Can edge-mqtt.facebook.com be added to the whitelist? If this domain is blocked, Messenger will act up, and refuse to connect.

In commit 6f2a16c you moved some domains to another list, but the current bash-script doesn't remove these domains from Pi-hole.

I know this is hard to implement but I think this is something to take into account when adding/removing domains ;)

Kind regards.

I've come across a few referral domains that I thought you might want. These are mainly from using Pricerunner and Google:

#Pricerunner redirect
clk.tradedoubler.com
tc.tradetracker.com
track.adform.net
track.webgains.com

#CDON redirect (don't remember, either from marketing email or one of the two other categories)
solutions.tradedoubler.com

#Google shopping redirect
ad.atdmt.com
clickserve.dartsearch.net

"cdn.samsungcloudsolution.com" is on the pi hole's default blocking list.

Recent Samsung TVs stop network if this domain is unaccesible.

https://www.reddit.com/r/pihole/comments/9fmudp/getting_prime_video_to_work_with_samsung_smart_tv/

According to that Reddit post, the following URL needs to be whitelisted for Samsung TV's Amazon Prime Video app.
time.samsungcloudsolution.com

Hello.

I'm not using your list. I googled for known pihole whitelists and reddit with your link came on top.

I've been running pihole for about 6 months now, with lots of black lists. We have about 100 people everyday on workstations using pihole's dns.

Time to time I need to whitelist something.
I noticed my whitelist file is getting rather large, thus went googling for some trusted whitelist that everybody can benefit from.

All this to say: here! have my whitelist, it may help you!

wl.txt

I have no structure, no comments, no optional. It was built as needed. Every time a needed site is not displaying correctly, there I go, open F12, see what links are being blocked and whitelist one by one until it works. (normally external js are the problem)

do i have to update the list to download the git every time or is it enough to just run the whitelist.sh?

Hi!

Adf.ly and www.adf.ly are listed in the whitelist. Shouldn't these two be listed in the optional-list.txt instead?

Thank you!