Changeset 33531 for gs3-extensions/maori-lang-detection/conf/url-greylist-filter.txt

Timestamp:

2019-09-26T23:03:01+12:00 (5 years ago)

Author:

ak19

Message:

Added whitelist for mi.wikipedia.org, and updates to blacklist and whitelist based on alexa top sites. Alexa.com only makes the present top 50 publicly visible, but wikipedia at least lists some more from Alexa taken from end 2016.

File:

• gs3-extensions/maori-lang-detection/conf/url-greylist-filter.txt (modified) (2 diffs)

gs3-extensions/maori-lang-detection/conf/url-greylist-filter.txt

@@ -1 @@
-# URL 'greylist': save matching urls to one side, to eyeball later and confirm if they should
-# be included or skipped
+# URL 'greylist': save matching urls to one side, to eyeball later and decide if
+# they should be included after all or whether it was okay to have skipped them
 # FORMAT:
 # precede URL by ^ to greylist urls that match the given prefix
@@ -15 +15 @@
 
 # Add alexa top sites to greylist
+
+youtube.com
+tmall.com
+baidu.com
+qq.com
+sohu.com
+facebook.com
+taobao.com
+#login.tmall.com
+wikipedia.org
+yahoo.com
+360.cn
+jd.com
+amazon.com
+Sina.com.cn
+weibo.com
+#pages.tmall.com
+live.com
+vk.com
+netflix.com
+alipay.com
+office.com
+okezone.com
+csdn.net
+instagram.com
+xinhuanet.com
+babytree.com
+twitter.com
+ebay.com
+stackoverflow.com
+naver.com
+aliexpress.com
+twitch.tv
+tribunnews.com
+apple.com
+soso.com
+tianya.cn
+microsoftonline.com
+yandex.ru
+
+# Remaining top sites from https://en.wikipedia.org/wiki/List_of_most_popular_websites
+
+ok.ru
+paypal.com
+t.co
+pinterest.com
+sogou.com
+espn.com
+walmart.com
+bitly.com
+ampproject.org
+sm.cn
+
+
+
+# UNSURE - what if these contain translated pages?
+google.com
+bing.com
+amazon.co
+msn.com
+microsoft.com
+accuweather.com
+
+#nasa.gov
+# w3schools.com
+# quora.com
+#reddit.com
+#blogspot.com
+#yahoo.co.