Changeset 33568 for gs3-extensions/maori-lang-detection/conf/url-blacklist-filter.txt

Timestamp:

2019-10-14T23:36:54+13:00 (5 years ago)

Author:

ak19

Message:

1. More sites greylisted and blacklisted, discovered as I attempted to crawl them and afterwards learnt to investigate sites first. Should all .ru and .pl domains be on the greylist? 2. Adjusted instruction comments in CCWETProcessor for compiling and running

File:

• gs3-extensions/maori-lang-detection/conf/url-blacklist-filter.txt (modified) (2 diffs)

gs3-extensions/maori-lang-detection/conf/url-blacklist-filter.txt

@@ -64 +64 @@
 wildsexsluts.com
 xxxblacknudes.com
+bigsexymelons.com
+
+# more adult sites
+acba.osb-land.com
 
 # sounds like some pirating site
 ^http://pirateguides.com/
+fastmp3.ru
 
 # from alexa topsites at https://www.alexa.com/topsites
@@ -76 +81 @@
 xhamster.com
 xnxx.com
+
+
+# not sure about the domain name and/or full url seems like it belongs here
+abcutie.com