Changeset 33554

Show
Ignore:
Timestamp:
09.10.2019 18:11:19 (8 days ago)
Author:
ak19
Message:

Added more to blacklist and greylist. And removed remaining duplicates from topsites list. Committing that before changing the top sites listing's URL patterns again.

Location:
gs3-extensions/maori-lang-detection/conf
Files:
3 modified

Legend:

Unmodified
Added
Removed
  • gs3-extensions/maori-lang-detection/conf/sites-too-big-to-exhaustively-crawl.txt

    r33553 r33554  
    1 # URL blacklist 
    2 # FORMAT: 
    3 # precede URL by ^ to blacklist urls that match the given prefix 
    4 # succeed URL by $ to blacklist urls that match the given suffix 
    5 # ^url$ will blacklist urls that match the given url completely 
    6 # Without either ^ or $ symbol, urls containing the given url will get blacklisted 
     1# top sites - base url forms 
    72 
    83# Contains alexa top sites (where only the first 50 were visible) 
     
    441436wikimedia.org 
    442437wikipedia.org 
    443 wikipedia.org 
    444 wikipedia.org 
    445438wiktionary.org 
    446439wiley.com 
     
    457450yahoo.co. 
    458451yahoo.com 
    459 yahoo.com 
    460452yale.edu 
    461453yandex.ru 
     
    469461zendesk.com 
    470462 
    471  
  • gs3-extensions/maori-lang-detection/conf/url-blacklist-filter.txt

    r33531 r33554  
    1010.video-chat. 
    1111.videochat. 
     123chat.ru 
     13livevideochatting.org 
     14lovewebcam.net 
     15 
     16cherrybabe.biz 
     17dreamsbabes.com 
     18adultfantasyboutique.com 
     19adultterra.com 
    1220 
    1321leatherdyke.porn 
    1422hornyteenharlots.com 
    1523adultviewsex.com 
     24adultsexualvideo.com 
     25ctbererotica.sexe-traque.com 
     26cybererotia.porn234.com 
     27cybereroticz.adultsupermart.com 
     28freegaywebcams.info 
     29lesbiansinmysoup.com 
     30videopornoxx.online 
     31sexandplay.com 
     32sexynakedselfies.info 
     33barebabez.com 
     34britnudes.net 
     35camaporno.com 
     36webxvideo.com 
     37gayspornosex.com 
     38jasminreviews.com 
     39sexchatlines4u.com 
     40sexybabeworld.org 
     41sexyleaks.info 
     42uniqueporno.com 
     43wildsexsluts.com 
     44xxxblacknudes.com 
    1645 
    1746# sounds like some pirating site 
  • gs3-extensions/maori-lang-detection/conf/url-greylist-filter.txt

    r33550 r33554  
    1313/product-page/ 
    1414/product-category/ 
     15ledlamp.china-led-lighting.com 
     16ledpar64.china-led-lighting.com 
     17ledwallwasher.china-led-lighting.com