Changeset 33554


Ignore:
Timestamp:
2019-10-09T18:11:19+13:00 (5 years ago)
Author:
ak19
Message:

Added more to blacklist and greylist. And removed remaining duplicates from topsites list. Committing that before changing the top sites listing's URL patterns again.

Location:
gs3-extensions/maori-lang-detection/conf
Files:
3 edited

Legend:

Unmodified
Added
Removed

  • gs3-extensions/maori-lang-detection/conf/sites-too-big-to-exhaustively-crawl.txt

    r33553 r33554  
    1 # URL blacklist
    2 # FORMAT:
    3 # precede URL by ^ to blacklist urls that match the given prefix
    4 # succeed URL by $ to blacklist urls that match the given suffix
    5 # ^url$ will blacklist urls that match the given url completely
    6 # Without either ^ or $ symbol, urls containing the given url will get blacklisted
     1# top sites - base url forms
    72
    83# Contains alexa top sites (where only the first 50 were visible)
    … …  
    441436wikimedia.org
    442437wikipedia.org
    443 wikipedia.org
    444 wikipedia.org
    445438wiktionary.org
    446439wiley.com
    … …  
    457450yahoo.co.
    458451yahoo.com
    459 yahoo.com
    460452yale.edu
    461453yandex.ru
    … …  
    469461zendesk.com
    470462
    471 

  • gs3-extensions/maori-lang-detection/conf/url-blacklist-filter.txt

    r33531 r33554  
    1010.video-chat.
    1111.videochat.
     123chat.ru
     13livevideochatting.org
     14lovewebcam.net
     15
     16cherrybabe.biz
     17dreamsbabes.com
     18adultfantasyboutique.com
     19adultterra.com
    1220
    1321leatherdyke.porn
    1422hornyteenharlots.com
    1523adultviewsex.com
     24adultsexualvideo.com
     25ctbererotica.sexe-traque.com
     26cybererotia.porn234.com
     27cybereroticz.adultsupermart.com
     28freegaywebcams.info
     29lesbiansinmysoup.com
     30videopornoxx.online
     31sexandplay.com
     32sexynakedselfies.info
     33barebabez.com
     34britnudes.net
     35camaporno.com
     36webxvideo.com
     37gayspornosex.com
     38jasminreviews.com
     39sexchatlines4u.com
     40sexybabeworld.org
     41sexyleaks.info
     42uniqueporno.com
     43wildsexsluts.com
     44xxxblacknudes.com
    1645
    1746# sounds like some pirating site

  • gs3-extensions/maori-lang-detection/conf/url-greylist-filter.txt

    r33550 r33554  
    1313/product-page/
    1414/product-category/
     15ledlamp.china-led-lighting.com
     16ledpar64.china-led-lighting.com
     17ledwallwasher.china-led-lighting.com
Note: See TracChangeset for help on using the changeset viewer.