Changeset 33555 for gs3-extensions

Timestamp:

2019-10-09T18:43:47+13:00 (5 years ago)

Author:

ak19

Message:

Modified top sites list as Dr Bainbridge described: suffixes for the same resource (e.g. google.com, google.it) are all retained. I have removed prefixes however, e.g. translate.google.com is removed since google.com is already there. Used latest version of alexa, wiki top sites page, and the moz top 500 sites page Dr Bainbridge had found.

File:

• gs3-extensions/maori-lang-detection/conf/sites-too-big-to-exhaustively-crawl.txt (modified) (29 diffs)

gs3-extensions/maori-lang-detection/conf/sites-too-big-to-exhaustively-crawl.txt

@@ -27 +27 @@
 addtoany.com
 adobe.com
+adweek.com
 airbnb.com
 akamaihd.net
@@ -36 +37 @@
 allaboutcookies.org
 allrecipes.com
-amazon.
+amazon.ca
+amazon.co.jp
+amazon.co.uk
+amazon.com
+amazon.de
+amazon.es
+amazon.fr
+amazon.in
+ameblo.jp
 ampproject.org
 android.com
@@ -45 +54 @@
 apple.com
 archive.org
+archives.gov
 arstechnica.com
 arxiv.org
@@ -56 +66 @@
 bbc.co.uk
 bbc.com
+behance.net
 berkeley.edu
 biblegateway.com
@@ -68 +79 @@
 bloomberg.com
 booking.com
+boston.com
 box.com
 britannica.com
@@ -78 +90 @@
 ca.gov
 cambridge.org
+canalblog.com
 cbc.ca
+cbslocal.com
 cbsnews.com
 cdc.gov
@@ -84 +98 @@
 channel4.com
 chicagotribune.com
+chinadaily.com.cn
 cisco.com
 clickbank.net
 cloudflare.com
+cmu.edu
 cnbc.com
 cnet.com
@@ -92 +108 @@
 cocolog-nifty.com
 columbia.edu
+connect.over-blog.com
 cornell.edu
 corriere.it
@@ -103 +120 @@
 dan.com
 daum.net
+debian.org
 dell.com
 depositfiles.com
 detik.com
 digg.com
+discovery.com
 disney.com
+disney.go.com
 disqus.com
 doubleclick.net
@@ -166 +186 @@
 goo.ne.jp
 goodreads.com
-google.
+google.ca
+google.co.id
+google.co.in
+google.co.jp
+google.co.uk
+google.com
+google.com.br
+google.com.hk
+google.com.tr
+google.de
+google.es
+google.fr
+google.it
+google.nl
+google.pl
+google.ru
+googleapis.com
 googleblog.com
 googleusercontent.com
@@ -203 +239 @@
 indiegogo.com
 instagram.com
+instructables.com
 intel.com
+interia.pl
 issuu.com
 istockphoto.com
@@ -224 +262 @@
 livescience.com
 loc.gov
+lonelyplanet.com
 lycos.com
+m.wikipedia.org
 mail.ru
 marketwatch.com
@@ -232 +272 @@
 medium.com
 mega.nz
+megaupload.com
 mercurynews.com
 merriam-webster.com
@@ -253 +294 @@
 naver.com
 naver.jp
+nba.com
 nbcnews.com
 ndtv.com
@@ -262 +304 @@
 newscientist.com
 newsweek.com
+newyorker.com
 nginx.com
 nginx.org
@@ -279 +322 @@
 odnoklassniki.ru
 office.com
+offset.com
 ok.ru
 okezone.com
@@ -295 +339 @@
 paypal.com
 pbs.org
+pcmag.com
 people.com
 photobucket.com
@@ -302 +347 @@
 playstation.com
 plesk.com
+plos.org
 politico.com
+prestashop.com
 prezi.com
 princeton.edu
@@ -316 +363 @@
 reddit.com
 repubblica.it
+researchgate.net
 reuters.com
 ria.ru
@@ -321 +369 @@
 rt.com
 rtve.es
+sakura.ne.jp
 samsung.com
 sapo.pt
+scholastic.com
 sciencedaily.com
 sciencedirect.com
@@ -341 +391 @@
 skype.com
 skyrock.com
+slate.com
 slideshare.net
 sm.cn
@@ -355 +406 @@
 springer.com
 sputniknews.com
+ssl-images-amazon.com
 stackoverflow.com
+standard.co.uk
 stanford.edu
 state.gov
@@ -361 +414 @@
 steampowered.com
 storage.canalblog.com
+storage.googleapis.com
 stores.jp
 storify.com
@@ -372 +426 @@
 taobao.com
 target.com
+teamviewer.com
 techcrunch.com
 ted.com
@@ -377 +432 @@
 telegraph.co.uk
 terra.com.br
+theatlantic.com
+thefreedictionary.com
 theglobeandmail.com
 theguardian.com
 themeforest.net
+thenextweb.com
 thestar.com
 thesun.co.uk
@@ -403 +461 @@
 uol.com.br
 urbandictionary.com
+usa.gov
 usatoday.com
 usgs.gov
@@ -424 +483 @@
 washingtonpost.com
 wattpad.com
+weather.com
 web.fc2.com
 webmd.com
@@ -448 +508 @@
 xinhuanet.com
 yadi.sk
-yahoo.co.
+yahoo.co.jp
 yahoo.com
 yale.edu
@@ -459 +519 @@
 ytimg.com
 zdnet.com
+zend.com
 zendesk.com
-
+zippyshare.com