Changeset 33675 for other-projects

Timestamp:

2019-11-15T00:22:34+13:00 (4 years ago)

Author:

ak19

Message:

Committing the newer query results (but from before today's reingestion in mongodb) and some more mongodb related links to read suggested by Dr Bainbridge and his google searches today.

File:

• other-projects/maori-lang-detection/MoreReading/mongodb.txt (modified) (4 diffs)

other-projects/maori-lang-detection/MoreReading/mongodb.txt

@@ -347 +347 @@
 https://docs.mongodb.com/manual/reference/method/db.collection.find/#find-projection
 
-
+Mongo Studio 3T documentation:
+https://studio3t.com/download/ (also has uninstall information)
+https://studio3t.com/download-thank-you/?OS=x64
+
+Google: MongoDB visualization
+MongoDB visualization map
+MongoDB Charts
+    (Open source visualisation tools)
+
+json map visualizer
+    geojson.tools
 -------------------
 
@@ -358 +368 @@
 # Num webpages
 db.getCollection('Webpages').find({}).count()
-75139
+X75139
+117496
 
 # Find number of websites who have 1 or more pages in Maori (a positive numPagesInMRI)
@@ -367 +378 @@
 db.getCollection('Webpages').find({isMRI:true}).count()
 X5224
-5215
+X5215
+db.getCollection('Webpages').find({isMRI:true}).count()
+7818
 
 # Number of pages that contain any number of MRI sentences
 db.getCollection('Webpages').find({containsMRI: true}).count()
-12858
+X12858
+20371
+
 
 # Number of sites with URLs containing /mi(/)
@@ -389 +404 @@
 db.getCollection('Websites').find({urlContainsLangCodeInpath:true}).sort({geoLocationCountryCode: 1})
 
-
+Actually, I want to sort by count. See https://docs.mongodb.com/manual/reference/operator/aggregation/sortByCount/
+
+
+
+* Identify where Maori language is online.
+* How can we identify high quality sites that would be good for a corpus.
+(Related work for other languages to quantifiably answer that)
+