Changeset 33608 for gs3-extensions/maori-lang-detection/src/org/greenstone/atea/MaoriTextDetector.java

Timestamp:

2019-10-30T23:02:26+13:00 (4 years ago)

Author:

ak19

Message:

1. New script to export from HBase so that we could in theory reimport into HBase. I've not tried the reimport out, but I followed instructions to export and I got a non-zero output file, so I am assuming it worked. 2. Committing today's new crawls in crawledNode4.tar. Each crawled site's folder inside it now includes a file called part-m-* that is the exported Hbase on that node VM. 3. Updated hdfs related GS_README.txt with instructions on viewing the contents of a table in HBase and a link on exporting/importing from HBase. 4. Minor changes like the tar files shouldn't be called tar.gz.

File:

• gs3-extensions/maori-lang-detection/src/org/greenstone/atea/MaoriTextDetector.java (modified) (1 diff)

gs3-extensions/maori-lang-detection/src/org/greenstone/atea/MaoriTextDetector.java

@@ -81 +81 @@
 
 
-    // we'll be storing just those sentences in text that are in Māori. 
+    // we'll be storing just those sentences in the text that are in Māori. 
     
     // OpenNLP language detection works best with a minimum of 2 sentences