Changeset 33801 for other-projects/maori-lang-detection/src/org/greenstone/atea/morphia/WebsiteInfo.java

Timestamp:

2019-12-13T18:40:46+13:00 (4 years ago)

Author:

ak19

Message:

1. NutchTextDumpToMongoDB Added an extra field to each document in Websites mongodb collection: numPagesContainingMRI. 2. Bugfix to yesterday's commit: performing a substring() was off by one.

File:

• other-projects/maori-lang-detection/src/org/greenstone/atea/morphia/WebsiteInfo.java (modified) (3 diffs)

other-projects/maori-lang-detection/src/org/greenstone/atea/morphia/WebsiteInfo.java

@@ -12 +12 @@
     public final int totalPages;
     public final int countOfWebPagesWithBodyText;
+    
     public final int numPagesInMRI;
+    public final int numPagesContainingMRI;
     
     public final long siteCrawledTimestamp;
@@ -22 +24 @@
     
     public WebsiteInfo(/*int siteCount,*/ String siteFolderName, String domainOfSite,
-               int totalPages, int countOfWebPagesWithBodyText, int numPagesInMRI,
+               int totalPages, int countOfWebPagesWithBodyText,
+               int numPagesInMRI, int numPagesContainingMRI,
                long siteCrawledTimestamp, boolean siteCrawlUnfinished, boolean redoCrawl,
                String geoLocationCountryCode, boolean urlContainsLangCodeInPath)
@@ -32 +35 @@
     this.totalPages = totalPages;
     this.countOfWebPagesWithBodyText = countOfWebPagesWithBodyText;
+    
     this.numPagesInMRI = numPagesInMRI;
+    this.numPagesContainingMRI = numPagesContainingMRI;
     
     this.siteCrawledTimestamp = siteCrawledTimestamp;