Changeset 33582 for gs3-extensions/maori-lang-detection/src/org/greenstone/atea/CCWETProcessor.java

Timestamp:

2019-10-17T23:12:38+13:00 (5 years ago)

Author:

ak19

Message:

NutchTextDumpProcessor prints each crawled site's stats: number of webpages per crawled site and how many of those were detected by OpenNLP as being in Maori (mri). Needed to make a reusable method in CCWETProcessor as public and static.

File:

• gs3-extensions/maori-lang-detection/src/org/greenstone/atea/CCWETProcessor.java (modified) (1 diff)

gs3-extensions/maori-lang-detection/src/org/greenstone/atea/CCWETProcessor.java

@@ -240 +240 @@
      * This retains any www. or subdomain prefix.
      */
-    private String getDomainForURL(String url, boolean withProtocol) {
+    public static String getDomainForURL(String url, boolean withProtocol) {
     int startIndex = startIndex = url.indexOf("//"); // for http:// or https:// prefix
     startIndex = (startIndex == -1) ? 0 : (startIndex+2); // skip past the protocol's // portion