Changeset 33870 for other-projects/maori-lang-detection/src/org/greenstone/atea/RandomURLsForDomainGenerator.java

Timestamp:

2020-01-24T20:48:17+13:00 (4 years ago)

Author:

ak19

Message:

Got the mongodb query working in Java in 2 different ways: the fully Java way and the way where I parse the query and parse the projection portion and then run the mongodb collection.find().projection() on it. Both work now. And thed RandomURLsForDomainGenerator now works fine.

File:

• other-projects/maori-lang-detection/src/org/greenstone/atea/RandomURLsForDomainGenerator.java (modified) (1 diff)

other-projects/maori-lang-detection/src/org/greenstone/atea/RandomURLsForDomainGenerator.java

@@ -60 +60 @@
     }
 
-    // copy into array
-    /*
-    urls = new String[urlsList.size()];
-    String[] urls = urlsList.toArray(urls);
-    urlsList.clear();
-    */
-
-    /*
-    // 2. generate numURLs of UNIQUE numbers between 0 to urls.length
-    // https://stackoverflow.com/questions/8115722/generating-unique-random-numbers-in-java
-    // https://www.geeksforgeeks.org/iterator-vs-foreach-in-java/
-    // BETTER: https://stackoverflow.com/questions/5505927/how-to-generate-a-random-permutation-in-java
-    
-    
-    // 3. then for each number, write the url at that index in array urls into file.
-    */
-
-    // Shuffle the urlsList, then write out the first numURLs into a file.
-    
-    // BETTER: https://stackoverflow.com/questions/5505927/how-to-generate-a-random-permutation-in-java
+    // Shuffle the urlsList, then write out the first numURLs into a file.  
+    // https://stackoverflow.com/questions/5505927/how-to-generate-a-random-permutation-in-java
     File parentFolder = domainsFile.getParentFile();
     String fileName = domainsFile.getName();
     File outFile = new File(parentFolder, "random"+numURLs+"_"+fileName);
+    File fullSetOutFile = new File(parentFolder, "all_"+fileName);
     
     // shuffle list and take the first n