# # ChangeLog for gs2-extensions/parallel-building/trunk/src/src/java # # Generated by Trac 1.4.2 # 2024-05-20T16:48:31+12:00 Sun, 21 Jul 2013 22:35:43 GMT jmt12 [27911] * gs2-extensions/parallel-building/trunk/src/src/java/org/nzdl/gsdl/compile.sh (modified) Modified the compilation to include the new ingester and its co- ... Sun, 21 Jul 2013 22:35:04 GMT jmt12 [27910] * gs2-extensions/parallel-building/trunk/src/src/java/org/nzdl/gsdl/GSGroupingComparator.java (added) * gs2-extensions/parallel-building/trunk/src/src/java/org/nzdl/gsdl/GSInfoDB.java (added) * gs2-extensions/parallel-building/trunk/src/src/java/org/nzdl/gsdl/GSPartitioner.java (added) * gs2-extensions/parallel-building/trunk/src/src/java/org/nzdl/gsdl/HadoopGreenstoneIngest2.java (added) Extended the existing HadoopGreenstoneIngest with proper Reduce phase ... Mon, 17 Jun 2013 22:59:52 GMT jmt12 [27654] * gs2-extensions/parallel-building/trunk/src/bin/script/hadoop_import.pl (modified) * gs2-extensions/parallel-building/trunk/src/src/java/org/nzdl/gsdl/HadoopGreenstoneIngest.java (modified) Add the ability to stagger the starting of Mappers by placing a ... Mon, 17 Jun 2013 22:12:53 GMT jmt12 [27641] * gs2-extensions/parallel-building/trunk/src/src/java/org/nzdl/gsdl/HadoopGreenstoneIngest.java (modified) Altered order of arguments and allow archives dir to be passed as ... Thu, 06 Jun 2013 23:27:08 GMT jmt12 [27571] * gs2-extensions/parallel-building/trunk/src/src/java/org/nzdl/gsdl/HadoopGreenstoneIngest.java (modified) increase timeout to 4 hours per map Thu, 06 Jun 2013 04:21:10 GMT jmt12 [27566] * gs2-extensions/parallel-building/trunk/src/src/java/org/nzdl/gsdl/HadoopGreenstoneIngest.java (modified) Making the getcpu optional - as it isn't available on Medusa (but ... Wed, 05 Jun 2013 23:11:10 GMT jmt12 [27558] * gs2-extensions/parallel-building/trunk/src/src/java/org/nzdl/gsdl/HadoopGreenstoneIngest.java (modified) Forgot that Hadoop Map processes no longer have the environment ... Wed, 05 Jun 2013 01:02:06 GMT jmt12 [27546] * gs2-extensions/parallel-building/trunk/src/src/java/org/nzdl/gsdl/HadoopGreenstoneIngest.java (modified) Adding the ability for the Hadoop Mapper to determine what CPU number ... Mon, 27 May 2013 23:36:00 GMT jmt12 [27494] * gs2-extensions/parallel-building/trunk/src/src/java/org/nzdl/gsdl/HadoopGreenstoneIngest.java (modified) Fixing a truncated comment - or maybe I never wrote an end to it... Mon, 27 May 2013 21:33:33 GMT jmt12 [27487] * gs2-extensions/parallel-building/trunk/src/src/java/org/nzdl/gsdl/HadoopGreenstoneIngest.java (modified) Ensure Parallel Building path in environment (for ThriftFS) and that ... Thu, 23 May 2013 22:14:14 GMT jmt12 [27433] * gs2-extensions/parallel-building/trunk/src/src/java/org/nzdl/gsdl/HadoopGreenstoneIngest.java (modified) Adding a few more details to the Hadoop log to assist with later work Thu, 23 May 2013 21:26:06 GMT jmt12 [27416] * gs2-extensions/parallel-building/trunk/src/src/java/org/nzdl/gsdl/HadoopGreenstoneIngest.java (modified) Forgot to ensure the manifests generated here are also version 2 Thu, 23 May 2013 21:23:29 GMT jmt12 [27413] * gs2-extensions/parallel-building/trunk/src/src/java/org/nzdl/gsdl/HadoopGreenstoneIngest.java (modified) Making the Hadoop processing aware that there are two different ... Wed, 20 Mar 2013 00:00:34 GMT jmt12 [27102] * gs2-extensions/parallel-building/trunk/src/src/java/org/nzdl/gsdl/HadoopGreenstoneIngest.java (modified) Adding in a progress reporter, as the set timeout to 10 hours trick ... Mon, 04 Mar 2013 21:12:35 GMT jmt12 [26982] * gs2-extensions/parallel-building/trunk/src/src/java/org/nzdl/gsdl/HadoopGreenstoneIngest.java (modified) Altered environment setup for subprocesses (due to Hadoop now moving ... Mon, 04 Mar 2013 21:11:05 GMT jmt12 [26981] * gs2-extensions/parallel-building/trunk/src/src/java/org/nzdl/gsdl/.svnignore (added) ignoring compiled java classes (hgi_classes) Mon, 04 Mar 2013 21:09:55 GMT jmt12 [26980] * gs2-extensions/parallel-building/trunk/src/src/java/org/nzdl/gsdl (modified) * gs2-extensions/parallel-building/trunk/src/src/java/org/nzdl/gsdl/HadoopGreenstoneIngest.java (modified) setting svnignore Mon, 04 Mar 2013 21:06:23 GMT jmt12 [26979] * gs2-extensions/parallel-building/trunk/src/src/java/org/nzdl/gsdl/compile.sh (modified) Fixed up lingering environment variables from when I was going to ... Mon, 25 Feb 2013 21:56:13 GMT jmt12 [26954] * gs2-extensions/parallel-building/trunk/src/src/java (added) * gs2-extensions/parallel-building/trunk/src/src/java/org (added) * gs2-extensions/parallel-building/trunk/src/src/java/org/nzdl (added) * gs2-extensions/parallel-building/trunk/src/src/java/org/nzdl/gsdl (added) * gs2-extensions/parallel-building/trunk/src/src/java/org/nzdl/gsdl/HadoopGreenstoneIngest.java (added) * gs2-extensions/parallel-building/trunk/src/src/java/org/nzdl/gsdl/compile.sh (added) checking in Java code from Hadoop parallel processing projects... phew