Changeset 24680 for gs2-extensions/parallel-building/trunk

Timestamp:

2011-09-28T13:16:19+13:00 (13 years ago)

Author:

jmt12

Message:

Removed sanity check for GDBM (where was my sanity - GDBM works, it's just slow because of locking). Added initializer for archiveinf-doc infodb to ensure that any GDBMServer persists throughout parallel building

File:

• gs2-extensions/parallel-building/trunk/src/bin/script/buildcol.pl (modified) (2 diffs)

gs2-extensions/parallel-building/trunk/src/bin/script/buildcol.pl

@@ -396 +396 @@
     {
       $collectcfg->{'infodbtype'} = &dbutil::get_default_infodb_type();
-    }
-    # sanity check - you currently can't have GDBM as the infodb while
-    # asking for a parallel build
-    elsif ($collectcfg->{'infodbtype'} eq 'gdbm' && $parallel)
-    {
-      print STDERR "WARNING: Parallel builds not supported by GDBM - reverting to serial build\n";
-      $parallel = 0;
     }
     # sanity check - you currently can't have SQLite as the infodb while
@@ -674 +667 @@
   {
     print $out "*** parallel building\n";
+    # Some infodb modes (namely GDBMServer at the moment) need to open the
+    # connection to the database in such a way that it persists over the
+    # child threads. We do this by adding a dummy call to build the file path
+    # to archiveinf-doc as it is the database in question. The '1' at the end
+    # means launch the server... it will then persist until this block passes
+    # out of scope (presumably after all the child mpi processes are done)
+    my $arcinfo_doc_filename = &dbutil::get_infodb_file_path($collectcfg->{'infodbtype'}, "archiveinf-doc", $archivedir, 1);
+
     # we initially create the recipe as a datastructure to make it easier for
     # each builder to determine what has already been defined