source: gs2-extensions/parallel-building/trunk

Revision Log Mode:


Legend:

Added
Modified
Copied or renamed
Diff Rev Age Author Log Message
(edit) @24844   12 years jmt12 Script to take the raw output from poll-gsdl.pl and collate the …
(edit) @24843   12 years jmt12 A script that launches an (affinity assigned) Greenstone import while …
(edit) @24842   12 years jmt12 Script to take the raw output from poll-processor.pl and collate the …
(edit) @24841   12 years jmt12
(edit) @24840   12 years jmt12 Added lots of comments as I was trying to determine the cause of the …
(edit) @24839   12 years jmt12 If the filelist is already present in tmp don't regenerate (just for …
(edit) @24838   12 years jmt12 Added in fix for 'socket pool exhausted' problem (see code for …
(edit) @24837   12 years jmt12 Make (rather time-consuming) compilation of these libraries …
(edit) @24836   12 years jmt12 Altered lockfile generation so that it occurs in specific collections …
(edit) @24835   12 years jmt12 Altered lockfile generation so that it occurs in specific collections …
(edit) @24834   12 years jmt12 Typo - missed -I for this dir include path
(edit) @24833   12 years jmt12 Adding support for setting affinity of worker processes. Lots of debug …
(edit) @24702   13 years jmt12 apparently the missing script was missing... teehee
(edit) @24699   13 years jmt12 Write the manifest files to the collection's tmp directory so we can …
(edit) @24698   13 years jmt12 Store the filelist.txt (list of all documents to be imported) in the …
(edit) @24697   13 years jmt12 Adding in a defined test on complex_meta to prevent a Perl warning
(edit) @24695   13 years jmt12 Script to run a battery of tests and record the results in a database
(edit) @24694   13 years jmt12 Setup script to generate a number of collections or varying sizes …
(edit) @24693   13 years jmt12 A hack to allow sudoedit to modify the drop_caches value non-interactively
(edit) @24690   13 years jmt12 Having added a new function to the cascade-make library to handle Perl …
(edit) @24686   13 years jmt12 Several changes to ensure parallel importing plays nicely with …
(edit) @24685   13 years jmt12 Ensure the client end of the socket is opened UTF8 aware
(edit) @24684   13 years jmt12 Changed order of arguments to mpiimport to make site (a GS3 thing) …
(edit) @24683   13 years jmt12 Fixes to process (based predominantly on the new/custom complexmeta …
(edit) @24682   13 years jmt12 Restored the complexmeta flag needed to allow parallel importing with …
(edit) @24681   13 years jmt12 Made it so listeners are only removed when the object is deallocated …
(edit) @24680   13 years jmt12 Removed sanity check for GDBM (where was my sanity - GDBM works, it's …
(edit) @24679   13 years jmt12 Added code to determine the open file handles and persist them through …
(edit) @24678   13 years jmt12 A tool for comparing the contents of two GDBM databases
(edit) @24677   13 years jmt12 A tool for generating manifest files from import directories
(edit) @24675   13 years jmt12 Continued to document the parallel building extension and various …
(edit) @24674   13 years jmt12 A new database driver that connects to one or more GDBMServers …
(edit) @24673   13 years jmt12 Added switch and code for enabling WAL when accessing SQLite, but it …
(edit) @24672   13 years jmt12 changed some error messages to be less... sacrilegious
(edit) @24671   13 years jmt12 Simple server and client objects that are based around a socket that …
(edit) @24670   13 years jmt12 An object encapsulating an active client to the GDBMServer - to be …
(edit) @24669   13 years jmt12 Added a test before trying to twiddle binmode on the infodb_handle to …
(edit) @24668   13 years jmt12 changed warning message when basebuilder asked to generate build …
(edit) @24667   13 years jmt12 Adding another sanity test to prevent parallel building when infodb is …
(edit) @24666   13 years jmt12 A daemonizable server that modifies a GDBM database (via the GDBMCLI …
(edit) @24665   13 years jmt12 A simple client for testing GDBMServer and for properly shutting it …
(edit) @24664   13 years jmt12 Ignoring unpacked versions of new packages
(edit) @24663   13 years jmt12 A new cascade-make script for sqlite although (since SQLite 3.7.8 …
(edit) @24662   13 years jmt12 Ignoring unpacked versions of new packages
(edit) @24661   13 years jmt12 New packages for GDBMServer, and a (failed) attempt to support SQLite …
(edit) @24660   13 years jmt12 Cascade make script (and script adjustments) for GDBMCLI tool
(edit) @24659   13 years jmt12 Several small changes to CLI such as new commands
(edit) @24639   13 years jmt12 A command line interface for GDBM to allow a bidirectional pipe from …
(edit) @24638   13 years jmt12 A place for logs to live
(edit) @24626   13 years jmt12 An (almost) complete copy of the perllib directory from a (circa …
(edit) @24625   13 years jmt12 Cascade building files for the locking version of GDBM tools
(edit) @24624   13 years jmt12 Rather than having the Greenstone output sent to some obscure log, use …
(edit) @24623   13 years jmt12 Make sure the extension's bin/script is on the path
(edit) @24622   13 years jmt12 Parallel enabled version of buildcol.pl and the parallel_import.pl …
(edit) @24621   13 years jmt12 Adding the version of GDBM txt2db with simply file locking so as to …
(edit) @24620   13 years jmt12 Cascade building files for the locking version of GDBM tools
(edit) @24619   13 years jmt12 Ignoring configured and building files
(edit) @24618   13 years jmt12 Adding the version of GDBM txt2db with simply file locking so as to …
(edit) @24596   13 years jmt12 Ignoring certain files
(edit) @24595   13 years jmt12 Ignoring certain files
(edit) @24594   13 years jmt12 Ignoring certain files
(edit) @24593   13 years jmt12 Ignoring certain files
(edit) @24592   13 years jmt12 Ignoring certain files
(edit) @24591   13 years jmt12 Initial checkin. Forgot to remove .svn folder from place I copied this from
(edit) @24590   13 years jmt12 Ignoring platform specific compiled/installed files
(edit) @24589   13 years jmt12 Initial checkin
(edit) @24585   13 years jmt12 Adding external reference to cascade-make repo
(add) @24584   13 years jmt12 Initial checkin
Note: See TracRevisionLog for help on using the revision log.