source: gs2-extensions/parallel-building/trunk/src

Revision Log Mode:


Legend:

Added
Modified
Copied or renamed
Diff Rev Age Author Log Message
(edit) @25810   9 years jmt12 MPI executable to provide parallel processing functionality to DSpace …
(edit) @25809   9 years jmt12 Script to parallel media filter DSpace
(edit) @25416   10 years jmt12 Actually make the client sleep the retry time it says it will
(edit) @25401   10 years jmt12 Extend the code that 'pre-started' the GDBMServer to pre-start any …
(edit) @25120   10 years jmt12 Shorten the directory names of folders in archives to avoid the …
(edit) @25118   10 years jmt12 Significant changes to support the latest round of batch tests (for …
(edit) @25117   10 years jmt12 Added some debug comments
(edit) @25116   10 years jmt12 (Temporarily) removing the global file scan and the tmp file deletion
(edit) @25115   10 years jmt12 This is sometimes called without the site argument... detect and match …
(edit) @25114   10 years jmt12 Some more tests as it appears there are ways to run import such as …
(edit) @25113   10 years jmt12 A TextPlugin extended to do a little more processing in order to …
(edit) @24848   10 years jmt12 Extended the manifestinator to correctly recurse into directories
(edit) @24847   10 years jmt12 Added the ability for the server to detect if it's calling process has …
(edit) @24846   10 years jmt12 A small SocketSwimmingThreadPoolServer to allow testing of the client …
(edit) @24845   10 years jmt12 Similar to poll-gsdl.pl except that this uses mpstat to gather …
(edit) @24844   10 years jmt12 Script to take the raw output from poll-gsdl.pl and collate the …
(edit) @24843   10 years jmt12 A script that launches an (affinity assigned) Greenstone import while …
(edit) @24842   10 years jmt12 Script to take the raw output from poll-processor.pl and collate the …
(edit) @24841   10 years jmt12
(edit) @24840   10 years jmt12 Added lots of comments as I was trying to determine the cause of the …
(edit) @24839   10 years jmt12 If the filelist is already present in tmp don't regenerate (just for …
(edit) @24838   10 years jmt12 Added in fix for 'socket pool exhausted' problem (see code for …
(edit) @24837   10 years jmt12 Make (rather time-consuming) compilation of these libraries …
(edit) @24836   10 years jmt12 Altered lockfile generation so that it occurs in specific collections …
(edit) @24835   10 years jmt12 Altered lockfile generation so that it occurs in specific collections …
(edit) @24834   10 years jmt12 Typo - missed -I for this dir include path
(edit) @24833   10 years jmt12 Adding support for setting affinity of worker processes. Lots of debug …
(edit) @24702   10 years jmt12 apparently the missing script was missing... teehee
(edit) @24699   10 years jmt12 Write the manifest files to the collection's tmp directory so we can …
(edit) @24698   10 years jmt12 Store the filelist.txt (list of all documents to be imported) in the …
(edit) @24697   10 years jmt12 Adding in a defined test on complex_meta to prevent a Perl warning
(edit) @24695   10 years jmt12 Script to run a battery of tests and record the results in a database
(edit) @24694   10 years jmt12 Setup script to generate a number of collections or varying sizes …
(edit) @24693   10 years jmt12 A hack to allow sudoedit to modify the drop_caches value non-interactively
(edit) @24690   10 years jmt12 Having added a new function to the cascade-make library to handle Perl …
(edit) @24686   10 years jmt12 Several changes to ensure parallel importing plays nicely with …
(edit) @24685   10 years jmt12 Ensure the client end of the socket is opened UTF8 aware
(edit) @24684   10 years jmt12 Changed order of arguments to mpiimport to make site (a GS3 thing) …
(edit) @24683   10 years jmt12 Fixes to process (based predominantly on the new/custom complexmeta …
(edit) @24682   10 years jmt12 Restored the complexmeta flag needed to allow parallel importing with …
(edit) @24681   10 years jmt12 Made it so listeners are only removed when the object is deallocated …
(edit) @24680   10 years jmt12 Removed sanity check for GDBM (where was my sanity - GDBM works, it's …
(edit) @24679   10 years jmt12 Added code to determine the open file handles and persist them through …
(edit) @24678   10 years jmt12 A tool for comparing the contents of two GDBM databases
(edit) @24677   10 years jmt12 A tool for generating manifest files from import directories
(edit) @24675   10 years jmt12 Continued to document the parallel building extension and various …
(edit) @24674   10 years jmt12 A new database driver that connects to one or more GDBMServers …
(edit) @24673   10 years jmt12 Added switch and code for enabling WAL when accessing SQLite, but it …
(edit) @24672   10 years jmt12 changed some error messages to be less... sacrilegious
(edit) @24671   10 years jmt12 Simple server and client objects that are based around a socket that …
(edit) @24670   10 years jmt12 An object encapsulating an active client to the GDBMServer - to be …
(edit) @24669   10 years jmt12 Added a test before trying to twiddle binmode on the infodb_handle to …
(edit) @24668   10 years jmt12 changed warning message when basebuilder asked to generate build …
(edit) @24667   10 years jmt12 Adding another sanity test to prevent parallel building when infodb is …
(edit) @24666   10 years jmt12 A daemonizable server that modifies a GDBM database (via the GDBMCLI …
(edit) @24665   10 years jmt12 A simple client for testing GDBMServer and for properly shutting it …
(edit) @24664   10 years jmt12 Ignoring unpacked versions of new packages
(edit) @24663   10 years jmt12 A new cascade-make script for sqlite although (since SQLite 3.7.8 …
(edit) @24662   10 years jmt12 Ignoring unpacked versions of new packages
(edit) @24661   10 years jmt12 New packages for GDBMServer, and a (failed) attempt to support SQLite …
(edit) @24660   10 years jmt12 Cascade make script (and script adjustments) for GDBMCLI tool
(edit) @24659   10 years jmt12 Several small changes to CLI such as new commands
(edit) @24639   10 years jmt12 A command line interface for GDBM to allow a bidirectional pipe from …
(edit) @24638   10 years jmt12 A place for logs to live
(edit) @24626   10 years jmt12 An (almost) complete copy of the perllib directory from a (circa …
(edit) @24625   10 years jmt12 Cascade building files for the locking version of GDBM tools
(edit) @24624   10 years jmt12 Rather than having the Greenstone output sent to some obscure log, use …
(edit) @24623   10 years jmt12 Make sure the extension's bin/script is on the path
(edit) @24622   10 years jmt12 Parallel enabled version of buildcol.pl and the parallel_import.pl …
(edit) @24621   10 years jmt12 Adding the version of GDBM txt2db with simply file locking so as to …
(edit) @24620   10 years jmt12 Cascade building files for the locking version of GDBM tools
(edit) @24619   10 years jmt12 Ignoring configured and building files
(edit) @24618   10 years jmt12 Adding the version of GDBM txt2db with simply file locking so as to …
(edit) @24596   10 years jmt12 Ignoring certain files
(edit) @24595   10 years jmt12 Ignoring certain files
(edit) @24594   10 years jmt12 Ignoring certain files
(edit) @24593   10 years jmt12 Ignoring certain files
(edit) @24592   10 years jmt12 Ignoring certain files
(edit) @24591   10 years jmt12 Initial checkin. Forgot to remove .svn folder from place I copied this from
(edit) @24590   10 years jmt12 Ignoring platform specific compiled/installed files
(edit) @24589   10 years jmt12 Initial checkin
(edit) @24585   10 years jmt12 Adding external reference to cascade-make repo
(add) @24584   10 years jmt12 Initial checkin
Note: See TracRevisionLog for help on using the revision log.