source: gs2-extensions/parallel-building/trunk/src/bin

Revision Log Mode:


Legend:

Added
Modified
Copied or renamed
Diff Rev Age Author Log Message
(edit) @27436   11 years jmt12 Adding the actual script - rather than a symlink to my dropbox. doh
(edit) @27435   11 years jmt12 Gah - only a symbolic link
(edit) @27414   11 years jmt12 Allowing more processing arguments to be configured at the call, and …
(edit) @27412   11 years jmt12 I obviously hadn't run this script on Karearea before - assumed all …
(edit) @27409   11 years jmt12 Unit test like testing for the FileUtils class and LocalFS, HDFSShell, …
(edit) @27408   11 years jmt12 A symbolic link to the actual script in the packages directory
(edit) @27378   11 years jmt12 Parallel processing support now added (via buildcolutil subclass) to …
(edit) @27126   11 years jmt12 Extra clean up commands (like removing cached versions of video …
(edit) @27125   11 years jmt12 A script to try and flush all caches - I'm certain it's flushing disk …
(edit) @27124   11 years jmt12 Use the new perl version script to extract the version number - so as …
(edit) @27119   11 years jmt12 Merging version finder from Medusa with the one lurking on Karearea
(edit) @27058   11 years jmt12 Adding data locality report generation to Hadoop greenstone imports
(edit) @27052   11 years jmt12 Turns out the Perl on Medusa doesn't support $V, so I've had to …
(edit) @27041   11 years jmt12 INC path now includes the installed extensions perl path (including …
(edit) @27040   11 years jmt12 A simple script that returns just the version number of Perl
(edit) @27036   11 years jmt12 A script to extract data locality and other task information from the …
(edit) @27006   11 years jmt12 A companion script to stop-hadoop-processes that just reports running …
(edit) @27005   11 years jmt12 Similar to stop-impt.pl, this script uses kill to stop runaway Hadoop …
(edit) @27004   11 years jmt12 A script to stop (using kill) a runaway import process and any related …
(edit) @27001   11 years jmt12 Passing more environment variables (HADOOPPREFIX, HDFSHOST, HDFSPORT) …
(edit) @26999   11 years jmt12 Ensuring MPI binds to correct interface, and passing through …
(edit) @26998   11 years jmt12 Adding maxdocs variable, lots of debug comments, added some tests for …
(edit) @26953   11 years jmt12 Checking in the script rather than a symbolic link to the script :P
(edit) @26952   11 years jmt12 Accidentally checked in symbolic link rather than script
(edit) @26949   11 years jmt12 Parallel import using Hadoop
(edit) @26930   11 years jmt12 Randomized order of files, and added the ability to specify a maximum …
(edit) @26929   11 years jmt12 A script to comprehensively clean up a collection between imports... …
(edit) @26923   11 years jmt12 Generates a specficied-size subset of a larger import directory
(edit) @26242   12 years jmt12 Modifications to progress messages to improve extracting information …
(edit) @26187   12 years jmt12 Adding the rest of parallel processing support for Terrier into SVN. …
(edit) @25943   12 years jmt12 Updated script to support cluster processing
(edit) @25809   12 years jmt12 Script to parallel media filter DSpace
(edit) @25118   12 years jmt12 Significant changes to support the latest round of batch tests (for …
(edit) @25117   12 years jmt12 Added some debug comments
(edit) @24848   12 years jmt12 Extended the manifestinator to correctly recurse into directories
(edit) @24847   12 years jmt12 Added the ability for the server to detect if it's calling process has …
(edit) @24846   12 years jmt12 A small SocketSwimmingThreadPoolServer to allow testing of the client …
(edit) @24845   12 years jmt12 Similar to poll-gsdl.pl except that this uses mpstat to gather …
(edit) @24844   12 years jmt12 Script to take the raw output from poll-gsdl.pl and collate the …
(edit) @24843   12 years jmt12 A script that launches an (affinity assigned) Greenstone import while …
(edit) @24842   12 years jmt12 Script to take the raw output from poll-processor.pl and collate the …
(edit) @24841   12 years jmt12
(edit) @24695   13 years jmt12 Script to run a battery of tests and record the results in a database
(edit) @24694   13 years jmt12 Setup script to generate a number of collections or varying sizes …
(edit) @24693   13 years jmt12 A hack to allow sudoedit to modify the drop_caches value non-interactively
(edit) @24680   13 years jmt12 Removed sanity check for GDBM (where was my sanity - GDBM works, it's …
(edit) @24679   13 years jmt12 Added code to determine the open file handles and persist them through …
(edit) @24678   13 years jmt12 A tool for comparing the contents of two GDBM databases
(edit) @24677   13 years jmt12 A tool for generating manifest files from import directories
(edit) @24667   13 years jmt12 Adding another sanity test to prevent parallel building when infodb is …
(edit) @24666   13 years jmt12 A daemonizable server that modifies a GDBM database (via the GDBMCLI …
(edit) @24665   13 years jmt12 A simple client for testing GDBMServer and for properly shutting it …
(add) @24622   13 years jmt12 Parallel enabled version of buildcol.pl and the parallel_import.pl …
Note: See TracRevisionLog for help on using the revision log.