source: gs2-extensions/parallel-building/trunk

Revision Log Mode:


Legend:

Added
Modified
Copied or renamed
Diff Rev Age Author Log Message
(edit) @27515   8 years jmt12 Making the file used durig buffertes be configurable
(edit) @27514   8 years jmt12 Altering code to allow configurable length of read/write buffer when …
(edit) @27512   8 years jmt12 Adding in a special test for measuring the effect of altering ThriftFS …
(edit) @27496   8 years jmt12 Replacing a smelly old util::file_exists() with a snazzy new …
(edit) @27495   8 years jmt12 removing doubled up debug comments and putting some paths in …
(edit) @27494   8 years jmt12 Fixing a truncated comment - or maybe I never wrote an end to it…
(edit) @27493   8 years jmt12 No longer required - not that sure why it was required in the first place
(edit) @27492   8 years jmt12 Some versions of Hadoop add host and protocol information into paths - …
(edit) @27491   8 years jmt12 Repairing three bugs in makeAllDirectories - incorrect pattern meant …
(edit) @27490   8 years jmt12 No longer requires
(edit) @27489   8 years jmt12 Shouldn't have been here
(edit) @27488   8 years jmt12 Since I've got rid of the thousand DateTime prereq modules, I can …
(edit) @27487   8 years jmt12 Ensure Parallel Building path in environment (for ThriftFS) and that …
(edit) @27481   8 years jmt12 Adding makeAllDirectories() (which I'd only implemented in LocalFS) to …
(edit) @27480   8 years jmt12 Removing DateTime dependency (so HDFSShell will always fail …
(edit) @27479   8 years jmt12 Remove time parsing as DateTime is a fricking nightmare to install …
(edit) @27478   8 years jmt12 Be a bit smarter about locating Perl version if not provided (rather …
(edit) @27477   8 years jmt12 Changed the order of additions to java classpath to ensure that my …
(edit) @27476   8 years jmt12
(edit) @27475   8 years jmt12
(edit) @27474   8 years jmt12 Ignoring extracted modules
(edit) @27473   8 years jmt12 I give up - I'll just do without DateTime
(edit) @27472   8 years jmt12
(edit) @27471   8 years jmt12
(edit) @27470   8 years jmt12 No longer need to ignore all the files I moved to cpan
(edit) @27469   8 years jmt12 A dedicated folder to hold the many, many CPAN modules I've ended up …
(edit) @27468   8 years jmt12 The (repeated) functionality of all these scripts moved into CPAN.sh
(edit) @27467   8 years jmt12 An advanced cascade script that will loop through an (evergrowing) …
(edit) @27466   8 years jmt12 moved to cpan folder in packages
(edit) @27465   8 years jmt12 Moved to cpan directory so I can use smarter cascade make
(edit) @27463   8 years jmt12
(edit) @27462   8 years jmt12
(edit) @27461   8 years jmt12
(edit) @27460   8 years jmt12
(edit) @27459   8 years jmt12
(edit) @27458   8 years jmt12
(edit) @27457   8 years jmt12
(edit) @27456   8 years jmt12
(edit) @27455   8 years jmt12
(edit) @27454   8 years jmt12 This is like a satanic game of whack-a-mole. Here are the four prereqs …
(edit) @27453   8 years jmt12 Surprise - now Params::Validate has a prereq too, namely …
(edit) @27452   8 years jmt12 Yet another prereq for DateTime - Params::Validate
(edit) @27450   8 years jmt12 Moved opt_modulebuild_* functions into a library, and altered the …
(edit) @27448   8 years jmt12 Even more prerequisites for Module::Build - Perl::OSType, …
(edit) @27447   8 years jmt12 ignore extracted Module::Build module
(edit) @27446   8 years jmt12 ignore extracted Module::Build module
(edit) @27445   8 years jmt12 cascade files for Module::Build perl module
(edit) @27444   8 years jmt12 Craphat - ModuleBuild required for compiling DateTime
(edit) @27443   8 years jmt12 ignore new extracted directories (DateTime and Test::Fatal)
(edit) @27442   8 years jmt12 ignore new extracted directories (DateTime and Test::Fatal)
(edit) @27441   8 years jmt12 Calling the cascade files for Test::Fatal and DateTime module building
(edit) @27440   8 years jmt12 cascade file for DateTime module. Uses customized functions as …
(edit) @27439   8 years jmt12 cascade file for Test::Fatal module
(edit) @27438   8 years jmt12 Module required by DateTime, which in turn is required by the …
(edit) @27437   8 years jmt12 Why doesn't this exist on Medusa... I thought it was a built-in
(edit) @27436   8 years jmt12 Adding the actual script - rather than a symlink to my dropbox. doh
(edit) @27435   8 years jmt12 Gah - only a symbolic link
(edit) @27434   8 years jmt12 Updated the starting script to look in the correct place (in this …
(edit) @27433   8 years jmt12 Adding a few more details to the Hadoop log to assist with later work
(edit) @27424   8 years jmt12 Adding canRead() and isAbsolute() functions, and some more debugging …
(edit) @27423   8 years jmt12 Adding canRead() and isAbsolute() functions
(edit) @27422   8 years jmt12 Adding canRead() and isAbsolute() functions
(edit) @27421   8 years jmt12 Fixing bug in filePutContents (wasn't shifting parameters off front of …
(edit) @27420   8 years jmt12 Updated to reflect changes in the perllib customization (most of it …
(edit) @27419   8 years jmt12 Adding more reasonable default values for HDFS host and port (so the …
(edit) @27418   8 years jmt12 Also recompile the HadoopGreenstoneIngest.java file during cascade make
(edit) @27417   8 years jmt12 A 'pseudo'-CASCASE-MAKE file for building java code. It doesn't really …
(edit) @27416   8 years jmt12 Forgot to ensure the manifests generated here are also version 2
(edit) @27415   8 years jmt12 Ensuring the manifests generated are marked as version 2 - i.e. should …
(edit) @27414   8 years jmt12 Allowing more processing arguments to be configured at the call, and …
(edit) @27413   8 years jmt12 Making the Hadoop processing aware that there are two different …
(edit) @27412   8 years jmt12 I obviously hadn't run this script on Karearea before - assumed all …
(edit) @27409   8 years jmt12 Unit test like testing for the FileUtils class and LocalFS, HDFSShell, …
(edit) @27408   8 years jmt12 A symbolic link to the actual script in the packages directory
(edit) @27407   8 years jmt12 updating ignore
(edit) @27406   8 years jmt12 Updating ignore
(edit) @27405   8 years jmt12 Now that I can get the Perl version, make the cascade make script …
(edit) @27404   8 years jmt12 Thrift access to HDFS and required Bit-Vector Perl module
(edit) @27386   8 years jmt12 Forgot these were just symbolic links to my Dropbox folder - adding in …
(edit) @27385   8 years jmt12 removing soft links to my dropbox folder - sorry
(edit) @27384   8 years jmt12 An overriding version of FileUtils that provides several drivers …
(edit) @27383   8 years jmt12 Adding a perl module for the slightly more efficient Base91 encoding …
(edit) @27382   8 years jmt12 Adding Thrift and its prerequisite BitVector packages
(edit) @27381   8 years jmt12 An image used during FileUtils testing to check binary transfer in …
(edit) @27378   8 years jmt12 Parallel processing support now added (via buildcolutil subclass) to …
(edit) @27377   8 years jmt12 Updating calls to intermediate util functions to the new FileUtils
(edit) @27373   8 years jmt12 No longer needs a custom util.pm - file utility functions now moved …
(edit) @27372   8 years jmt12 Fixing where I'd used uppercase letters in a package name that didn't …
(edit) @27371   8 years jmt12 Replacing with a proper class inheriting from gdbm and just overriding …
(edit) @27370   8 years jmt12 fixing minor bug in inheritence tree
(edit) @27280   8 years jmt12 A subclass of buildcolutils.pm with added functionality for parallel …
(edit) @27279   8 years jmt12 A subclass of inexport.pm with added functionality for parallel …
(edit) @27278   8 years jmt12 Renamed so it can be found in an automated fashion (prefixed by the …
(edit) @27237   8 years jmt12 Moved several generally applicable changes (manifest version, …
(edit) @27236   8 years jmt12 extended loader (to support extensions) and conditional additions to …
(edit) @27235   8 years jmt12 Moving the conditional additions to INC into the main trunk's version
(edit) @27234   8 years jmt12 renamed prepare_build_recipe() to the more meaningful …
(edit) @27233   8 years jmt12 Recipe generation code moved into subclass of mgbuilder called …
(edit) @27232   8 years jmt12 Recipe generation code moved into subclass of mgppbuilder called …
(edit) @27231   8 years jmt12 Recipe generation code moved into subclass of mgppbuilder called …
Note: See TracRevisionLog for help on using the revision log.