source: gs2-extensions

Revision Log Mode:


Legend:

Added
Modified
Copied or renamed
Diff Rev Age Author Log Message
(edit) @27567   11 years jmt12 Found a printWarning that I handed changed to use the FileUtils version
(edit) @27566   11 years jmt12 Making the getcpu optional - as it isn't available on Medusa (but then …
(edit) @27561   11 years jmt12 Adding very basic compile file for getcpu - can't be bothered going …
(edit) @27560   11 years jmt12 Fixing typo in regexp that meant filenames sometimes ignored
(edit) @27559   11 years jmt12 Changed mime-type away from binary - I hope. Meanwhile, generate …
(edit) @27558   11 years jmt12 Forgot that Hadoop Map processes no longer have the environment …
(edit) @27552   11 years jmt12 Altering the debug comments to provide IO boundary timings a little …
(edit) @27551   11 years jmt12 Altered so that it expects to be given a CSV containing parallel …
(edit) @27550   11 years jmt12 Ensure the hostname is added to the Hadoop logs so we can identify the …
(edit) @27549   11 years jmt12 Extract information from the logs generated by parallel Greenstone …
(edit) @27548   11 years jmt12 Extract information from the logs generated by parallel Greenstone …
(edit) @27547   11 years jmt12 Rejigging some processing comments
(edit) @27546   11 years jmt12 Adding the ability for the Hadoop Mapper to determine what CPU number …
(edit) @27545   11 years jmt12 Ignoring just the compiled file (for now)
(edit) @27544   11 years jmt12 A tiny C script to guesstimate the CPU the calling Process is on
(edit) @27543   11 years jmt12 Adding generate_gantt.pl script in its original form - i.e. directly …
(edit) @27532   11 years jmt12 Add the ability to configure the Thrift connector using a …
(edit) @27531   11 years jmt12 Only output the message about using copy instead of hard/soft link once
(edit) @27530   11 years jmt12 Clear out old logs, and adding more comments about what the script is …
(edit) @27529   11 years jmt12 Fixing a bug (HDFS drivers not being recognized due to sometimes …
(edit) @27527   11 years jmt12 Calling the isHDFS() in FileUtils rather than the non-existant one in utils
(edit) @27526   11 years jmt12 Adding in a 'isHDFS()' function so that some plugins (SimpleVideoPlug) …
(edit) @27525   11 years jmt12 Adding in a 'isHDFS()' function so that some plugins (SimpleVideoPlug) …
(edit) @27515   11 years jmt12 Making the file used durig buffertes be configurable
(edit) @27514   11 years jmt12 Altering code to allow configurable length of read/write buffer when …
(edit) @27512   11 years jmt12 Adding in a special test for measuring the effect of altering ThriftFS …
(edit) @27510   11 years ak19 Using the recommended FileUtils.pm methods in place of the deprecated …
(edit) @27496   11 years jmt12 Replacing a smelly old util::file_exists() with a snazzy new …
(edit) @27495   11 years jmt12 removing doubled up debug comments and putting some paths in …
(edit) @27494   11 years jmt12 Fixing a truncated comment - or maybe I never wrote an end to it…
(edit) @27493   11 years jmt12 No longer required - not that sure why it was required in the first place
(edit) @27492   11 years jmt12 Some versions of Hadoop add host and protocol information into paths - …
(edit) @27491   11 years jmt12 Repairing three bugs in makeAllDirectories - incorrect pattern meant …
(edit) @27490   11 years jmt12 No longer requires
(edit) @27489   11 years jmt12 Shouldn't have been here
(edit) @27488   11 years jmt12 Since I've got rid of the thousand DateTime prereq modules, I can …
(edit) @27487   11 years jmt12 Ensure Parallel Building path in environment (for ThriftFS) and that …
(edit) @27481   11 years jmt12 Adding makeAllDirectories() (which I'd only implemented in LocalFS) to …
(edit) @27480   11 years jmt12 Removing DateTime dependency (so HDFSShell will always fail …
(edit) @27479   11 years jmt12 Remove time parsing as DateTime is a fricking nightmare to install …
(edit) @27478   11 years jmt12 Be a bit smarter about locating Perl version if not provided (rather …
(edit) @27477   11 years jmt12 Changed the order of additions to java classpath to ensure that my …
(edit) @27476   11 years jmt12
(edit) @27475   11 years jmt12
(edit) @27474   11 years jmt12 Ignoring extracted modules
(edit) @27473   11 years jmt12 I give up - I'll just do without DateTime
(edit) @27472   11 years jmt12
(edit) @27471   11 years jmt12
(edit) @27470   11 years jmt12 No longer need to ignore all the files I moved to cpan
(edit) @27469   11 years jmt12 A dedicated folder to hold the many, many CPAN modules I've ended up …
(edit) @27468   11 years jmt12 The (repeated) functionality of all these scripts moved into CPAN.sh
(edit) @27467   11 years jmt12 An advanced cascade script that will loop through an (evergrowing) …
(edit) @27466   11 years jmt12 moved to cpan folder in packages
(edit) @27465   11 years jmt12 Moved to cpan directory so I can use smarter cascade make
(edit) @27463   11 years jmt12
(edit) @27462   11 years jmt12
(edit) @27461   11 years jmt12
(edit) @27460   11 years jmt12
(edit) @27459   11 years jmt12
(edit) @27458   11 years jmt12
(edit) @27457   11 years jmt12
(edit) @27456   11 years jmt12
(edit) @27455   11 years jmt12
(edit) @27454   11 years jmt12 This is like a satanic game of whack-a-mole. Here are the four prereqs …
(edit) @27453   11 years jmt12 Surprise - now Params::Validate has a prereq too, namely …
(edit) @27452   11 years jmt12 Yet another prereq for DateTime - Params::Validate
(edit) @27450   11 years jmt12 Moved opt_modulebuild_* functions into a library, and altered the …
(edit) @27448   11 years jmt12 Even more prerequisites for Module::Build - Perl::OSType, …
(edit) @27447   11 years jmt12 ignore extracted Module::Build module
(edit) @27446   11 years jmt12 ignore extracted Module::Build module
(edit) @27445   11 years jmt12 cascade files for Module::Build perl module
(edit) @27444   11 years jmt12 Craphat - ModuleBuild required for compiling DateTime
(edit) @27443   11 years jmt12 ignore new extracted directories (DateTime and Test::Fatal)
(edit) @27442   11 years jmt12 ignore new extracted directories (DateTime and Test::Fatal)
(edit) @27441   11 years jmt12 Calling the cascade files for Test::Fatal and DateTime module building
(edit) @27440   11 years jmt12 cascade file for DateTime module. Uses customized functions as …
(edit) @27439   11 years jmt12 cascade file for Test::Fatal module
(edit) @27438   11 years jmt12 Module required by DateTime, which in turn is required by the …
(edit) @27437   11 years jmt12 Why doesn't this exist on Medusa... I thought it was a built-in
(edit) @27436   11 years jmt12 Adding the actual script - rather than a symlink to my dropbox. doh
(edit) @27435   11 years jmt12 Gah - only a symbolic link
(edit) @27434   11 years jmt12 Updated the starting script to look in the correct place (in this …
(edit) @27433   11 years jmt12 Adding a few more details to the Hadoop log to assist with later work
(edit) @27432   11 years jmt12 ignore os specific install directories
(edit) @27431   11 years jmt12 ignore os specific install directories
(edit) @27430   11 years jmt12 ignore extracted packages
(edit) @27429   11 years jmt12 ignore extracted packages
(edit) @27428   11 years jmt12 Handbrake appears to have some conditional compilation things lurking …
(edit) @27427   11 years jmt12 Updated with interesting details and juicy gossip. Not really... but …
(edit) @27426   11 years jmt12 Add in a loop to attempt video conversion multiple times should the …
(edit) @27425   11 years jmt12 Tidying up debug comments and processing comments
(edit) @27424   11 years jmt12 Adding canRead() and isAbsolute() functions, and some more debugging …
(edit) @27423   11 years jmt12 Adding canRead() and isAbsolute() functions
(edit) @27422   11 years jmt12 Adding canRead() and isAbsolute() functions
(edit) @27421   11 years jmt12 Fixing bug in filePutContents (wasn't shifting parameters off front of …
(edit) @27420   11 years jmt12 Updated to reflect changes in the perllib customization (most of it …
(edit) @27419   11 years jmt12 Adding more reasonable default values for HDFS host and port (so the …
(edit) @27418   11 years jmt12 Also recompile the HadoopGreenstoneIngest.java file during cascade make
(edit) @27417   11 years jmt12 A 'pseudo'-CASCASE-MAKE file for building java code. It doesn't really …
(edit) @27416   11 years jmt12 Forgot to ensure the manifests generated here are also version 2
Note: See TracRevisionLog for help on using the revision log.