source: gs2-extensions

Revision Log Mode:


Legend:

Added
Modified
Copied or renamed
Diff Rev Age Author Log Message
(edit) @27679   8 years davidb Embelishment of the web content
(edit) @27669   8 years jmt12 Sort compute nodes naturally before labelling them with incremental …
(edit) @27654   8 years jmt12 Add the ability to stagger the starting of Mappers by placing a …
(edit) @27653   8 years jmt12 Forgot to pull self off the head of arguments
(edit) @27652   8 years jmt12 Changing buffer to 128K (slightly faster) and adding a comment …
(edit) @27651   8 years jmt12
(edit) @27650   8 years jmt12
(edit) @27649   8 years jmt12 No longer in SVN control
(edit) @27648   8 years jmt12 Template for setup.bash - a user will have to populate Hadoop fields
(edit) @27647   8 years jmt12 Add some more testing to ensure any local copy of a media file is the …
(edit) @27645   8 years jmt12
(edit) @27644   8 years jmt12 Extended to support HDFS-access via NFS. This applies to both the call …
(edit) @27643   8 years jmt12 Changed the script generator so it can recurse through directories and …
(edit) @27642   8 years jmt12 A script I downloaded that successfully splits video files - something …
(edit) @27641   8 years jmt12 Altered order of arguments and allow archives dir to be passed as …
(edit) @27640   8 years jmt12
(edit) @27638   8 years jmt12 Change it so failure to open a filehandle isn't fatal - leave it up to …
(edit) @27633   8 years sjm84 Under linux, test for linux/magic.h causes a compilation error on …
(edit) @27631   8 years jmt12 A proxy to allow NFS access to HDFS
(edit) @27620   8 years ak19 Rebuilt dist on 32 bit machine. Dr Bainbridge removed the absolute …
(edit) @27618   8 years ak19 Dr Bainbridge removed the absolute paths in symbolic links to new bz …
(edit) @27616   8 years davidb Fine tuning
(edit) @27615   8 years davidb
(edit) @27614   8 years davidb Now generated from '.in' file, and no longer under SVN control
(edit) @27613   8 years davidb Create AFR-SETUP.sh from its '.in' counterpart if it does not already exist
(edit) @27612   8 years davidb .in file from which a local copy is made (not under SVN control) that …
(edit) @27611   8 years davidb Improved wording
(edit) @27610   8 years davidb Bespoke script for the SALAMI script
(edit) @27609   8 years davidb Setting needed by 'cluster1'
(edit) @27608   8 years davidb Tidy up
(edit) @27607   8 years davidb Due to unusual configure/compile script, tarclean tested for earlier …
(edit) @27606   8 years davidb Yasm needed by cascade make, but found not to be present (be default) …
(edit) @27605   8 years davidb Yasm needed by cascade make, but found not to be present (be default) …
(edit) @27599   8 years davidb Update to text message
(edit) @27598   8 years davidb Used to control the hostname and port services run on
(edit) @27595   8 years jmt12 Updating list of untarred directories to ignore
(edit) @27594   8 years jmt12 Extend hadoop_import.pl to be able to start and stop the Thrift server(s)
(edit) @27593   8 years jmt12 Need Class Accessor for Thrift client under Rocks
(edit) @27592   8 years jmt12 Adding in a script to allow a daemon version of Thrift to be started …
(edit) @27591   8 years jmt12 Ensure Thrift will, be default, attempt to connect to the local …
(edit) @27590   8 years jmt12 Adding statistics about data locality, and highlighting tasks where …
(edit) @27589   8 years jmt12 Fixing up some minor bugs in regex's
(edit) @27588   8 years jmt12 Extend parser to support jobs that are split over several logs. Also …
(edit) @27587   8 years jmt12 Allow debug mode to be enabled from the command line
(edit) @27586   8 years jmt12 Updating script to date date of hadoop job into account when searching …
(edit) @27585   8 years jmt12 The perl on Medusa won't let you immediately treat a returned array in …
(edit) @27584   8 years jmt12 I wasn't doing -r when attempting to clear directories left in /tmp by …
(edit) @27583   8 years jmt12 Adding code to differentiate between workers in a cluster - all of …
(edit) @27582   8 years ak19 New imagemagick distribution for 32 BIT LINUX that includes zlib (libz …
(edit) @27581   8 years ak19 New imagemagick distribution for linux 64 bit that includes zlib (libz …
(edit) @27580   8 years ak19 Adding libbz2 (bzip2) and its cascade-make file from gnome-lin, …
(edit) @27571   8 years jmt12 increase timeout to 4 hours per map
(edit) @27570   8 years jmt12 Make the warning about binmode() not being applicable more meaningful, …
(edit) @27569   8 years jmt12 Trying to streamline the error messages from failing to link …
(edit) @27568   8 years jmt12 Testing on Medusa suggests optimal buffer size around 128K
(edit) @27567   8 years jmt12 Found a printWarning that I handed changed to use the FileUtils version
(edit) @27566   8 years jmt12 Making the getcpu optional - as it isn't available on Medusa (but then …
(edit) @27561   8 years jmt12 Adding very basic compile file for getcpu - can't be bothered going …
(edit) @27560   8 years jmt12 Fixing typo in regexp that meant filenames sometimes ignored
(edit) @27559   8 years jmt12 Changed mime-type away from binary - I hope. Meanwhile, generate …
(edit) @27558   8 years jmt12 Forgot that Hadoop Map processes no longer have the environment …
(edit) @27552   8 years jmt12 Altering the debug comments to provide IO boundary timings a little …
(edit) @27551   8 years jmt12 Altered so that it expects to be given a CSV containing parallel …
(edit) @27550   8 years jmt12 Ensure the hostname is added to the Hadoop logs so we can identify the …
(edit) @27549   8 years jmt12 Extract information from the logs generated by parallel Greenstone …
(edit) @27548   8 years jmt12 Extract information from the logs generated by parallel Greenstone …
(edit) @27547   8 years jmt12 Rejigging some processing comments
(edit) @27546   8 years jmt12 Adding the ability for the Hadoop Mapper to determine what CPU number …
(edit) @27545   8 years jmt12 Ignoring just the compiled file (for now)
(edit) @27544   8 years jmt12 A tiny C script to guesstimate the CPU the calling Process is on
(edit) @27543   8 years jmt12 Adding generate_gantt.pl script in its original form - i.e. directly …
(edit) @27532   8 years jmt12 Add the ability to configure the Thrift connector using a …
(edit) @27531   8 years jmt12 Only output the message about using copy instead of hard/soft link once
(edit) @27530   8 years jmt12 Clear out old logs, and adding more comments about what the script is …
(edit) @27529   8 years jmt12 Fixing a bug (HDFS drivers not being recognized due to sometimes …
(edit) @27527   8 years jmt12 Calling the isHDFS() in FileUtils rather than the non-existant one in utils
(edit) @27526   8 years jmt12 Adding in a 'isHDFS()' function so that some plugins (SimpleVideoPlug) …
(edit) @27525   8 years jmt12 Adding in a 'isHDFS()' function so that some plugins (SimpleVideoPlug) …
(edit) @27515   8 years jmt12 Making the file used durig buffertes be configurable
(edit) @27514   8 years jmt12 Altering code to allow configurable length of read/write buffer when …
(edit) @27512   8 years jmt12 Adding in a special test for measuring the effect of altering ThriftFS …
(edit) @27510   8 years ak19 Using the recommended FileUtils.pm methods in place of the deprecated …
(edit) @27496   8 years jmt12 Replacing a smelly old util::file_exists() with a snazzy new …
(edit) @27495   8 years jmt12 removing doubled up debug comments and putting some paths in …
(edit) @27494   8 years jmt12 Fixing a truncated comment - or maybe I never wrote an end to it…
(edit) @27493   8 years jmt12 No longer required - not that sure why it was required in the first place
(edit) @27492   8 years jmt12 Some versions of Hadoop add host and protocol information into paths - …
(edit) @27491   8 years jmt12 Repairing three bugs in makeAllDirectories - incorrect pattern meant …
(edit) @27490   8 years jmt12 No longer requires
(edit) @27489   8 years jmt12 Shouldn't have been here
(edit) @27488   8 years jmt12 Since I've got rid of the thousand DateTime prereq modules, I can …
(edit) @27487   8 years jmt12 Ensure Parallel Building path in environment (for ThriftFS) and that …
(edit) @27481   8 years jmt12 Adding makeAllDirectories() (which I'd only implemented in LocalFS) to …
(edit) @27480   8 years jmt12 Removing DateTime dependency (so HDFSShell will always fail …
(edit) @27479   8 years jmt12 Remove time parsing as DateTime is a fricking nightmare to install …
(edit) @27478   8 years jmt12 Be a bit smarter about locating Perl version if not provided (rather …
(edit) @27477   8 years jmt12 Changed the order of additions to java classpath to ensure that my …
(edit) @27476   8 years jmt12
(edit) @27475   8 years jmt12
(edit) @27474   8 years jmt12 Ignoring extracted modules
Note: See TracRevisionLog for help on using the revision log.