|
|
@27570
|
11 years |
jmt12 |
Make the warning about binmode() not being applicable more meaningful, …
|
|
|
@27569
|
11 years |
jmt12 |
Trying to streamline the error messages from failing to link …
|
|
|
@27568
|
11 years |
jmt12 |
Testing on Medusa suggests optimal buffer size around 128K
|
|
|
@27567
|
11 years |
jmt12 |
Found a printWarning that I handed changed to use the FileUtils version
|
|
|
@27566
|
11 years |
jmt12 |
Making the getcpu optional - as it isn't available on Medusa (but then …
|
|
|
@27561
|
11 years |
jmt12 |
Adding very basic compile file for getcpu - can't be bothered going …
|
|
|
@27560
|
11 years |
jmt12 |
Fixing typo in regexp that meant filenames sometimes ignored
|
|
|
@27559
|
11 years |
jmt12 |
Changed mime-type away from binary - I hope. Meanwhile, generate …
|
|
|
@27558
|
11 years |
jmt12 |
Forgot that Hadoop Map processes no longer have the environment …
|
|
|
@27551
|
11 years |
jmt12 |
Altered so that it expects to be given a CSV containing parallel …
|
|
|
@27550
|
11 years |
jmt12 |
Ensure the hostname is added to the Hadoop logs so we can identify the …
|
|
|
@27549
|
11 years |
jmt12 |
Extract information from the logs generated by parallel Greenstone …
|
|
|
@27548
|
11 years |
jmt12 |
Extract information from the logs generated by parallel Greenstone …
|
|
|
@27547
|
11 years |
jmt12 |
Rejigging some processing comments
|
|
|
@27546
|
11 years |
jmt12 |
Adding the ability for the Hadoop Mapper to determine what CPU number …
|
|
|
@27545
|
11 years |
jmt12 |
Ignoring just the compiled file (for now)
|
|
|
@27544
|
11 years |
jmt12 |
A tiny C script to guesstimate the CPU the calling Process is on
|
|
|
@27543
|
11 years |
jmt12 |
Adding generate_gantt.pl script in its original form - i.e. directly …
|
|
|
@27532
|
11 years |
jmt12 |
Add the ability to configure the Thrift connector using a …
|
|
|
@27531
|
11 years |
jmt12 |
Only output the message about using copy instead of hard/soft link once
|
|
|
@27530
|
11 years |
jmt12 |
Clear out old logs, and adding more comments about what the script is …
|
|
|
@27526
|
11 years |
jmt12 |
Adding in a 'isHDFS()' function so that some plugins (SimpleVideoPlug) …
|
|
|
@27525
|
11 years |
jmt12 |
Adding in a 'isHDFS()' function so that some plugins (SimpleVideoPlug) …
|
|
|
@27515
|
11 years |
jmt12 |
Making the file used durig buffertes be configurable
|
|
|
@27514
|
11 years |
jmt12 |
Altering code to allow configurable length of read/write buffer when …
|
|
|
@27512
|
11 years |
jmt12 |
Adding in a special test for measuring the effect of altering ThriftFS …
|
|
|
@27496
|
11 years |
jmt12 |
Replacing a smelly old util::file_exists() with a snazzy new …
|
|
|
@27495
|
11 years |
jmt12 |
removing doubled up debug comments and putting some paths in …
|
|
|
@27494
|
11 years |
jmt12 |
Fixing a truncated comment - or maybe I never wrote an end to it…
|
|
|
@27493
|
11 years |
jmt12 |
No longer required - not that sure why it was required in the first place
|
|
|
@27492
|
11 years |
jmt12 |
Some versions of Hadoop add host and protocol information into paths - …
|
|
|
@27491
|
11 years |
jmt12 |
Repairing three bugs in makeAllDirectories - incorrect pattern meant …
|
|
|
@27490
|
11 years |
jmt12 |
No longer requires
|
|
|
@27489
|
11 years |
jmt12 |
Shouldn't have been here
|
|
|
@27488
|
11 years |
jmt12 |
Since I've got rid of the thousand DateTime prereq modules, I can …
|
|
|
@27487
|
11 years |
jmt12 |
Ensure Parallel Building path in environment (for ThriftFS) and that …
|
|
|
@27481
|
11 years |
jmt12 |
Adding makeAllDirectories() (which I'd only implemented in LocalFS) to …
|
|
|
@27480
|
11 years |
jmt12 |
Removing DateTime dependency (so HDFSShell will always fail …
|
|
|
@27479
|
11 years |
jmt12 |
Remove time parsing as DateTime is a fricking nightmare to install …
|
|
|
@27478
|
11 years |
jmt12 |
Be a bit smarter about locating Perl version if not provided (rather …
|
|
|
@27477
|
11 years |
jmt12 |
Changed the order of additions to java classpath to ensure that my …
|
|
|
@27476
|
11 years |
jmt12 |
|
|
|
@27475
|
11 years |
jmt12 |
|
|
|
@27474
|
11 years |
jmt12 |
Ignoring extracted modules
|
|
|
@27473
|
11 years |
jmt12 |
I give up - I'll just do without DateTime
|
|
|
@27472
|
11 years |
jmt12 |
|
|
|
@27471
|
11 years |
jmt12 |
|
|
|
@27470
|
11 years |
jmt12 |
No longer need to ignore all the files I moved to cpan
|
|
|
@27469
|
11 years |
jmt12 |
A dedicated folder to hold the many, many CPAN modules I've ended up …
|
|
|
@27468
|
11 years |
jmt12 |
The (repeated) functionality of all these scripts moved into CPAN.sh
|
|
|
@27467
|
11 years |
jmt12 |
An advanced cascade script that will loop through an (evergrowing) …
|
|
|
@27466
|
11 years |
jmt12 |
moved to cpan folder in packages
|
|
|
@27465
|
11 years |
jmt12 |
Moved to cpan directory so I can use smarter cascade make
|
|
|
@27463
|
11 years |
jmt12 |
|
|
|
@27462
|
11 years |
jmt12 |
|
|
|
@27461
|
11 years |
jmt12 |
|
|
|
@27460
|
11 years |
jmt12 |
|
|
|
@27459
|
11 years |
jmt12 |
|
|
|
@27458
|
11 years |
jmt12 |
|
|
|
@27457
|
11 years |
jmt12 |
|
|
|
@27456
|
11 years |
jmt12 |
|
|
|
@27455
|
11 years |
jmt12 |
|
|
|
@27454
|
11 years |
jmt12 |
This is like a satanic game of whack-a-mole. Here are the four prereqs …
|
|
|
@27453
|
11 years |
jmt12 |
Surprise - now Params::Validate has a prereq too, namely …
|
|
|
@27452
|
11 years |
jmt12 |
Yet another prereq for DateTime - Params::Validate
|
|
|
@27450
|
11 years |
jmt12 |
Moved opt_modulebuild_* functions into a library, and altered the …
|
|
|
@27448
|
11 years |
jmt12 |
Even more prerequisites for Module::Build - Perl::OSType, …
|
|
|
@27447
|
11 years |
jmt12 |
ignore extracted Module::Build module
|
|
|
@27446
|
11 years |
jmt12 |
ignore extracted Module::Build module
|
|
|
@27445
|
11 years |
jmt12 |
cascade files for Module::Build perl module
|
|
|
@27444
|
11 years |
jmt12 |
Craphat - ModuleBuild required for compiling DateTime
|
|
|
@27443
|
11 years |
jmt12 |
ignore new extracted directories (DateTime and Test::Fatal)
|
|
|
@27442
|
11 years |
jmt12 |
ignore new extracted directories (DateTime and Test::Fatal)
|
|
|
@27441
|
11 years |
jmt12 |
Calling the cascade files for Test::Fatal and DateTime module building
|
|
|
@27440
|
11 years |
jmt12 |
cascade file for DateTime module. Uses customized functions as …
|
|
|
@27439
|
11 years |
jmt12 |
cascade file for Test::Fatal module
|
|
|
@27438
|
11 years |
jmt12 |
Module required by DateTime, which in turn is required by the …
|
|
|
@27437
|
11 years |
jmt12 |
Why doesn't this exist on Medusa... I thought it was a built-in
|
|
|
@27436
|
11 years |
jmt12 |
Adding the actual script - rather than a symlink to my dropbox. doh
|
|
|
@27435
|
11 years |
jmt12 |
Gah - only a symbolic link
|
|
|
@27434
|
11 years |
jmt12 |
Updated the starting script to look in the correct place (in this …
|
|
|
@27433
|
11 years |
jmt12 |
Adding a few more details to the Hadoop log to assist with later work
|
|
|
@27424
|
11 years |
jmt12 |
Adding canRead() and isAbsolute() functions, and some more debugging …
|
|
|
@27423
|
11 years |
jmt12 |
Adding canRead() and isAbsolute() functions
|
|
|
@27422
|
11 years |
jmt12 |
Adding canRead() and isAbsolute() functions
|
|
|
@27421
|
11 years |
jmt12 |
Fixing bug in filePutContents (wasn't shifting parameters off front of …
|
|
|
@27420
|
11 years |
jmt12 |
Updated to reflect changes in the perllib customization (most of it …
|
|
|
@27419
|
11 years |
jmt12 |
Adding more reasonable default values for HDFS host and port (so the …
|
|
|
@27418
|
11 years |
jmt12 |
Also recompile the HadoopGreenstoneIngest.java file during cascade make
|
|
|
@27417
|
11 years |
jmt12 |
A 'pseudo'-CASCASE-MAKE file for building java code. It doesn't really …
|
|
|
@27416
|
11 years |
jmt12 |
Forgot to ensure the manifests generated here are also version 2
|
|
|
@27415
|
11 years |
jmt12 |
Ensuring the manifests generated are marked as version 2 - i.e. should …
|
|
|
@27414
|
11 years |
jmt12 |
Allowing more processing arguments to be configured at the call, and …
|
|
|
@27413
|
11 years |
jmt12 |
Making the Hadoop processing aware that there are two different …
|
|
|
@27412
|
11 years |
jmt12 |
I obviously hadn't run this script on Karearea before - assumed all …
|
|
|
@27409
|
11 years |
jmt12 |
Unit test like testing for the FileUtils class and LocalFS, HDFSShell, …
|
|
|
@27408
|
11 years |
jmt12 |
A symbolic link to the actual script in the packages directory
|
|
|
@27407
|
11 years |
jmt12 |
updating ignore
|
|
|
@27406
|
11 years |
jmt12 |
Updating ignore
|
|
|
@27405
|
11 years |
jmt12 |
Now that I can get the Perl version, make the cascade make script …
|
|
|