Changeset 30908

Timestamp:

2016-10-24T15:39:07+13:00 (7 years ago)

Author:

davidb

Message:

Additional finesse added in as a result of further testing on Vagrant master node

Location:

other-projects/hathitrust/solr-extracted-features/trunk/scripts

Files:

• PD-DOWNLOAD-EVERY-1000.sh (modified) (1 diff)
• PD-DOWNLOAD-EVERY-10000.sh (added)
• PD-GET-FULL-FILE-LIST.sh (added)
• PD-SELECT-EVERY-10000.sh (added)

other-projects/hathitrust/solr-extracted-features/trunk/scripts/PD-DOWNLOAD-EVERY-1000.sh

@@ -1 @@
-rsync -pav --progress --files-from=pd-file-listing-step1000.txt data.analytics.hathitrust.org::pd-features/ json-files/.
+#!/bin/bash
+
+if [ ! -d ef-json-files ] ; then
+  mkdir ef-json-files
+fi
+
+rsync -pav --progress --files-from=pd-file-listing-step1000.txt data.analytics.hathitrust.org::pd-features/ ef-json-files/.