Last change
on this file since 31053 was 31053, checked in by davidb, 7 years ago |
Addition of second argument, optional, for where to save the files
|
-
Property svn:executable
set to
*
|
File size:
656 bytes
|
Rev | Line | |
---|
[31034] | 1 | #!/bin/bash
|
---|
| 2 |
|
---|
[31053] | 3 | argc=$#
|
---|
| 4 |
|
---|
| 5 | if [ "$argc" != "1" ] && [ "$argc" != "2" ] ; then
|
---|
| 6 | echo "Usage FULL-DOWNLOAD-EVERY-N.sh <num> [output-dir]" >&2
|
---|
[31034] | 7 | exit 1
|
---|
| 8 | fi
|
---|
| 9 |
|
---|
| 10 | num=$1
|
---|
| 11 |
|
---|
[31053] | 12 | if [ "$argc" = "2" ] ; then
|
---|
| 13 | output_dir="$2"
|
---|
| 14 | else
|
---|
| 15 | output_dir="full-ef-json-files"
|
---|
[31034] | 16 | fi
|
---|
| 17 |
|
---|
[31053] | 18 | # Remove any trailing /.
|
---|
| 19 | output_dir="${output_dir%/\.}"
|
---|
| 20 | output_dir="${output_dir%/}"
|
---|
| 21 |
|
---|
| 22 | if [ ! -d "$output_dir" ] ; then
|
---|
| 23 | echo ""
|
---|
| 24 | echo "****"
|
---|
| 25 | echo "* Creating $output_dir"
|
---|
| 26 | echo "****"
|
---|
| 27 | echo ""
|
---|
| 28 | mkdir "$output_dir"
|
---|
| 29 | fi
|
---|
| 30 |
|
---|
| 31 | # Now ensure a trailing /. is present!
|
---|
| 32 | output_dir="${output_dir}/."
|
---|
| 33 |
|
---|
| 34 |
|
---|
[31035] | 35 | rsync -pav --files-from=full-listing-step${num}.txt \
|
---|
[31053] | 36 | data.analytics.hathitrust.org::features/ $output_dir
|
---|
Note:
See
TracBrowser
for help on using the repository browser.