source: other-projects/hathitrust/wcsa/extracted-features-solr/trunk/gslis-cluster/SCRIPTS/FULL-EF-HDFS.sh@ 31128

Last change on this file since 31128 was 31128, checked in by davidb, 7 years ago

Some scripts to help with pushing and monitoring the progress of the put into the HDFS file area

  • Property svn:executable set to *
File size: 934 bytes
RevLine 
[31128]1#!/bin/bash
2
3ssh gc0 "nohup PAIRTREE-FOREACH-HDFS-PUT.sh mdp > nohup-gc0-mdp.out 2>&1 &"
4ssh gc1 "nohup PAIRTREE-FOREACH-HDFS-PUT.sh uc1 > nohup-gc1-uc1.out 2>&1 &"
5ssh gc2 "nohup PAIRTREE-FOREACH-HDFS-PUT.sh hvd > nohup-gc2-hvd.out 2>&1 &"
6ssh gc3 "nohup PAIRTREE-FOREACH-HDFS-PUT.sh wu > nohup-gc3-wu.out 2>&1 &"
7
8
9#ssh gc0 "nohup hdfs dfs -put /data/features/ef-full/mdp full-ef-json-files/. > nohup-mdp.out 2>&1 &"
10#ssh gc1 "nohup hdfs dfs -put /data/features/ef-full/uc1 full-ef-json-files/. > nohup-uc1.out 2>&1 &"
11#ssh gc2 "nohup hdfs dfs -put /data/features/ef-full/hvd full-ef-json-files/. > nohup-hvd.out 2>&1 &"
12##ssh gc3 "nohup hdfs dfs -put /data/features/ef-full/wu full-ef-json-files/. > nohup-wu.out 2>&1 &"
13
14#ssh gc3 "nohup hdfs dfs -put /data/features/ef-full/inu full-ef-json-files/. > nohup-inu.out 2>&1 &"
15##ssh gc1 "nohup hdfs dfs -put /data/features/ef-full/coo full-ef-json-files/. > nohup-coo.out 2>&1 &"
Note: See TracBrowser for help on using the repository browser.