source: other-projects/hathitrust/wcsa/extracted-features-solr/trunk/gslis-cluster/SCRIPTS/FILE-SIZE-CHECK-HDFS.sh

Last change on this file was 31161, checked in by davidb, 5 years ago

Comparison of local disk version with HDFS version

  • Property svn:executable set to *
File size: 113 bytes
Line 
1#!/bin/bash
2
3hdfs dfs -du -s full-ef-json-files/* | awk '{ print $1 " " $3 }' | sed 's/full-ef-json-files\///'
4
Note: See TracBrowser for help on using the repository browser.