- Timestamp:
- 2019-09-05T17:26:27+12:00 (5 years ago)
- File:
-
- 1 edited
Legend:
- Unmodified
- Added
- Removed
-
gs3-extensions/maori-lang-detection/MoreReading/Vagrant-Spark-Hadoop.txt
r33448 r33456 1 Hadoop/Map-reduce 2 3 https://www.guru99.com/create-your-first-hadoop-program.html 4 5 -------------- 1 6 To run firefox/anything graphical inside the VM run by vagrant, have to ssh -Y onto both analytics and then to the vagrant VM from analytics: 2 7 1. ssh analytics -Y … … 41 46 vagrant@node1:~/cc-index-table/src/script$ hdfs dfs -cat hdfs:///user/vagrant/cc-mri-unzipped-csv/cc-mri.csv | wc -l 42 47 345625 48 49 50 51 vagrant@node1:~/cc-index-table$ hdfs dfs -cat hdfs:///user/vagrant/cc-mri-csv/part* > file.csv.gz 52 vagrant@node1:~/cc-index-table$ less file.csv.gz 53 54 55 https://www.patricia-anong.com/blog/2017/11/1/extend-vmdk-on-virtualbox 56 57 58 When not using LIKE '%mri%' but = 'mri' instead: 59 vagrant@node1:~/cc-index-table$ hdfs dfs -cat hdfs:///user/vagrant/cc-mri-unzipped-csv/cc-mri.csv | wc -l 60 5767 43 61 44 62 -----------------------------------------
Note:
See TracChangeset
for help on using the changeset viewer.