Hadoop HDFS basic commands

1.HDFS Hadoop command to delete file

hadoop fs -rm /user/cloudera/output/part-r-00000

hadoop fs -rm -r /user/cloudera/input/TestWC.txt

2. HDFS Hadoop command to delete directory

hadoop fs -rm -r -f /user/cloudera/output

3. HDFS Hadoop command to copy local file to HDFS file

hadoop fs -copyFromLocal /home/cloudera/Desktop/SAN/101.txt /user/cloudera/input

Also, this applies:

hadoop fs -put /home/cloudera/Desktop/SAN/101.txt /user/cloudera/input

4. Run jobs in the Mapreduce hadoop command

Pattern: hadoop jar {jar file local path} {pakageName.class} {hdfs input file location} {hdfs output file location}

eg.

hadoop jar /home/cloudera/Desktop/SAN/WordCoOccurPair.jar pair.WordCoOccurPair /user/cloudera/input /user/cloudera/output

5. Copy HDFS file into local file system command

Pattern : hadoop fs -copyToLocal {hdfs file path} {local folder path}

Eg.

hadoop fs -copyToLocal /user/cloudera/output/part-r-00000 /home/cloudera/Desktop/SAN/

6. Create folder in HDFS directory

hadoop fs -mkdir /user/cloudera/input2

This creates the folder input2 inside user/cloudera directory