HDFS DFS

In Hadoop, the term “HDFS DFS” is not a standard command or operation. However, it’s possible that you may have encountered it in the context of Hadoop commands. Typically, Hadoop users interact with the Hadoop Distributed File System (HDFS) using the hdfs dfs command-line tool, which provides a set of subcommands for various file and directory operations within HDFS.

Here are some common hdfs dfs subcommands:

1. List Files and Directories:

   • hdfs dfs -ls: Lists files and directories in HDFS.

2. Create Directories:

   • hdfs dfs -mkdir: Creates one or more directories in HDFS.

3. Upload Data:

   • hdfs dfs -put: Copies files or directories from the local file system to HDFS.

4. Download Data:

   • hdfs dfs -get: Copies files or directories from HDFS to the local file system.

5. View File Content:

   • hdfs dfs -cat: Displays the contents of a file in HDFS.

6. Remove Files/Directories:

   • hdfs dfs -rm: Deletes files or directories in HDFS.
   • hdfs dfs -rm -r: Recursively deletes files and directories.

7. Copy Between File Systems:

   • hdfs dfs -copyToLocal: Copies files from HDFS to the local file system.
   • hdfs dfs -copyFromLocal: Copies files from the local file system to HDFS.

8. Move or Rename Files/Directories:

   • hdfs dfs -mv: Moves or renames files and directories in HDFS.

9. Change Permissions and Ownership:

   • hdfs dfs -chmod: Changes file or directory permissions in HDFS.
   • hdfs dfs -chown: Changes file or directory ownership in HDFS.

10. Check Disk Usage:

    • hdfs dfs -du: Shows the amount of space used by files and directories in HDFS.