ARTICLE DETAIL

建站实战干货

来自一线的建站与推广经验沉淀,每一条都经过真实交付验证。

HDFS 常用shell命令

2026/9/6 2:48:12 拓冰建站 浏览量
HDFS 常用shell命令 一、基本语法hadoop fs或hdfs dfs二者是完全相同的。bin/hadoop fs[-appendToFilelocalsrc...dst][-cat[-ignoreCrc]src...][-chgrp[-R]GROUPPATH...][-chmod[-R]MODE[,MODE]...|OCTALMODEPATH...][-chown[-R][OWNER][:[GROUP]]PATH...][-copyFromLocal[-f][-p]localsrc...dst][-copyToLocal[-p][-ignoreCrc][-crc]src...localdst][-count[-q]path...][-cp[-f][-p]src...dst][-df[-h][path...]][-du[-s][-h]path...][-get[-p][-ignoreCrc][-crc]src...localdst][-getmerge[-nl]srclocaldst][-help[cmd...]][-ls[-d][-h][-R][path...]][-mkdir[-p]path...][-moveFromLocallocalsrc...dst][-moveToLocalsrclocaldst][-mvsrc...dst][-put[-f][-p]localsrc...dst][-rm[-f][-r|-R][-skipTrash]src...][-rmdir[--ignore-fail-on-non-empty]dir...]acl_specpath]][-setrep[-R][-w]reppath...][-stat[format]path...][-tail[-f]file][-test -[defsz]path][-text[-ignoreCrc]src...]二、示例1、基本操作-help输出这个命令参数。hadoop fs-helprm创建/sanguo文件夹。hadoop fs-mkdir/sanguo2、下载-moveFromLocal从本地剪切粘贴到HDFS。hadoop fs-moveFromLocal./shuguo.txt /sanguo-copyFromLocal从本地文件系统中拷贝文件到HDFS路径去。hadoop fs-copyFromLocalweiguo.txt /sanguo-put等同于copyFromLocal生产环境更习惯用put。hadoop fs-put./wuguo.txt /sanguo-appendToFile追加一个文件到已经存在的文件末尾。hadoop fs-appendToFileliubei.txt /sanguo/shuguo.txt3、下载-copyToLocal从HDFS拷贝到本地。hadoop fs-copyToLocal/sanguo/shuguo.txt ./-get等同于copyToLocal生产环境更习惯用get。hadoop fs-get/sanguo/shuguo.txt ./shuguo2.txt4、HDFS直接操作-ls显示目录信息。hadoop fs-ls/sanguo-cat显示文件内容。hadoop fs-cat/sanguo/shuguo.txt-chgrp、-chmod、-chownLinux文件系统中的用法一样修改文件所属权限。hadoop fs-chmod666/sanguo/shuguo.txt hadoop fs-chownatguigu:atguigu /sanguo/shuguo.txt-mkdir创建路径。hadoop fs-mkdir/jinguo-cp从HDFS的一个路径拷贝到HDFS的另一个路径。hadoop fs-cp/sanguo/shuguo.txt /jinguo-cp从HDFS的一个路径拷贝到HDFS的另一个路径。hadoop fs-cp/sanguo/shuguo.txt /jinguo-mv在HDFS目录中移动文件。hadoop fs-mv/sanguo/wuguo.txt /jinguo hadoop fs-mv/sanguo/weiguo.txt /jinguo-tail显示一个文件的末尾1kb的数据。hadoop fs-tail/jinguo/shuguo.txt-rm删除文件或文件夹。hadoop fs-rm/sanguo/shuguo.txt-rm -r递归删除目录及目录里面内容。hadoop fs-rm-r/sanguo-du统计文件夹的大小信息。hadoop fs-du-s-h/jinguo hadoop fs-du-h/jinguo-setrep设置HDFS中文件的副本数量。hadoop fs-setrep10/jinguo/shuguo.txt这里设置的副本数只是记录在NameNode的元数据中是否真的会有这么多副本还得看DataNode的数量。因为目前只有3台设备最多也就3个副本只有节点数的增加到10台时副本数才能达到10。