hadoop hdfs配置设置和优化

HttpFs(HDFS over HTTP)
     telnet server01 14000
     http://server01:14000/webhdfs/v1/?op=gethomedirectory&user.name=hdfs
     http://server01:14000/webhdfs/v1/tmp/?op=LISTSTATUS&user.name=hdfs 

    doc: http://hadoop.apache.org/docs/r2.7.2/hadoop-project-dist/hadoop-hdfs/WebHDFS.html

HA[Namenode and ResourceManager]

DistCp
   .http
     -hadoop distcp hftp://oldHDFS:50070/    hdfs://newHDFS:8020/
     -hadoop distcp hdfs://oldHDFS:8020/    hdfs://newHDFS:8020/

HDFS Cache
        . Centralized Cache Management in HDFS

        hdfs  cacheadmin -listPools

        hdfs  cacheadmin -listDirectives -pool impala_pool

        hdfs cacheadmin -addPool impala_pool 

        hdfs cacheadmin -addDirective -path /apps -pool impala_pool

        hdfs cacheadmin -listDirectives -pool impala_pool

NFS
  - http://hadoop.apache.org/docs/r2.7.2/hadoop-project-dist/hadoop-hdfs/HdfsNfsGateway.html
  - http://www.itweet.cn/2015/07/10/HDFS_NFS_Gateway/