Cluster Balancing Algorithm
This section describes the algorithm deployed by the HDFS Balancer to balance the cluster. The HDFS Balancer runs in iterations. Each iteration consists of the following steps:
- 1. Accidental Deletion Protection
- 2. ACLs on HDFS
- 3. Archival Storage
- 4. Backing Up HDFS Metadata
- 5. Balancing in HDFS
- 6. Centralized Cache Management in HDFS
- 7. Configuring HDFS Compression
- 8. Configuring Rack Awareness On HDP
- 9. Customizing HDFS
- 10. G1GC Garbage Collector Configuration (Technical Preview)
- 11. Hadoop Archives
- 12. HDFS DataNode Monitoring
- 13. JMX Metrics APIs for HDFS Daemons
- 14. Memory as Storage (Technical Preview)
- 15. Running DataNodes as Non-Root
- 16. Short Circuit Local Reads On HDFS
- 17. WebHDFS Administrator Guide