集群数量:3台
配置(推荐配置):
软件:
集群部署计划
| | hadoop1 | hadoop2 | hadoop3 |
| ----------------------- | ---------------------- | -------------------------------- | ------------------------------- |
| Hadoop-hdfs | nameNode
dataNode | dataNode | dataNode
secondaryNameNode |
| Hadoop-yarn | nodeManager | nodeManager
resourceManager | nodeManager |
| zookeeper | ✅ | ✅ | ✅ |
| flume | 采集 | 采集 | 传输 |
| kafka | ✅ | ✅ | ✅ |
| hbase | ✅ | ✅ | ✅ |
| spark | ✅ | ✅ | ✅ |
| hive | ✅ | | |
| MySQL(保存hive元数据) | ✅ | | |