大数据集群规划(12台主机的大数据集群规划)

329 阅读1分钟

集群规划图如下

集群规划详情如下

Master Hosts[3]

Host1

  • Zookeeper Server
  • Kafka Broker
  • HDFS Name Node
  • HDFS Journal Node
  • HDFS Failover COntroller
  • YRAN Resource Manager
  • YRAN JobHistory Server

Host2

  • Zookeeper Server
  • Kafka Broker
  • HDFS Name Node
  • HDFS Journal Node
  • HDFS Failover COntroller
  • YRAN Resource Manager

Host3

  • Zookeeper Server
  • Kafka Broker
  • Spark History Server

Gateway Hosts[1]

Host1

  • Hue Server
  • Hue Load Balancer
  • Hive Server2
  • Gateway Configuration

Worker Hosts[12]

  • HDFS Data Node

  • YRAN Node Manager

  • Impala Deamon

  • Hive Gateway

Utility Hosts[1]

Host1

  • Cloudera Manager
  • Cloudera Manager Service Alert Publisher
  • Cloudera Manager Service Event Server
  • Cloudera Manager Service Host Monitor
  • Cloudera Manager Service Service Monitor
  • Impala Catalog Server
  • Impala StateStore
  • Hive Metastore
  • Oozie Server