部署 Hive

只需要部署在 Hadoop 的 master 节点即可

1. 下载 hive

   dlcdn.apache.org/hive/

2. 解压

sudo tar -zxvf apache-hive-3.1.3-bin.tar.gz -C /opt
sudo mv /opt/apache-hive-3.1.3-bin  /opt/hive
sudo chown -R hadoop:hadoop /opt/hive

3. 配置环境变量

export HIVE_HOME=/opt/hive
export PATH=$JAVA_HOME/bin:$HADOOP_HOME/bin:$HIVE_HOME/bin:$PATH

source /etc/profile

4. 使用 mysql 元数据存储

• 安装mysql

 sudo apt update && sudo apt install -y mysql-server
 sudo mysql_secure_installation

• 创建数据库、帐号

CREATE DATABASE hive_metastore;

CREATE USER 'hive'@'localhost' IDENTIFIED BY '123456';
GRANT ALL PRIVILEGES ON hive_metastore.* TO 'hive'@'localhost';
FLUSH PRIVILEGES;

• 下载 jar 包，拷贝到 $HIVE_HOME/lib

repo1.maven.org/maven2/mysq…

• 修改 hive-site.html

<configuration>
    <property>
        <name>javax.jdo.option.ConnectionURL</name>
        <value>jdbc:mysql://bigdata01:3306/metastore?createDatabaseIfNotExist=true</value>
        <description>JDBC connect string for a JDBC metastore</description>
    </property>
    <property>
        <name>javax.jdo.option.ConnectionDriverName</name>
        <value>com.mysql.jdbc.Driver</value>
        <description>Driver class name for a JDBC metastore</description>
    </property>
    <property>
        <name>javax.jdo.option.ConnectionUserName</name>
        <value>root</value>
        <description>username to use against metastore database</description>
    </property>
    <property>
        <name>javax.jdo.option.ConnectionPassword</name>
        <value>root</value>
        <description>password to use against metastore database</description>
    </property>
</configuration>

• 初始化Metastore数据库

schematool -dbType mysql -initSchema

5. 启动 hive

hive

hive> show databases;

hive> exit; # 退出