​环境介绍：

Centos7

Sqoop1.99.6

Hadoop2.6

Mysql5.6

1 Sqoop1.99.6安装

1.1Sqoop1.99.6安装

首先从官网(mirror.bit.edu.cn/apache/sqoo…)下载sqoop-1.99.6-bin-hadoop200.tar.gz，解压放在/usr/local/sqoop目录中。

在/etc/profile中添加如下配置

export SQOOP_HOME=/usr/local/sqoopexport CATALINA_HOME=$SQOOP_HOME/serverexport LOGDIR=$SQOOP_HOME/logs

  并将SQOOP_HOME添加到PATH中，export PATH=$PATH:$JAVA_HOME/bin: $SQOOP_HOME/bin。

       进入/usr/local/sqoop/server/conf/目录下，修改sqoop.properties

org.apache.sqoop.submission.engine.mapreduce.configuration.directory=/usr/local/hadoop (hadoop安装目录)org.apache.sqoop.log4j.appender.file.File=/usr/local/sqoop/logs/sqoop.log#org.apache.sqoop.log4j.appender.file.File=@LOGDIR@/sqoop.log#org.apache.sqoop.auditlogger.default.file=@LOGDIR@/default.auditorg.apache.sqoop.auditlogger.default.file=/usr/local/sqoop/logs/default.audit

 修改catalina.properties

common.loader=${catalina.base}/lib,${catalina.base}/lib/*.jar,${catalina.home}/lib,${catalina.home}/lib/*.jar,${catalina.home}/../lib/*.jar,/usr/local/hadoop/share/hadoop/common/*.jar,/usr/local/hadoop/share/hadoop/common/lib/*.jar,/usr/local/hadoop/share/hadoop/hdfs/*.jar,/usr/local/hadoop/share/hadoop/hdfs/lib/*.jar,/usr/local/hadoop/share/hadoop/mapreduce/*.jar,/usr/local/hadoop/share/hadoop/mapreduce/lib/*.jar,/usr/local/hadoop/share/hadoop/tools/*.jar,/usr/local/hadoop/share/hadoop/tools/lib/*.jar,/usr/local/hadoop/share/hadoop/yarn/*.jar,/usr/local/hadoop/share/hadoop/yarn/lib/*.jar,/usr/local/hadoop/share/hadoop/httpfs/tomcat/lib/*.jar

拷贝mysql-connector-java-5.1.39-bin.jar到/usr/local/sqoop/server/lib目录下。在/usr/local/sqoop/目录下新建lib目录。

1.2Sqoop1.99.6启动

进入/usr/local/sqoop/bin目录下，执行

sqoop.sh server start

执行如下命令，进入命令行模式。

sqoop.sh client

设置服务端

set server –host localhost –port 12000 –webapp sqoop

查看版本信息

show connector

​

 分别建立与MySQL、hadoop的连接。​​

查看连接信息

​​​​​​​​

 建立job任务

​​​​​​​​ 

具体参看sqoop.apache.org/docs/1.99.6…

启动job，出现如下情况表示运行成功。

​

1.3 mysql数据表

在上面导出的MySQL表中，主要是databases:test下的user表。

​​​​​​​​ 

 

1.4在hadoop上查看

Warning：必须确保你的hadoop安装完全正确！！！

即出现如下两个页面。

​

​

在/sqoop中有如下

​

 这两个文件为生成的txt文件，打开查看

​

 发现跟MySQL中的的数据完全一样，导入成功。

注意： 如果在导入的过程中，出现以下问题，请查看/usr/local/sqoop/logs/文件下的sqoop.log文件，根据相应的报错来解决问题。

Exception has occurred during processing command 
Exception:org.apache.sqoop.common.SqoopExceptionMessage: CLIENT_0001:Server has returned exception

​ 

​