ICode9

精准搜索请尝试: 精确搜索
首页 > 系统相关> 文章详细

Centos7安装Sqoop

2021-09-15 09:05:25  阅读:165  来源: 互联网

标签:opt 1.4 sqoop Sqoop module Centos7 bigdata01 HOME 安装


1、将sqoop-1.4.6.bin__hadoop-2.0.4-alpha.tar.gz上传至/opt/software

2、解压

[bigdata@bigdata01 software]$ tar -zxvf sqoop-1.4.6.bin__hadoop-2.0.4-alpha.tar.gz -C /opt/module/

3、修改名称

[bigdata@bigdata01 module]$ mv sqoop-1.4.6.bin__hadoop-2.0.4-alpha/ sqoop-1.4.6

4、修改文件

[bigdata@bigdata01 module]$ cd /opt/module/sqoop-1.4.6/conf/

4.1、修改文件名称

[bigdata@bigdata01 conf]$ mv sqoop-env-template.sh sqoop-env.sh

4.2修改文件内容

[bigdata@bigdata01 conf]$ vim sqoop-env.sh 
#增加以下内容
export HADOOP_COMMON_HOME=/opt/module/hadoop-3.1.3
export HADOOP_MAPRED_HOME=/opt/module/hadoop-3.1.3
export HIVE_HOME=/opt/module/hive-3.1.2
export ZOOKEEPER_HOME=/opt/module/zookeeper-3.5.7
export ZOOCFGDIR=/opt/module/zookeeper-3.5.7/conf

5、拷贝jdbc驱动

将mysql-connector-java-5.1.27-bin.jar上传至/opt/module/sqoop-1.4.6/lib/目录

6、配置环境变量

[bigdata@bigdata01 lib]$ sudo vim /etc/profile.d/my_env.sh 
#增加如下内容
#SQOOP_HOME
export SQOOP_HOME=/opt/module/sqoop-1.4.6
export PATH=$PATH:$SQOOP_HOME/bin
#使配置生效
[bigdata@bigdata01 lib]$ source /etc/profile.d/my_env.sh 

7、测试是否安装成功

[bigdata@bigdata01 sqoop-1.4.6]$ sqoop --list-databases --connect jdbc:mysql://bigdata01:3306 --username root --password root
Warning: /opt/module/sqoop-1.4.6/../hbase does not exist! HBase imports will fail.
Please set $HBASE_HOME to the root of your HBase installation.
Warning: /opt/module/sqoop-1.4.6/../hcatalog does not exist! HCatalog jobs will fail.
Please set $HCAT_HOME to the root of your HCatalog installation.
Warning: /opt/module/sqoop-1.4.6/../accumulo does not exist! Accumulo imports will fail.
Please set $ACCUMULO_HOME to the root of your Accumulo installation.
No such sqoop tool: --list-databases. See 'sqoop help'.
[bigdata@bigdata01 sqoop-1.4.6]$ sqoop list-databases --connect jdbc:mysql://bigdata01:3306 --username root --password root
Warning: /opt/module/sqoop-1.4.6/../hbase does not exist! HBase imports will fail.
Please set $HBASE_HOME to the root of your HBase installation.
Warning: /opt/module/sqoop-1.4.6/../hcatalog does not exist! HCatalog jobs will fail.
Please set $HCAT_HOME to the root of your HCatalog installation.
Warning: /opt/module/sqoop-1.4.6/../accumulo does not exist! Accumulo imports will fail.
Please set $ACCUMULO_HOME to the root of your Accumulo installation.
2021-09-11 15:49:18,691 INFO sqoop.Sqoop: Running Sqoop version: 1.4.6
2021-09-11 15:49:18,732 WARN tool.BaseSqoopTool: Setting your password on the command-line is insecure. Consider using -P instead.
2021-09-11 15:49:18,889 INFO manager.MySQLManager: Preparing to use a MySQL streaming resultset.
information_schema
gmall
mysql
performance_schema
sys

 

标签:opt,1.4,sqoop,Sqoop,module,Centos7,bigdata01,HOME,安装
来源: https://www.cnblogs.com/iamzxd/p/15270667.html

本站声明: 1. iCode9 技术分享网(下文简称本站)提供的所有内容,仅供技术学习、探讨和分享;
2. 关于本站的所有留言、评论、转载及引用,纯属内容发起人的个人观点,与本站观点和立场无关;
3. 关于本站的所有言论和文字,纯属内容发起人的个人观点,与本站观点和立场无关;
4. 本站文章均是网友提供,不完全保证技术分享内容的完整性、准确性、时效性、风险性和版权归属;如您发现该文章侵犯了您的权益,可联系我们第一时间进行删除;
5. 本站为非盈利性的个人网站,所有内容不会用来进行牟利,也不会利用任何形式的广告来间接获益,纯粹是为了广大技术爱好者提供技术内容和技术思想的分享性交流网站。

专注分享技术,共同学习,共同进步。侵权联系[81616952@qq.com]

Copyright (C)ICode9.com, All Rights Reserved.

ICode9版权所有