ICode9

精准搜索请尝试: 精确搜索
首页 > 其他分享> 文章详细

CDH 05.cdh本地源搭建配置

2021-10-22 15:01:09  阅读:311  来源: 互联网

标签:scm cloudera database default CDH 05 cdh systemctl utf8


1、解决安装的时候报一下警告(禁用透明页):

echo never > /sys/kernel/mm/transparent_hugepage/defrag;
echo never > /sys/kernel/mm/transparent_hugepage/enabled;

vi /etc/rc.local # 添加如下两行,并同步该文件到其他服务器
echo never > /sys/kernel/mm/transparent_hugepage/defrag
echo never > /sys/kernel/mm/transparent_hugepage/enabled

 

cd ~/scripts/;
sh ./ssh_to_all_node.sh "echo never > /sys/kernel/mm/transparent_hugepage/defrag;"
sh ./ssh_to_all_node.sh "echo never > /sys/kernel/mm/transparent_hugepage/enabled;"
sh ./sync_to_all_node.sh /etc/rc.local /etc

2、配置本地Parcel存储库

mkdir -p /opt/cloudera/parcel-repo

将下载好的parcel和manifest.json文件放置到该目录

cd /opt/cloudera/parcel-repo

sha1sum CDH-6.3.2-1.cdh6.3.2.p0.1605554-el7.parcel | awk '{ print $1 }' > CDH-6.3.2-1.cdh6.3.2.p0.1605554-el7.parcel.sha

3、创建新用户和修改文件权限

useradd cloudera-scm;
chown -R cloudera-scm:cloudera-scm /opt/cloudera/parcel-repo/*

4、安装rpm包

yum -y install edhat-lsb portmap mod_ssl openssl-devel python-psycopg2 MySQL-python chkconfig bind-utils libxslt zlib sqlite cyrus-sasl-plain cyrus-sasl-gssapi fuse fuse-libs

cd ~/scripts/;
sh ./ssh_to_all_node.sh "yum -y install edhat-lsb portmap mod_ssl openssl-devel python-psycopg2 MySQL-python chkconfig bind-utils libxslt zlib sqlite cyrus-sasl-plain cyrus-sasl-gssapi fuse fuse-libs"

5、安装cloudera-manager (在 cdh-cm-v01 服务器上执行)

yum -y install cloudera-manager-daemons cloudera-manager-agent cloudera-manager-server

6、创建cdh需要数据库

mysql -uroot -prootROOT@1234

drop database if exists scm;
drop database if exists hive;
drop database if exists hue;

drop database if exists amon;
drop database if exists rman;
drop database if exists metastore;
drop database if exists sentry;
drop database if exists nav;
drop database if exists oozie;

生产:%严格控制到IP段或者具体IP地址,密码区别开
create database scm default character set utf8 default collate utf8_general_ci;
grant all on scm.* to 'scm'@'%' identified by 'rootROOT@1234';
create database hive default character set utf8 default collate utf8_general_ci;
grant all on hive.* to 'hive'@'%' identified by 'rootROOT@1234';
create database hue default character set utf8 default collate utf8_general_ci;
grant all on hue.* to 'hue'@'%' identified by 'rootROOT@1234';
flush privileges;

create database amon default character set utf8 default collate utf8_general_ci;
grant all on amon.* to 'amon'@'%' identified by 'rootROOT@1234';
create database rman default character set utf8 default collate utf8_general_ci;
grant all on rman.* to 'rman'@'%' identified by 'rootROOT@1234';
create database metastore default character set utf8 default collate utf8_general_ci;
grant all on metastore.* to 'hive'@'%' identified by 'rootROOT@1234';
create database sentry default character set utf8 default collate utf8_general_ci;
grant all on sentry.* to 'sentry'@'%' identified by 'rootROOT@1234';
create database nav default character set utf8 default collate utf8_general_ci;
grant all on nav.* to 'nav'@'%' identified by 'rootROOT@1234';
create database oozie default character set utf8 default collate utf8_general_ci;
grant all on oozie.* to 'oozie'@'%' identified by 'rootROOT@1234';
flush privileges;

7、设置cdh数据库

7.1、MySQL数据库与CDH Server在同一台主机上

/opt/cloudera/cm/schema/scm_prepare_database.sh mysql scm scm

 

7.2、MySQL数据库与CDH Server不在同一台主机上

/opt/cloudera/cm/schema/scm_prepare_database.sh mysql -h <mysql-host-ip> --scm-host <cm-server-ip> scm scm

8、启动Cloudera Manager

systemctl enable cloudera-scm-server;
systemctl start cloudera-scm-server;
systemctl status cloudera-scm-server;

 

systemctl enable cloudera-scm-agent;
systemctl start cloudera-scm-agent;
systemctl status cloudera-scm-agent;

# 停止Cloudera Manager
systemctl stop cloudera-scm-server;
systemctl stop cloudera-scm-agent;

systemctl start cloudera-scm-server;
systemctl start cloudera-scm-agent;

systemctl status cloudera-scm-server;
systemctl status cloudera-scm-agent;

9、查看端口被监听

netstat -anlp |grep -E "7182|7180"|grep LISTEN;

10、查看 Cloudera Manager 日志(主要是看是否有其它错误):

tail -n 400 /var/log/cloudera-scm-server/cloudera-scm-server.log
tail -n 400 /var/log/cloudera-scm-agent/cloudera-scm-agent.log

 

11、浏览器查看:默认账号密码是admin:admin

http://cdh-cm-v01.yunes.com:7180

 

标签:scm,cloudera,database,default,CDH,05,cdh,systemctl,utf8
来源: https://blog.csdn.net/walykyy/article/details/120904977

本站声明: 1. iCode9 技术分享网(下文简称本站)提供的所有内容,仅供技术学习、探讨和分享;
2. 关于本站的所有留言、评论、转载及引用,纯属内容发起人的个人观点,与本站观点和立场无关;
3. 关于本站的所有言论和文字,纯属内容发起人的个人观点,与本站观点和立场无关;
4. 本站文章均是网友提供,不完全保证技术分享内容的完整性、准确性、时效性、风险性和版权归属;如您发现该文章侵犯了您的权益,可联系我们第一时间进行删除;
5. 本站为非盈利性的个人网站,所有内容不会用来进行牟利,也不会利用任何形式的广告来间接获益,纯粹是为了广大技术爱好者提供技术内容和技术思想的分享性交流网站。

专注分享技术,共同学习,共同进步。侵权联系[81616952@qq.com]

Copyright (C)ICode9.com, All Rights Reserved.

ICode9版权所有