标签：EbProjec 1.11 v10 flink servers metrics prometheus 电商 root
[BigDataHadoop：EbProject&电商实时数仓项目.V10] [Deployment.EbProject电商实时数仓项目][|EbProject：可视化&Flink配置.V5|]
一、修改flink配置，开放flink被监控端口
### --- 把prometheus的jar包复制到flink的lib目录下
~~~ # 把prometheus的jar包复制到flink的lib目录下
~~~ # prometheus的jar包的地址在flink的plugin目录下：/opt/yanqi/servers/flink-1.11.1/plugins/metrics-prometheus/flink-metrics-prometheus-1.11.1.jar
[root@hadoop01 ~]# cp /opt/yanqi/servers/flink-1.11.1/plugins/metrics-prometheus/flink-metrics-prometheus-1.11.1.jar \
/opt/yanqi/servers/flink-1.11.1/lib/### --- 修改flink-conf.yaml:
~~~ # 修改flink-conf.yaml配置文件
[root@hadoop01 ~]# vim /opt/yanqi/servers/flink-1.11.1/conf/flink-conf.yaml
~~~ # 文件末尾添加如下参数：hadoop00：为prometheus，pushgateway机器的主机名
metrics.reporter.promgateway.class: org.apache.flink.metrics.prometheus.PrometheusPushGatewayReporter
metrics.reporter.promgateway.host: hadoop00
metrics.reporter.promgateway.port: 9091
metrics.reporter.promgateway.jobName: myJob
metrics.reporter.promgateway.randomJobNameSuffix: true
metrics.reporter.promgateway.deleteOnShutdown: false### --- 发送配置文件到其它主机
~~~ # 发送prometheus.jar包到其它主机
[root@hadoop01 ~]# rsync-script /opt/yanqi/servers/flink-1.11.1/lib/flink-metrics-prometheus-1.11.1.jar
~~~ # 同步flink-conf.yaml配置文件到其它主机
[root@hadoop01 ~]# rsync-script /opt/yanqi/servers/flink-1.11.1/conf/flink-conf.yaml### --- 启动flink.standalone集群模式
~~~ # 启动flink.tandalone集群模式：启动hdfs和yarn服务
[root@hadoop01 ~]# /opt/yanqi/servers/flink-1.11.1/bin/start-cluster.sh~~~ # 启动写入窗口
[root@hadoop01 ~]# nc -lp 7777
~~~ # 写入参数
hello prometheus~~~ # 启动yarn session
[root@hadoop01 ~]# /opt/yanqi/servers/flink-1.11.1/bin/yarn-session.sh -s 1 -jm 1024 -tm 1024m
~~~ # 输出参数
[] - Submitting application master application_1638345082205_0001
JobManager Web Interface: http://hadoop03:42033
~~~ # 启动flink.yarn.jobs
[root@hadoop01 ~]# /opt/yanqi/servers/flink-1.11.1/bin/flink run \
-c WordCountScalaStream -yid application_1638345082205_0001 /root/myjars/FirstFlink-1.0-SNAPSHOT.jar
~~~ # 输出参数
Job has been submitted with JobID 391c28db1d8a2303234373b4f1de8e9f
===============================END===============================
Walter Savage Landor:strove with none,for none was worth my strife.Nature I loved and, next to Nature, Art:I warm'd both hands before the fire of life.It sinks, and I am ready to depart ——W.S.Landor
来自为知笔记(Wiz)
标签：EbProjec,1.11,v10,flink,servers,metrics,prometheus,电商,root 来源： https://www.cnblogs.com/yanqivip/p/16155982.html
本站声明： 1. iCode9 技术分享网（下文简称本站）提供的所有内容，仅供技术学习、探讨和分享； 2. 关于本站的所有留言、评论、转载及引用，纯属内容发起人的个人观点，与本站观点和立场无关； 3. 关于本站的所有言论和文字，纯属内容发起人的个人观点，与本站观点和立场无关； 4. 本站文章均是网友提供，不完全保证技术分享内容的完整性、准确性、时效性、风险性和版权归属；如您发现该文章侵犯了您的权益，可联系我们第一时间进行删除； 5. 本站为非盈利性的个人网站，所有内容不会用来进行牟利，也不会利用任何形式的广告来间接获益，纯粹是为了广大技术爱好者提供技术内容和技术思想的分享性交流网站。