单机-docker搭建flink服务(一)

韵味老鸟 2024-07-30 14:57:42

单机-docker搭建flink服务

#容器路径 /opt/flink/conf

下载镜像:docker pull flink:1.16.1-scala_2.12-java8

#创建网络

#docker network create --driver=overlay --scope=swarm meta ,只能在服务时使用

#删除 docker network rm meta

docker network create --driver=overlay --scope=swarm --attachable meta

#查看网络

docker network inspect meta |grep Attachable

#打上标签

docker node update --label-add flink-node=flink01 node1

#启动flink后,复制配置文件

docker cp 26ea2a7279bb:/opt/flink/conf/flink-conf.yaml .

#创建目录

mkdir -p /data/flink-single/{job,task,log,lib}

#删除空行

#grep -v "#" flink-conf.yaml |sed '/^$/d'

#job task配置一样,flink-conf.yaml配置

#jobjobmanager.rpc.address: flink01-jobmanagerjobmanager.rpc.port: 6123#jobmanager.heap.size: 128mjobmanager.bind-host: 0.0.0.0jobmanager.memory.process.size: 1724mjobmanager.execution.failover-strategy: region#task#taskmanager.heap.size: 128mtaskmanager.numberOfTaskSlots: 2taskmanager.bind-host: 0.0.0.0taskmanager.memory.process.size: 1724m#rest.address: 0.0.0.0rest.bind-address: 0.0.0.0blob.server.port: 6124query.server.port: 6125parallelism.default: 1##high-availability: zookeeper#high-availability.zookeeper.path.root: /flink#high-availability.storageDir: hdfs:///dev-cdh1:9000/ha/hdfs#prod deny#high-availability.storageDir: /opt/flink/ha/ #high-availability.zookeeper.quorum: zookeeper:2181#state.backend: rocksdb#state.checkpoints.dir: file:///data/flink/checkpoints#state.savepoints.dir: file:///data/flink/checkpoints#state.backend.incremental: trueweb.submit.enable: true

0 阅读:0