swarm方式部署多实例flink
节点标签:
#打上标签
docker node update --label-add flink-node=flink01 node1
docker node update --label-add flink-node=flink02 node2
docker node update --label-add flink-node=flink03 node3
1.启用高可用配置
high-availability: cluster-id: /cluster_umi mode: zookeeper zookeeper: path: root: /flink quorum: zk1:2181 storageDir: /data/flink2.docker-compose.yaml配置
version: '3'services: flink-jobmanager: image: flink-meta:1.19-1.0.0 hostname: flink-jobmanager ports: - 48081:48081 networks: - meta environment: FLINK_PROPERTIES: "jobmanager.rpc.address:flink-jobmanager" volumes: - /data/flink/conf/:/opt/flink/conf/ command: jobmanager deploy: replicas: 2# placement:# constraints: [node.labels.flink-node == flink01] flink-taskmanager: image: flink-meta:1.19-1.0.0 hostname: task-jobmanager# ports:# - 48081:48081 networks: - meta environment: FLINK_PROPERTIES: "jobmanager.rpc.address:flink-jobmanager" volumes: - /data/flink/conf/:/opt/flink/conf/ command: taskmanager deploy: replicas: 2# placement:# constraints: [node.labels.flink-node == flink01] networks: meta: external: true多jobmanager实例情况下,会自动选举