=changeit # ignore if source Kafka cluster is not using SSL
=/work/kafka_2.11-0.10.0.1/ssl/sourceKafkaClusterTrustStore.jks # ignore if source Kafka cluster is not using SSL Security.protocol=SSL # ignore if source Kafka cluster is not using SSL Kafka MirrorMaker Configure Kafka MirrorMakerīrvers=sourceKafka01:9093,sourceKafka02:9093 # use plaintext if source Kafka cluster is not using SSL bin/kafka-console-consumer.sh -new-consumer -bootstrap-server localhost:9092 -topic mirrored_topic
Start listening to the topic in target cluster using Console Consumer. bin/kafka-topics.sh -zookeeper localhost:2181 -create -if-not-exists -replication-factor 1 -partitions 1 -config 'retention.ms=3600000' -topic mirrored_topic bin/kafka-topics.sh -zookeeper localhost:2181 -list Listeners=PLAINTEXT://localhost:9092,SSL://localhost:9093 # Timeout in ms for connecting to zookeeper # The interval at which log segments are checked to see if they can be deleted according to the retention policies When this size is reached a new log segment will be created. # The maximum size of a log segment file. # The minimum age of a log file to be eligible for deletion # A comma separated list of directories under which to store log files # The maximum size of a request that the socket server will accept (protection against OOM) # The receive buffer (SO_RCVBUF) used by the socket server # The send buffer (SO_SNDBUF) used by the socket server # The number of threads handling network requests This must be set to a unique integer for each broker. Configure Target Kafka cluster's Server. 
bin/zookeeper-server-start.sh config/zookeeper.properties # disable the per-ip limit on thseparatedof connections since this is a non-production config # the port at which the clients will connect # the directory where the snapshot is stored.ĭataDir=/work/kafka_2.11-0.10.0.1/zookeeper-data
Configure Target Kafka cluster's ZooKeeper. 
Select appropriate version and download its tgz from Kafka Downloads page.
Download and install Kafka (target cluster). Check MirrorMaker.scala for more details.
0 kommentar(er)
