Part of the log is as follows:
4/12/19 11:24:20 INFO consumer. ZookeeperConsumerConnector: [mygroupid_TZ0509 be4114f] - 1418959450703-1, Cleared all relevant the queues for this fetcher
14/12/19 11:24:20 INFO consumer. ZookeeperConsumerConnector: [mygroupid_TZ0509 be4114f] - 1418959450703-1, Cleared the data chunks in all the consumer message iterators
14/12/19 11:24:20 INFO consumer. ZookeeperConsumerConnector: [mygroupid_TZ0509 be4114f] - 1418959450703-1, Committing all offsets after clearing the fetcher the queues
14/12/19 11:24:20 INFO consumer. ZookeeperConsumerConnector: [mygroupid_TZ0509 be4114f] - 1418959450703-1, Releasing partition ownership
14/12/19 11:24:20 INFO consumer. ZookeeperConsumerConnector: [mygroupid_TZ0509 be4114f] - 1418959450703-1, consumer mygroupid_TZ0509-1418959450703-1 be4114f rebalancing the following partitions: ArrayBuffer (0) for topic luyang with consumers: List (be4114f mygroupid_TZ0509-1418959450703-1-0)
14/12/19 11:24:20 INFO consumer. ZookeeperConsumerConnector: [mygroupid_TZ0509 be4114f] - 1418959450703-1, mygroupid_TZ0509 be4114f - 1418959450703-1-0 attempting to claim partition 0
14/12/19 11:24:20 INFO consumer. ZookeeperConsumerConnector: [mygroupid_TZ0509 be4114f] - 1418959450703-1, mygroupid_TZ0509 be4114f - 1418959450703-1-0 successfully owned partition 0 for topic luyang
14/12/19 11:24:20 INFO consumer. ZookeeperConsumerConnector: [mygroupid_TZ0509 be4114f] - 1418959450703-1, Updating the cache
14/12/19 11:24:20 INFO consumer. ZookeeperConsumerConnector: [mygroupid_TZ0509 be4114f] - 1418959450703-1, consumer mygroupid_TZ0509-1418959450703-1 be4114f selected partitions: luyang: 0: fetched offset=1: consumed offset=1
14/12/19 11:24:20 INFO consumer. ConsumerFetcherManager $LeaderFinderThread: [mygroupid_TZ0509 be4114f - 1418959450703-1 - leader - finder - thread], Starting
14/12/19 11:24:20 INFO consumer. ZookeeperConsumerConnector: [mygroupid_TZ0509 be4114f] - 1418959450703-1, end rebalancing consumer mygroupid_TZ0509-1418959450703-1 be4114f try # 0
14/12/19 11:24:20 INFO receiver. ReceiverSupervisorImpl: Called receiver onStart
14/12/19 11:24:20 INFO scheduler. ReceiverTracker: Registered receiver for stream 0 from akka://sparkDriver
14/12/19 11:24:20 INFO kafka. KafkaReceiver: Starting MessageHandler.
14/12/19 11:24:20 INFO utils. VerifiableProperties: Verifying the properties
14/12/19 11:24:20 INFO utils. VerifiableProperties: Property metadata. The broker. The list is overridden to 192.168.103.95:9092192168 103.96:9092192168 103.97:9092
14/12/19 11:24:20 INFO utils. VerifiableProperties: the Property request. A timeout. Ms is overridden to 30000
14/12/19 11:24:20 INFO utils. VerifiableProperties: the Property of client. The id is overridden to mygroupid
14/12/19 11:24:20 INFO client. ClientUtils $: Fetching the metadata from the broker id: 0, host: 192.168.103.95, port: 9092 with the correlation id 0 for 1 topic (s) Set (luyang)
14/12/19 11:24:20 INFO producer. SyncProducer: Connected to 192.168.103.95:9092 for producing
14/12/19 11:24:20 INFO producer. SyncProducer: Disconnecting from 192.168.103.95:9092
14/12/19 11:24:20 INFO consumer. ConsumerFetcherThread: [be4114f ConsumerFetcherThread - mygroupid_TZ0509-1418959450703-1-0-0], Starting
14/12/19 11:24:20 INFO consumer. ConsumerFetcherManager: [ConsumerFetcherManager - 1418959459781] Adding fetcher for partition [luyang, 0], to broker initOffset - 1 0 with fetcherId 0
14/12/19 11:24:25 INFO scheduler. ReceiverTracker: Stream 0 blocks received 0
14/12/19 11:24:25 INFO scheduler. JobScheduler: Added jobs for time 1418959465000 ms
14/12/19 11:24:30 INFO scheduler. ReceiverTracker: Stream 0 blocks received 0
14/12/19 11:24:30 INFO scheduler. JobScheduler: Added jobs for time 1418959470000 ms
14/12/19 11:24:35 INFO scheduler. ReceiverTracker: Stream 0 blocks received 0
14/12/19 11:24:35 INFO scheduler. JobScheduler: Added jobs for time 1418959475000 ms

CodePudding user response:

Well, do it himself

CodePudding user response:

How to solve the building Lord, I also encountered the same problem, can reveal the solution, thank you!

CodePudding user response:

refer to the second floor lynne823 response:

well, oneself done

Brother, you this is how to solve, meet the same problem with you ~

CodePudding user response:

BBS of domestic and foreign different, I think have the right to ask questions, should at least put the method to solve the problem even if it is thought to inform,