Home > other >  Kafka regular cleaning outdated data
Kafka regular cleaning outdated data

Time:10-14


Made a clear strategy, but still every 7 days to clear
Clear strategy is as follows:

# # # # # # # # # # # # # # # # # # # # # # # # # # # # # Log Retention Policy # # # # # # # # # # # # # # # # # # # # # # # # # # # # #

# The following configurations control The disposal of The log segments. The policy can
# be set to delete segments after a period of time, or after a given size has accumulated.
# A segment will be does whenever * * either of these criteria are met. The Deletion always happens
# from the end of the log.

# The minimum age of a log file to be eligible for deletion due to age
# log cleaning strategy
The log. The cleanup. The policy=delete
The retention. Hours=1
The log. The cleaner. The enable=true

# A size - -based retention policy for logs. The Segments are pruned from the log unless the remaining
# segments drop below the retention) bytes) Functions provides independently of the retention. Hours.
The log. The retention. Bytes=1048576

# The maximum size of a log segment file. When this size is reached a new log segment will be created.
The log. The segment. The bytes=10240

# The interval at which The log segments are checked to see if they can be does "
# to the retention policies
The log. The retention. Check. Interval. Ms=300000

# # # # # # # # # # # # # # # # # # # # # # # # # # # # # Zookeeper # # # # # # # # # # # # # # # # # # # # # # # # # # # # #

  • Related