内容简介:测试环境使用的Kafka出现了点儿问题,服务器被停止,所有的topic日志不知怎的被清空。一番大清洗(清理zookeeper节点、kafka topic log)、重启Kafka、创建分区后发现报了如下的错误:日志中提到的high watermark指的是一个partition中上一次提交的消息的offset。报警是因为topic刚创建、消费已开始、但是还没有生产者推送消息过来、对应topic没有任何offset的记录导致的。
测试环境使用的Kafka出现了点儿问题,服务器被停止,所有的topic日志不知怎的被清空。一番大清洗(清理zookeeper节点、kafka topic log)、重启Kafka、创建分区后发现报了如下的错误:
[2018-10-24 19:34:31,834] WARN Partition [test_topic_xxx,30] on broker 3: No checkpointed highwatermark is found for partition [test_topic_xxx,30] (kafka.cluster.Partition) [2018-10-24 19:34:31,839] WARN Partition [test_topic_xxx,27] on broker 3: No checkpointed highwatermark is found for partition [test_topic_xxx,27] (kafka.cluster.Partition) [2018-10-24 19:34:31,843] WARN Partition [test_topic_xxx,24] on broker 3: No checkpointed highwatermark is found for partition [test_topic_xxx,24] (kafka.cluster.Partition) [2018-10-24 19:34:31,846] WARN Partition [test_topic_xxx,21] on broker 3: No checkpointed highwatermark is found for partition [test_topic_xxx,21] (kafka.cluster.Partition) [2018-10-24 19:34:31,850] WARN Partition [test_topic_xxx,18] on broker 3: No checkpointed highwatermark is found for partition [test_topic_xxx,18] (kafka.cluster.Partition) [2018-10-24 19:34:31,854] WARN Partition [test_topic_xxx,15] on broker 3: No checkpointed highwatermark is found for partition [test_topic_xxx,15] (kafka.cluster.Partition) [2018-10-24 19:34:31,857] WARN Partition [test_topic_xxx,12] on broker 3: No checkpointed highwatermark is found for partition [test_topic_xxx,12] (kafka.cluster.Partition) [2018-10-24 19:34:31,860] WARN Partition [test_topic_xxx,9] on broker 3: No checkpointed highwatermark is found for partition [test_topic_xxx,9] (kafka.cluster.Partition) [2018-10-24 19:34:31,863] WARN Partition [test_topic_xxx,6] on broker 3: No checkpointed highwatermark is found for partition [test_topic_xxx,6] (kafka.cluster.Partition) [2018-10-24 19:34:31,866] WARN Partition [test_topic_xxx,3] on broker 3: No checkpointed highwatermark is found for partition [test_topic_xxx,3] (kafka.cluster.Partition) [2018-10-24 19:34:31,870] WARN Partition [test_topic_xxx,0] on broker 3: No checkpointed highwatermark is found for partition [test_topic_xxx,0] (kafka.cluster.Partition) [2018-10-24 19:34:31,873] WARN Partition [test_topic_xxx,10] on broker 3: No checkpointed highwatermark is found for partition [test_topic_xxx,10] (kafka.cluster.Partition)
找了些资料 知道了报警的原因。
日志中提到的high watermark指的是一个partition中上一次提交的消息的offset。报警是因为topic刚创建、消费已开始、但是还没有生产者推送消息过来、对应topic没有任何offset的记录导致的。
所以该警告可以忽略,待有消息推送过来即可。
相关资料
Intra-cluster Replication in Apache Kafka
#####
以上所述就是小编给大家介绍的《Kafka警告:No checkpointed highwatermark is found for partition》,希望对大家有所帮助,如果大家有任何疑问请给我留言,小编会及时回复大家的。在此也非常感谢大家对 码农网 的支持!
本站部分资源来源于网络,本站转载出于传递更多信息之目的,版权归原作者或者来源机构所有,如转载稿涉及版权问题,请联系我们。
Python极客项目编程
Mahesh Venkitachalam / 王海鹏 / 人民邮电出版社 / 2017-5 / 69
Python 是一种强大的编程语言,容易学习而且充满乐趣。但掌握了基本知识后,接下来做什么? 本书包含了一组富有想象力的编程项目,它们将引导你用Python 来制作图像和音乐、模拟现实世界的现象,并与 Arduino 和树莓派这样的硬件进行交互。你将学习使用常见的Python 工具和库,如numpy、matplotlib 和pygame, 来完成以下工作: ● 利用参数方程......一起来看看 《Python极客项目编程》 这本书的介绍吧!