Apache Kafka 1.1.0 发布,改进 Kafka controller

栏目: 软件资讯 发布于: 2018-03-30 09:20:04

Apache Kafka 1.1.0 已发布,带来了大量改进和修复。主要亮点包括:

  • Kafka 1.1.0 includes significant improvements to the Kafka Controller that speed up controlled shutdown. ZooKeeper session expiration edge cases have also been fixed as part of this effort.

  • Controller improvements also enable more partitions to be supported on a single cluster. KIP-227 introduced incremental fetch requests, providing more efficient replication when the number of partitions is large.

  • KIP-113 added support for replica movement between log directories to enable data balancing with JBOD.

  • Some of the broker configuration options like SSL keystores can now be updated dynamically without restarting the broker. See KIP-226 for details and the full list of dynamic configs.

  • Delegation token based authentication (KIP-48) has been added to Kafka brokers to support large number of clients without overloading Kerberos KDCs or other authentication servers.

  • Several new features have been added to Kafka Connect, including header support (KIP-145), SSL and Kafka cluster identifiers in the Connect REST interface (KIP-208 and KIP-238), validation of connector names (KIP-212) and support for topic regex in sink connectors (KIP-215). Additionally, the default maximum heap size for Connect workers was increased to 2GB.

  • Several improvements have been added to the Kafka Streams API, including reducing repartition topic partitions footprint, customizable error handling for produce failures and enhanced resilience to broker unavailability. See KIPs 205, 210, 220, 224 and 239 for details.



【声明】文章转载自:开源中国社区 [http://www.oschina.net]

转载请注明:文章转载自 [http://www.php230.com]
本文标题:Apache Kafka 1.1.0 发布,改进 Kafka controller
麦金尼 (Wes McKinney) (作者), 唐学韬 (译者), 等 (译者)