Apache Kafka 0.10.1.0 发布了,该版本更新了大量内容,主要改进如下:
新特性
-
[KAFKA-1464] - Add a throttling option to the Kafka replication tool
-
[KAFKA-3176] - Allow console consumer to consume from particular partitions when new consumer is used.
-
[KAFKA-3492] - support quota based on authenticated user name
-
[KAFKA-3776] - Unify store and downstream caching in streams
-
[KAFKA-3858] - Add functions to print stream topologies
-
[KAFKA-3909] - Queryable state for Kafka Streams
-
[KAFKA-4015] - Change cleanup.policy config to accept a list of valid policies
-
[KAFKA-4093] - Cluster id
改进
-
[KAFKA-724] - Allow automatic socket.send.buffer from operating system
-
[KAFKA-1981] - Make log compaction point configurable
-
[KAFKA-2063] - Bound fetch response size (KIP-74)
-
[KAFKA-2547] - Make DynamicConfigManager to use the ZkNodeChangeNotificationListener introduced as part of KAFKA-2211
-
[KAFKA-2800] - Update outdated dependencies
-
[KAFKA-3158] - ConsumerGroupCommand should tell whether group is actually dead
-
[KAFKA-3281] - Improve message of stop scripts when no processes are running
-
[KAFKA-3282] - Change tools to use new consumer if zookeeper is not specified
-
[KAFKA-3283] - Remove beta from new consumer documentation
-
[KAFKA-3479] - Add new consumer metrics documentation
-
[KAFKA-3595] - Add capability to specify replication compact option for stream store
-
[KAFKA-3644] - Use Boolean protocol type for StopReplicaRequest delete_partitions
-
[KAFKA-3680] - Make Java client classloading more flexible
-
[KAFKA-3683] - Add file descriptor recommendation to ops guide
-
[KAFKA-3697] - Clean-up website documentation when it comes to clients
-
[KAFKA-3699] - Update protocol page on website to explain how KIP-35 should be used
-
[KAFKA-3711] - Allow configuration of MetricsReporter subclasses
-
[KAFKA-3732] - Add an auto accept option to kafka-acls.sh
-
[KAFKA-3748] - Add consumer-property to console tools consumer (similar to --producer-property)
-
[KAFKA-3749] - "BOOSTRAP_SERVERS_DOC" typo in CommonClientConfigs
-
[KAFKA-3753] - Add approximateNumEntries() to the StateStore interface for metrics reporting
-
[KAFKA-3760] - Set broker state as running after publishing to ZooKeeper
-
[KAFKA-3762] - Log.loadSegments() should log the message in exception
-
[KAFKA-3765] - Code style issues in Kafka
-
[KAFKA-3768] - Replace all pattern match on boolean value by if/elase block.
下载地址
源代码
https://www.apache.org/dyn/closer.cgi?path=/kafka/0.10.1.0/kafka-0.10.1.0-src.tgz
二进制文件
https://www.apache.org/dyn/closer.cgi?path=/kafka/0.10.1.0/kafka_2.11-0.10.1.0.tgz
https://www.apache.org/dyn/closer.cgi?path=/kafka/0.10.1.0/kafka_2.10-0.10.1.0.tgz
卡夫卡的目的是提供一个发布订阅解决方案,它可以处理消费者规模的网站中的所有动作流数据。 这种动作(网页浏览,搜索和其他用户的行动)是在现代网络上的许多社会功能的一个关键因素。 这些数据通常是由于吞吐量的要求而通过处理日志和日志聚合来解决。 对于像Hadoop的一样的日志数据和离线分析系统,但又要求实时处理的限制,这是一个可行的解决方案。kafka的目的是通过Hadoop的并行加载机制来统一线上和离线的消息处理,也是为了通过集群机来提供实时的消费。