Apache Kafka 3.8 - Introducing a New Docker Image for GraalVM-based Native Kafka Broker

Apache Kafka 3.8 - Introducing a New Docker Image for GraalVM-based Native Kafka Broker

Jul 29, 2024

► LEARN MORE: https://cnfl.io/46sav6f

Apache Kafka® 3.8 is here! On behalf of the Kafka community, Danica Fine highlights key release updates, with KIPs from Kafka Core, Kafka Streams, and Kafka Connect.

For more detailed information on the KIPs in this release, check out the Confluent blog: https://cnfl.io/46sav6f

Kafka Core:

  • KIP-974: Introduces a new Docker Image using a GraalVM-based native Kafka binary running in KRaft mode
  • KIP-1028: Introduces a Docker Official Image for Apache Kafka
  • KIP-848: New Consumer group membership and rebalance protocol now in Preview
  • KIP-719: Deprecates the log4j appender in favor of log4j2
  • KIP-390: Adds support for setting the compression level for the specified compression codec (gzip, lz4, zstd)
  • KIP-993: Introduces a new configuration that limits the access of ConfigProviders for security purposes
  • KIP-1036: Expands on the changes made by KIP-334 to the RecordDeserializationException, adding failed record content and metadata
  • KIP-1019: Introduces a new method, isMeasurable() to the KafkaMetric class

Kafka Streams:

  • KIP-989: Introduces new metrics to aid in finding leaked StateStore iterators
  • KIP-924: Adds a new group of configurable interfaces for plugging custom behavior into the Streams Partition Assignor (including StickyTaskAssignor)
  • KIP-813: Adds shareable, “read-only” state stores to the Processor API, which can be loaded with topic data without additional changelog topics

Kafka Connect:

  • KIP-1004: Adds a tasks.max.enforce boolean configuration that will cause the Connector to fail on creating more tasks than specified by tasks.max

RELATED RESOURCES
► See release notes for AK 3.8: https://downloads.apache.org/kafka/3.8.0/RELEASE_NOTES.html
► Download AK 3.8: https://kafka.apache.org/downloads
► Get started with AK 3.8: https://kafka.apache.org/documentation/#quickstart

CHAPTERS

00:00 - Intro

00:24 - KIP 974: Docker Image for GraalVM based Native Kafka Broker

00:51 - KIP 1028: Docker Official Image for Apache Kafka

01:17 - KIP 848: The Next Generation of the Consumer Rebalance Protocol (Preview)

01:34 - KIP 719: Deprecate Log4J Appender

01:50 - KIP 390: Support Compression Level

02:20 - KIP 993: Allow restricting files accessed by File and Directory ConfigProviders

02:42 - KIP 1036: Extend RecordDeserializationException

02:59 - KIP 1019: Expose method to determine Metric Measurability

03:16 - KIP 989: Improved StateStore Iterator metrics for detecting leaks

03:33 - KIP 924: Customizable task assignment for Streams

04:03 - KIP 813: Shareable State Stores

04:47 - KIP 1004: Enforce tasks.max property in Kafka Connect

05:22 - Closing

ABOUT CONFLUENT
Confluent is pioneering a fundamentally new category of data infrastructure focused on data in motion. Confluent’s cloud-native offering is the foundational platform for data in motion – designed to be the intelligent connective tissue enabling real-time data, from multiple sources, to constantly stream across the organization. With Confluent, organizations can meet the new business imperative of delivering rich, digital front-end customer experiences and transitioning to sophisticated, real-time, software-driven backend operations. To learn more, please visit www.confluent.io.

#apachekafka #kafka #confluent