Unlock the full InfoQ experience by logging in! Stay updated with your favorite authors and topics, engage with content, and download exclusive resources. Senyo Simpson discusses how Rust's core ...

Streaming is hot. The demand for real-time data processing is rising, and streaming vendors are proliferating and competing. Apache Kafka is a key component in many data pipeline architectures, mostly ...

Just about all technology decision-making must meet two essential criteria: it must enable you to meet your business goals and it must work well alongside the rest of your technology stack. When it ...

In this section, we will examine the architectural components and related terminology in Kafka. Basically, Kafka consists of the following components: Kafka Cluster—a collection of one or more servers ...

Life happens as a continuous flow of events (a stream). Ted Dunning and Ellen Friedman describe new designs for streaming data architecture that help you get real-time insights and greatly improve the ...

Shiny new objects are easy to find in the big data space. So when the industry’s attention shifted towards processing streams of data in real time–as opposed to batch-style processing that was popular ...

These days, massively scalable pub/sub messaging is virtually synonymous with Apache Kafka. Apache Kafka continues to be the rock-solid, open-source, go-to choice for distributed streaming ...