Streaming with Apache Kafka

A fully managed Kafka service that allows you to build real-time, distributed data streaming pipelines so you can collect, process, store, and move millions of events per minute in a cost-efficient manner that’s 100% compatible with open source Apache Kafka.

OCI Stream with Apache Kafka (5:46)

Why OCI Streaming with Apache Kafka?

Leverage the high-throughput, low-latency Apache Kafka event streaming platform, fully managed on Oracle Cloud Infrastructure (OCI).

Fully managed

Apache Kafka service

100%

Compatible with Apache Kafka

99.9%

Availability SLA

Cost efficient

Simple and user-friendly pricing with an industry-leading price-performance ratio

Secure

Data encrypted at rest and in transit; integrated with OCI Key Management Service

Open source ecosystem

Out-of-the-box support for all open source tools and connectors built for Apache Kafka

OCI competitive pricing designed for you

Up to 31% less costly than Amazon Managed Streaming for Apache Kafka (Amazon MSK) and up to 73% less costly than Confluent.

Pricing comparison chart, description below
This bar chart compares the monthly costs associated with different cluster sizes—small, medium, and large—across three services: OCI Streaming with Kafka, Amazon Managed Streaming for Apache Kafka (Amazon MSK), and Confluent Cloud. OCI Streaming with Kafka is the most cost-effective solution. It's up to 31% less costly than Amazon MSK and 73% less costly than Confluent.

Note: Average price comparison done for a small, medium, and large 3-broker cluster with 4, 8, and 16 vCPUs using public pricing of Amazon Managed Streaming for Apache Kafka in AWS US East and Confluent dedicated multizone clusters on AWS US East-4 on November 10, 2024 based on 2 VCPUs having comparable performance to 1 OCPU.

OCI Streaming with Apache Kafka use cases

  • Change data capture (CDC)

    Kafka facilitates CDC by efficiently streaming real-time data changes from databases to downstream systems, enabling immediate processing and integration across applications.

  • Metrics and logs ingestion

    Kafka helps combine logs from different servers within a single feed and transform the data into a standardized format for further analysis by downstream applications.

  • Real-time analytics

    Kafka processes and analyzes continuous streams of data for real-time insights, anomaly detection, and predictive analytics.

  • Web/mobile activity data tracking

    Kafka assists in building a user activity tracking pipeline for real-time processing, monitoring, or loading into data warehousing systems for offline processing and reporting.

How OCI Streaming with Apache Kafka works

Typical use cases for OCI Streaming with Apache Kafka involve processing and analyzing real-time streaming data, such as aggregating and analyzing large volumes of log data from multiple sources to gain immediate insights.

This architecture showcases how data flows from ingestion through OCI Streaming with Apache Kafka to final storage and analytics, enabling seamless, real-time data processing and analysis.


How OCI Streaming with Apache Kafka works diagram, description below

The diagram provides an overview of OCI Streaming with Apache Kafka, showing the flow from data ingestion to use cases.

  1. Data Ingestion: Data is ingested from sources such as messaging platforms, web activity tracking, metrics and logs, change data capture, and IoT devices and fed into Kafka using a source Kafka connector.
  2. OCI Streaming with Apache Kafka:
    • Fully managed: Kafka cluster administration is automated, including scaling and compliance.
    • 100% compatible: Kafka applications can be easily ported to OCI with no code changes.
    • Cost-efficient: Pay-as-you-go pricing is based on compute and storage usage.
  3. Use Cases: The processed data is used for user behavior analysis, demand forecasting, fraud detection, trading anomaly detection, and healthcare analytics, providing real-time insights for decision-making.

Get started with OCI Streaming with Apache Kafka

Try 20+ Always Free cloud services, with a 30-day trial for even more

Oracle offers a Free Tier with no time limits on more than 20 services such as Autonomous AI Database, Arm Compute, and Storage, as well as US$300 in free credits to try additional cloud services. Get the details and sign up for your free account today.

  • What’s included with Oracle Cloud Free Tier?

    • 2 Autonomous AI Databases, 20 GB each
    • AMD and Arm Compute VMs
    • 200 GB total block storage
    • 10 GB object storage
    • 10 TB outbound data transfer per month
    • 10+ more Always Free services
    • US$300 in free credits for 30 days for even more

Contact sales

Interested in learning more about Oracle Cloud Infrastructure? Let one of our experts help.

  • They can answer questions like:

    • What workloads run best on OCI?
    • How do I get the most out of my overall Oracle investments?
    • How does OCI compare to other cloud computing providers?
    • How can OCI support your IaaS and PaaS goals?