# 15 - Stream data from Apache Kafka into Adobe Experience Platform

**Authors:** [**Vivek Tiwari**](https://www.linkedin.com/in/vivek-tiwari-25092656/)**,** [**Nipun Nair**](https://www.linkedin.com/in/nipunnair/)**,** [**Wouter Van Geluwe**](https://www.linkedin.com/in/woutervangeluwe/)

In this module, you'll learn how to setup your own Apache Kafka cluster, define topics, producers and consumers and stream data into Adobe Experience Platform using the Adobe Experience Platform Sink Connector through Kafka Connect.

## Learning Objectives

* Perform a basic setup of a local Kafka cluster
* Create a Kafka topic, use a Kafka producer and a Kafka consumer
* Configure Kafka Connect and the Adobe Experience Platform Sink Connector
* Manually produce events and see those events get ingested in Adobe Experience Platform
* Use an existing Twitter producer library from Kafka Connect to stream Twitter data into Adobe Experience Platform

## Prerequisites

* Java JDK11 or above needs to be installed on your computer, you can download that JDK here: <https://www.oracle.com/java/technologies/javase-jdk11-downloads.html>
* Access to Adobe Experience Platform

## Architecture Overview

Have a look at the below architecture, which highlights the components that will be discussed and used in this module.

![Architecture Overview](/files/Aqk7kN8RhTORSNemPuCf)

## Sandbox to use

{% hint style="info" %}
Kindly refer to [Exercise 0.0](/comprehensive-technical-tutorial-archive/getting-started/ex0.md) for instructions on how to find your Sandbox ID and other identifying values.
{% endhint %}

## Exercises

[15.1 Introduction to Apache Kafka](/comprehensive-technical-tutorial-archive/module15/ex1.md)

In this exercise, you'll learn about the basics of Apache Kafka

[15.2 Install and configure your Kafka cluster](/comprehensive-technical-tutorial-archive/module15/ex2.md)

In this exercise, you'll download, install and configure your basic Apache Kafka cluster.

[15.3 Configure HTTP API Streaming endpoint in Adobe Experience Platform](/comprehensive-technical-tutorial-archive/module15/ex3.md)

In this exercise, you'll configure an HTTP API Source Connector in Adobe Experience Platform.

[15.4 Install and configure Kafka Connect and the Adobe Experience Platform Sink Connector](/comprehensive-technical-tutorial-archive/module15/ex4.md)

In this exercise, you'll use Kafka Connect to install and use the Adobe Experience Platform Sink Connector and you'll send events into Adobe Experience Platform manually.

[Summary and benefits](/comprehensive-technical-tutorial-archive/module15/summary.md)

Summary of this module and overview of the benefits.

{% hint style="info" %}
Thank you for investing your time in learning all there is to know about Adobe Experience Platform. If you have questions, want to share general feedback of have suggestions on future content, please contact the Solution Partner Portal, by sending an email to **<spphelp@adobe.com>**.
{% endhint %}


---

# Agent Instructions: Querying This Documentation

If you need additional information that is not directly available in this page, you can query the documentation dynamically by asking a question.

Perform an HTTP GET request on the current page URL with the `ask` query parameter:

```
GET https://docs.adobesandbox.com/comprehensive-technical-tutorial-archive/module15.md?ask=<question>
```

The question should be specific, self-contained, and written in natural language.
The response will contain a direct answer to the question and relevant excerpts and sources from the documentation.

Use this mechanism when the answer is not explicitly present in the current page, you need clarification or additional context, or you want to retrieve related documentation sections.