Replicating Apache Kafka data

Before you begin

Ask your Kafka administrator for Kafka credentials that Data Replication can use to write to the cluster. Ask for Kafka producer properties for the cluster. To connect to Apache Kafka in a project in Cloud Pak for Data as a Service, see Apache Kafka connection.

Starting Data Replication

To create a Data Replication asset:

1. Click the Assets tab in the project.

2. Click New asset > Replicate data.

3. Enter a name.

4. Click Connections.

5. On the Source options page, select a connection from the list of connections or click Add connection to create a new connection.

6. Click Select data, select a schema, and optionally a table from the schema.

7. On the Target options page, select the Kafka connection from the list.

8. On the Review page, review the summary, then click Create.

   When you configure Data Replication to replicate a source schema, tables you create on the source database replicate to the default topic when you run the Data Replication asset. When you replicate a source schema and you change a source table's structure, Data Replication updates the target topic headers accordingly. When you start a replication, the topics that are configured in the replication are truncated. When you pause and resume a replication, the topics are not truncated.

Parent topic: Supported Data Replication connections