Skip to main content

Before You Start

Welcome to developing Kafka Connect pipelines with Apache Kafka and AMPS, the Advanced Message Processing System from 60East Technologies.

These guides will help you learn how to use the AMPS Kafka connector to move messages between AMPS and Apache Kafka.

Before reading this guide, it is important to have a good understanding of the following topics:

  • Developing Applications in Java

    To be successful using this guide, you will need to possess a working knowledge of the Java language. Visit http://java.oracle.com for resources on learning Java.

  • AMPS Concepts

    The connector uses the AMPS Java client, so we recommend reading about the AMPS Java Client.

    Many features included in the connector require an understanding of AMPS, so we recommend reading the Introduction to AMPS guide.

    Detailed explanations of the AMPS server behavior are in the AMPS Server Documentation.

  • Kafka and Kafka Connect Concepts

    The connector is used by Kafka Connect to receive data from AMPS and to sink data to AMPS.

    Before working through this guide, we recommend reading the Kafka Connect documentation to understand workers, connector plugins, source connectors, sink connectors, converter settings, and standalone or distributed mode.

    The connector examples use a Kafka worker, a Kafka broker, and an AMPS server running on the development system.

Setting up Development Instances​

In order to use the connector, a Kafka Connect worker, a Kafka broker, and a running AMPS server are required. You can build the connector without a Kafka or AMPS instance, but you will get more out of this guide by running the examples against working development instances.

Setting up an AMPS Development Instance​

Instructions for starting an instance of AMPS are available in the Introduction to AMPS guide.

tip

The AMPS server runs on x64 Linux. The Introduction to AMPS and AMPS FAQ contain information on how to run an AMPS server on a development system that does not run Linux.

Setting up Kafka and Kafka Connect​

Instructions for starting Apache Kafka are available in the Apache Kafka Quickstart guide.

Kafka Connect is included with Apache Kafka distributions. You can run the connector in either standalone mode or distributed mode. Distributed mode is recommended for the connector examples because connectors can be loaded and managed through the Kafka Connect REST API.

tip

The connector is built for Java 8 or higher. If you are using Kafka 4.0 or higher, use Java 17 or higher for the Kafka runtime.