Kafka Interface
A Kafka interface type defines the connections to Apache Kafka and can be used by the Broadway Pub / Sub Actors, iidFinder or by User Jobs.
To create a new Kafka interface, do the following:
Go to Project Tree > Shared Objects, right click Interfaces and select New Interface and then select Kafka from the Interface Type dropdown menu to open the New Interface window.
Populate the connection's settings and click Save.
Connection Settings
Example of SSL Properties Definition
SSL Security Protocol
When SSL authentication is required on Kafka, set Enable SSL/SASL property to True and populate the SSL properties on the Kafka Interface. Below is the example of Interface definition when the Security Protocol = SSL.
SASL_SSL / SASL_PLAINTEXT Security Protocols
When you need to connect to Kafka using a user and a password, set the Security Protocol = SASL_SSL or SASL_PLAINTEXT and populate the Session user name and password attributes.
In addition, in case of SASL_SSL - populate the Truststore and Keystore properties as below.
Example of Publish to Kafka Broadway Flow
The above Broadway flow uses a Publish Actor to publish the data to the predefined Kafka interface. The data is published to the Example topic which overrides the topic in the Interface definition.
Kafka Interface
A Kafka interface type defines the connections to Apache Kafka and can be used by the Broadway Pub / Sub Actors, iidFinder or by User Jobs.
To create a new Kafka interface, do the following:
Go to Project Tree > Shared Objects, right click Interfaces and select New Interface and then select Kafka from the Interface Type dropdown menu to open the New Interface window.
Populate the connection's settings and click Save.
Connection Settings
Example of SSL Properties Definition
SSL Security Protocol
When SSL authentication is required on Kafka, set Enable SSL/SASL property to True and populate the SSL properties on the Kafka Interface. Below is the example of Interface definition when the Security Protocol = SSL.
SASL_SSL / SASL_PLAINTEXT Security Protocols
When you need to connect to Kafka using a user and a password, set the Security Protocol = SASL_SSL or SASL_PLAINTEXT and populate the Session user name and password attributes.
In addition, in case of SASL_SSL - populate the Truststore and Keystore properties as below.
Example of Publish to Kafka Broadway Flow
The above Broadway flow uses a Publish Actor to publish the data to the predefined Kafka interface. The data is published to the Example topic which overrides the topic in the Interface definition.
