CDC Configuration

Fabric config.ini file has several sections for CDC configuration:

Section Name

Parameters

cdc

Parameter Name

Parameter Description

#CDC_PUBLISH_MODE=ON

This parameter controls whether a CDC message is published to external systems. The following values can be set:

  • ON (default), when implemented, publish the CDC message.
  • OFF, never publish the CDC message.
  • IF_SETUP, (Studio Debug default) when implemented, publish the CDC message only if the CDC publisher has been configured in the config.ini file.

#MAX_CONCURRENT_TRX=20

 

The number of parallel CDC transactions allowed at any one given time.

#TRX_MAX_WAIT_MS=60000

 

Max wait time to create a new transaction (in milliseconds). Since the transaction creation process might be waiting for the transactions pool to become available, this parameter puts a limit on such wait time.

 

#TRANSACTION_ACKNOWLEDGE_TIME_SEC=60

 

A maximum number of seconds to acknowledge an idle transaction that has not yet been saved to Cassandra.

Click for more information about this parameter.

#TRX_MAX_DURATION_SEC=86400

 

Max duration time for a transaction, when the time elapsed, a transaction will be dropped.

 

#CDC_PUBLISHER_JOB_AFFINITY=

 

Affinity for CDC publisher job

 

#CDC_CONSUMER_JOB_AFFINITY=

Affinity for CDC consumer job

cdc_data_publish

Description

Instructions

Parameters for the CDC_TRANSACTION_PUBLISHER job.

Populate the #BOOTSTRAP_SERVERS by IP address of the Kafka servers.

It is possible to populate several IP addresses separated by a comma.

cdc_data_publish_ssl

Description

Instructions

SSL connection parameters when connecting the Kafka servers.

 
cdc_data_consume

Description

Instructions

Parameters for the CDC_TRANSACTION_CONSUMER job.

Populate the #BOOTSTRAP_SERVERS by IP address of the Kafka servers.

It is possible to populate several IP addresses separated by a comma.

cdc_data_consume_ssl

Description

Instructions

SSL connection parameters when connecting the Kafka servers.

 
 
search_engine

Description

Instructions

Supported providers: ElasticSearchProvide

A maximum number of concurrent threads to process the bulk actions:

#BULK_PROCESSOR_MAX_CONCURRENT_WORKERS=5

Bulk size. The maximum number of actions (requests) in one bulk:

#BULK_PROCESSOR_MAX_ACTIONS=1000

Previous

CDC Configuration

Fabric config.ini file has several sections for CDC configuration:

Section Name

Parameters

cdc

Parameter Name

Parameter Description

#CDC_PUBLISH_MODE=ON

This parameter controls whether a CDC message is published to external systems. The following values can be set:

  • ON (default), when implemented, publish the CDC message.
  • OFF, never publish the CDC message.
  • IF_SETUP, (Studio Debug default) when implemented, publish the CDC message only if the CDC publisher has been configured in the config.ini file.

#MAX_CONCURRENT_TRX=20

 

The number of parallel CDC transactions allowed at any one given time.

#TRX_MAX_WAIT_MS=60000

 

Max wait time to create a new transaction (in milliseconds). Since the transaction creation process might be waiting for the transactions pool to become available, this parameter puts a limit on such wait time.

 

#TRANSACTION_ACKNOWLEDGE_TIME_SEC=60

 

A maximum number of seconds to acknowledge an idle transaction that has not yet been saved to Cassandra.

Click for more information about this parameter.

#TRX_MAX_DURATION_SEC=86400

 

Max duration time for a transaction, when the time elapsed, a transaction will be dropped.

 

#CDC_PUBLISHER_JOB_AFFINITY=

 

Affinity for CDC publisher job

 

#CDC_CONSUMER_JOB_AFFINITY=

Affinity for CDC consumer job

cdc_data_publish

Description

Instructions

Parameters for the CDC_TRANSACTION_PUBLISHER job.

Populate the #BOOTSTRAP_SERVERS by IP address of the Kafka servers.

It is possible to populate several IP addresses separated by a comma.

cdc_data_publish_ssl

Description

Instructions

SSL connection parameters when connecting the Kafka servers.

 
cdc_data_consume

Description

Instructions

Parameters for the CDC_TRANSACTION_CONSUMER job.

Populate the #BOOTSTRAP_SERVERS by IP address of the Kafka servers.

It is possible to populate several IP addresses separated by a comma.

cdc_data_consume_ssl

Description

Instructions

SSL connection parameters when connecting the Kafka servers.

 
 
search_engine

Description

Instructions

Supported providers: ElasticSearchProvide

A maximum number of concurrent threads to process the bulk actions:

#BULK_PROCESSOR_MAX_CONCURRENT_WORKERS=5

Bulk size. The maximum number of actions (requests) in one bulk:

#BULK_PROCESSOR_MAX_ACTIONS=1000

Previous