Broadway Flows Execution

Use Case

A Broadway Batch process can be executed to loop through a list of external parameters such as a list of payments records (of a specific set of instances), or over a list of files.

Broadway batch processes can also be run on multiple instances using Instance Groups or embedded SQL statements as described in the Batch Commands section.

In addition, this process can benefit from all Batch configuration parameters, such as nodes affinity, capacity (max_nodes, max_workers_per_node) and the ability to run multiple executions of the same Batch process (allow_multiple).

Broadway Batch Commands

Example 1

The FABRIC_COMMAND parameter must be set using the Broadway command syntax as described below:

BATCH CUSTOMER.customer_IG_600To700 FABRIC_COMMAND="broadway Customer.SampleFlow customer_id=?" with async=true;

Example 2

BATCH CUSTOMER from fabric USING ('BROADWAY CUSTOMER.flow1') fabric_command='sync_instance CUSTOMER.?';

Migrate the list of entities created using a Broadway flow “flow1”. Note that “flow1” output should return a list of instance IDs. The BROADWAY command, executed within the ‘USING’ clause, will run as if the RESULT_STRUCTURE=CURSOR.

Previous

Broadway Flows Execution

Use Case

A Broadway Batch process can be executed to loop through a list of external parameters such as a list of payments records (of a specific set of instances), or over a list of files.

Broadway batch processes can also be run on multiple instances using Instance Groups or embedded SQL statements as described in the Batch Commands section.

In addition, this process can benefit from all Batch configuration parameters, such as nodes affinity, capacity (max_nodes, max_workers_per_node) and the ability to run multiple executions of the same Batch process (allow_multiple).

Broadway Batch Commands

Example 1

The FABRIC_COMMAND parameter must be set using the Broadway command syntax as described below:

BATCH CUSTOMER.customer_IG_600To700 FABRIC_COMMAND="broadway Customer.SampleFlow customer_id=?" with async=true;

Example 2

BATCH CUSTOMER from fabric USING ('BROADWAY CUSTOMER.flow1') fabric_command='sync_instance CUSTOMER.?';

Migrate the list of entities created using a Broadway flow “flow1”. Note that “flow1” output should return a list of instance IDs. The BROADWAY command, executed within the ‘USING’ clause, will run as if the RESULT_STRUCTURE=CURSOR.

Previous