Predefined Entity List Implementation
This article outlines the implementation of a Custom Logic flow to enable an entity subset based on the Predefined Entity List in a task. The entity list of the full entity subset can be generated by either using an SQL query on the source DB or running a Broadway flow. A Broadway flow is required when running an extract task on a non-JDBC data source.
Implementation Guidelines
The MigrateList MTable can run either an SQL statement or a Broadway flow.
Create a Broadway flow under the related root LU or the Shared Objects. It is recommended to place the Broadway flow under the Shared Objects to enable running the flow on several root LUs of a given Business Entity (BE). The Broadway flow must include the following Stages:
- Stage 1: Generate the list of entities.
- Stage 2: Call the insertToLuExternalEntityList Actor (imported from the TDM library) in a loop (iteration) to insert all entities into the entity table created in the TDM DB:
- Set the input LU_NAME as external; its value is populated by the task execution process.
- Set a Transaction in the loop to ensure a single commit for all iterations.
Populate the Broadway flow in the MigrateList MTable.
Redeploy the related LUs and the TDM LU.
How the Broadway Flow Generates an Entity List for Task Execution
The Broadway flow needs to generate the entity list and call the TDM library Actors to insert them into a dedicated table in the TDM DB. For each task execution, a separate entity table is created with the following naming convention: entity_list_<task exe_id>.
The TDM task execution process runs the batch process on entities in the entity table that belong to the current task execution (identified by the current task execution id). The table is removed when the task execution process is complete.
Debugging the Broadway Flow
- Run the createLuExternalEntityListTable TDM flow (imported from the TDM library) and populate the taskExecutionId input parameter to create the entity table in the TDM DB.
- Populate the input parameters and run the customized Broadway flow.
Predefined Entity List Implementation
This article outlines the implementation of a Custom Logic flow to enable an entity subset based on the Predefined Entity List in a task. The entity list of the full entity subset can be generated by either using an SQL query on the source DB or running a Broadway flow. A Broadway flow is required when running an extract task on a non-JDBC data source.
Implementation Guidelines
The MigrateList MTable can run either an SQL statement or a Broadway flow.
Create a Broadway flow under the related root LU or the Shared Objects. It is recommended to place the Broadway flow under the Shared Objects to enable running the flow on several root LUs of a given Business Entity (BE). The Broadway flow must include the following Stages:
- Stage 1: Generate the list of entities.
- Stage 2: Call the insertToLuExternalEntityList Actor (imported from the TDM library) in a loop (iteration) to insert all entities into the entity table created in the TDM DB:
- Set the input LU_NAME as external; its value is populated by the task execution process.
- Set a Transaction in the loop to ensure a single commit for all iterations.
Populate the Broadway flow in the MigrateList MTable.
Redeploy the related LUs and the TDM LU.
How the Broadway Flow Generates an Entity List for Task Execution
The Broadway flow needs to generate the entity list and call the TDM library Actors to insert them into a dedicated table in the TDM DB. For each task execution, a separate entity table is created with the following naming convention: entity_list_<task exe_id>.
The TDM task execution process runs the batch process on entities in the entity table that belong to the current task execution (identified by the current task execution id). The table is removed when the task execution process is complete.
Debugging the Broadway Flow
- Run the createLuExternalEntityListTable TDM flow (imported from the TDM library) and populate the taskExecutionId input parameter to create the entity table in the TDM DB.
- Populate the input parameters and run the customized Broadway flow.
