Predefined Entity List Implementation
This article guides how to implement Custom Logic flow in order to enable an entity subset based on the Predefined Entity List in a task. The entity list of the full entity subset can be generated by either using an SQL query on the source DB or running a Broadway flow. A Broadway flow is needed when running an extract task on a non-JDBC data source.
Implementation Guidelines
The MigrateList MTable can run either an SQL statement or a Broadway flow.
Create a Broadway flow under the related root LU or the Shared Objects. It is recommended to locate the Broadway flow under the Shared Objects to enable running the flow on several root LUs of a given Business Entity. The Broadway flow must include the following stages:
- Stage 1: Get the list of entities.
- Stage 2: Call the insertToLuExternalEntityList Actor (imported from the TDM library) in a loop (iteration) to insert all entities into the entity table created in the TDM DB:
- Set the input LU_NAME to be external and get its value from the task execution process.
- Set a Transaction in the loop to have one commit on all iterations.
Populate the Broadway flow in the MigrateList MTable.
Redeploy the related LUs and the TDM LU.
How does the Broadway Flow generate an Entity List for the Task Execution?
The TDM library provides a list of Broadway Actors and flows to support generating an entity list by a project's Broadway flow. The project's Broadway flow gets the entity list and calls the TDM library Actors to insert them into a dedicated table in the TDM DB. A separate entity table is created upon a task execution and has the following naming convention: entity_list_<task exe_id>.
The TDM task execution process runs the batch process on entities in the entity table that are a part of the current task execution, having the current task execution id. The table is dropped at the end of the task execution.
From TDM 8.1 onwards, the entity table is created in the TDM DB.
Debugging the Broadway Flow
- Run the createLuExternalEntityListTable TDM flow (imported from the TDM library) and populate the input taskExecutionId parameter to create the entity table in the TDM DB.
- Populate the input parameters and run the customized Broadway flow.
Predefined Entity List Implementation
This article guides how to implement Custom Logic flow in order to enable an entity subset based on the Predefined Entity List in a task. The entity list of the full entity subset can be generated by either using an SQL query on the source DB or running a Broadway flow. A Broadway flow is needed when running an extract task on a non-JDBC data source.
Implementation Guidelines
The MigrateList MTable can run either an SQL statement or a Broadway flow.
Create a Broadway flow under the related root LU or the Shared Objects. It is recommended to locate the Broadway flow under the Shared Objects to enable running the flow on several root LUs of a given Business Entity. The Broadway flow must include the following stages:
- Stage 1: Get the list of entities.
- Stage 2: Call the insertToLuExternalEntityList Actor (imported from the TDM library) in a loop (iteration) to insert all entities into the entity table created in the TDM DB:
- Set the input LU_NAME to be external and get its value from the task execution process.
- Set a Transaction in the loop to have one commit on all iterations.
Populate the Broadway flow in the MigrateList MTable.
Redeploy the related LUs and the TDM LU.
How does the Broadway Flow generate an Entity List for the Task Execution?
The TDM library provides a list of Broadway Actors and flows to support generating an entity list by a project's Broadway flow. The project's Broadway flow gets the entity list and calls the TDM library Actors to insert them into a dedicated table in the TDM DB. A separate entity table is created upon a task execution and has the following naming convention: entity_list_<task exe_id>.
The TDM task execution process runs the batch process on entities in the entity table that are a part of the current task execution, having the current task execution id. The table is dropped at the end of the task execution.
From TDM 8.1 onwards, the entity table is created in the TDM DB.
Debugging the Broadway Flow
- Run the createLuExternalEntityListTable TDM flow (imported from the TDM library) and populate the input taskExecutionId parameter to create the entity table in the TDM DB.
- Populate the input parameters and run the customized Broadway flow.
