Task - Test Data Store Component
The Test Data Store component is the Fabric ETL and storage layer, and it is mandatory on each task. It has 2 attributes:
Create Data Snapshot Checkbox
Check the checkbox to create a Data snapshot (version) for the extracted entities and/or tables.
Entities
This checkbox is clear by default. The checkbox can be checked whenever the Source' Policy for fetching data gets the data from the source environment or the task synthetically generates new entities.
Tables
This checkbox is checked since each task execution that gets the data from the source environment, creates a new data snapshot (version) on each extracted table.
Retention Period
The retention period is set on the extracted entities and/or tables. When this period ends, the task's entities and/or tables are automatically deleted from Fabric and are no longer available.
Retention Period Values
Do not delete - do not delete from Fabric.
Do not retain - avoid saving the task's entities and/or tables in Fabric. This option can be used, for example, for running an extract task on a large subset of entities in order to populate TDM parameter tables on each entity without saving the entities into Fabric.
Setting a time measuring unit (e.g., minutes, hours, days) and a corresponding value. For example, save the data in Fabric for 2 days. When this set period ends, the data will automatically be deleted from Fabric.
Notes:
- The time measuring unit and value can be set only if the Fabric storage supports TTL (Time to Live). Otherwise, the task window must be configured to display only the Do not delete and Do not retain options.
- The retention period can be set in minutes, hours, days, weeks or years, depending on the maximum retention period that is set in the TDM DB. Both parameters - default retention period and maximum retention period - are set in the TDM DB.
Default Retention Period
Data versioning checkbox is clear - Do not delete.
Data versioning checkbox is checked -
Fabric storage supports TTL:
Entities: 5 days.
Tables: Do not delete.
Fabric storage does not support TTL:
Do not delete
Task - Test Data Store Component
The Test Data Store component is the Fabric ETL and storage layer, and it is mandatory on each task. It has 2 attributes:
Create Data Snapshot Checkbox
Check the checkbox to create a Data snapshot (version) for the extracted entities and/or tables.
Entities
This checkbox is clear by default. The checkbox can be checked whenever the Source' Policy for fetching data gets the data from the source environment or the task synthetically generates new entities.
Tables
This checkbox is checked since each task execution that gets the data from the source environment, creates a new data snapshot (version) on each extracted table.
Retention Period
The retention period is set on the extracted entities and/or tables. When this period ends, the task's entities and/or tables are automatically deleted from Fabric and are no longer available.
Retention Period Values
Do not delete - do not delete from Fabric.
Do not retain - avoid saving the task's entities and/or tables in Fabric. This option can be used, for example, for running an extract task on a large subset of entities in order to populate TDM parameter tables on each entity without saving the entities into Fabric.
Setting a time measuring unit (e.g., minutes, hours, days) and a corresponding value. For example, save the data in Fabric for 2 days. When this set period ends, the data will automatically be deleted from Fabric.
Notes:
- The time measuring unit and value can be set only if the Fabric storage supports TTL (Time to Live). Otherwise, the task window must be configured to display only the Do not delete and Do not retain options.
- The retention period can be set in minutes, hours, days, weeks or years, depending on the maximum retention period that is set in the TDM DB. Both parameters - default retention period and maximum retention period - are set in the TDM DB.
Default Retention Period
Data versioning checkbox is clear - Do not delete.
Data versioning checkbox is checked -
Fabric storage supports TTL:
Entities: 5 days.
Tables: Do not delete.
Fabric storage does not support TTL:
Do not delete
