Workflows
Workflows are long running processes, managed by the system, and represent the orchestration of a specific set of activities. These activities can include the loading of data for linkages and the extraction of linkage results.
You can view a list of active and complete workflows from the Activity page.
Workflow types
There is one type of workflow process available:
Link and Extract
This workflow manages the linkage of one or more data sources and the extraction of linkage results. It is triggered through the Bulk Load function on a Linkage Project.
Only Data Sources with direct connections (such as Microsoft SQL Table Data Source) can be included in this process as it needs to be able to pull the data from the data source directly.
The process of loading the data can occur as a single Envelope, whereby each data source is first loaded into the system before the linkage process occurs.
It can also load and link every data source independently, each one treated as a separate Envelope. The workflow will load one data source at a time, wait for the linkage to complete, and then load data from the next data source. This will continue until all data sources have been loaded and linked.
If the workflow also includes a suitable Extraction Project (i.e. an Enduring Key Extraction Project), the system will run extraction requests for each Event Type associated with the Data Sources that were loaded. Similarly to the linkages, it will request Event Types one at a time, waiting for one to complete before triggering the next.
Workflow schedules
Workflows can either be run immediately on creation, or scheduled to run periodically. This option is given to the user when workflow is created.
Workflow schedules can be managed within each Linkage Project.