Workflows
Workflows are long running processes, managed by the system, and represent the orchestration of a specific set of activities. These activities can include the loading of data for linkages and the extraction of linkage results.
You can view a list of active and complete workflows from the Activity page.
Workflow types
There is one type of workflow process available:
Link and Extract
This workflow manages the linkage of one or more data sources and the extraction of linkage results. It is triggered through the Bulk Load function on a Linkage Project.
Only Data Sources with direct connections (such as Microsoft SQL Table Data Source) can be included in this process as it needs to be able to pull the data from the data source directly.
The process of loading the data can occur as a single Envelope, whereby each data source is first loaded into the system before the linkage process occurs.
It can also load and link every data source independently, each one treated as a separate Envelope. The workflow will load one data source at a time, wait for the linkage to complete, and then load data from the next data source. This will continue until all data sources have been loaded and linked.
If the workflow also includes a suitable Extraction Project (i.e. an Enduring Key Extraction Project), the system will run extraction requests for each Event Type associated with the Data Sources that were loaded. Similarly to the linkages, it will request Event Types one at a time, waiting for one to complete before triggering the next.
These workflows can either be run immediately on creation, or scheduled to run periodically. This option is given to the user when workflow is created.
Workflow schedules can be managed within each Linkage Project.
Data Client Secret Sharing
This workflow is initiated whenever a data source associated with a Data Client is attached to a Linkage Project's PPRL Scope for the first time. Each data client requires a secret to encode the source data and this secret is managed entirely by the data clients themselves.
The first Data Client to be added to a PPRL Scope will be asked to create a new secret. Subsequent data clients that are added to the PPRL Scope will acquire the same secret, with one of the already attached clients tasked with encrypting the secret and passing it through LinXmart to its destination.
As multiple Event Types can be attached to a Linkage Project in one action, this Data Client Secret Sharing workflow will be created to ensure that all Data Client participating in the linkage for this project have the same shared secret.
These workflows are managed entirely by the system.