Onboard Rule With Impact
A 4-step recipe with Acceldata. We can help you get access.
Recipe · 4 steps
Onboard Rule With Impact
with Acceldata
Create a data quality rule and map the datasets it will impact.
- List datasets on the given source and capture the first dataset id to onboard the rule against.
- List the rules already monitoring the dataset so the new rule does not duplicate existing coverage.
- Create the new data quality rule on the dataset's column using the supplied definition.
- Retrieve the dataset's downstream lineage so the consumers affected by this rule's alerts are identified.
What you'll need to have ready
- apiKey: Acceldata API key sent in the X-API-Key header.
- source: Data source platform to filter datasets by (e.g. snowflake).
- ruleName: Name of the data quality rule to create.
- ruleType: Type of data quality check (e.g. null_check, uniqueness_check).
- columnName: Column on the dataset that the rule monitors.
- threshold: Alert threshold as a percentage (0-100).
- severity: Severity of alerts triggered by this rule.
For your developer
Arazzo workflow acceldata:onboard-rule-with-impact, 4 operations: listDatasets → getDataQualityRules → postDataQualityRules → getDatasetLineage. Specs on APIs.io.