{"database":"redshift","version":"1.34.3","metadata":{"identifier":{"packageName":"Matillion.Utilities","name":"Audit"},"rootJobReference":{"name":"Audit","type":"ORCHESTRATION","parameterMetadata":[{"slot":2,"variableName":"audit_job_name","variableType":"SCALAR","displayName":"Parent Job Name","description":"Use automatic variable ${job_name} to populate this property"},{"slot":3,"variableName":"sns_flag","variableType":"SCALAR","displayName":"Send SNS Message","description":"Posts a message to SNS if property is set to 'Yes' or 'True'"},{"slot":4,"variableName":"sns_region","variableType":"SCALAR","displayName":"SNS Region","description":"SNS Region"},{"slot":5,"variableName":"sns_topic","variableType":"SCALAR","displayName":"SNS Topic","description":"SNS Topic Name"},{"slot":6,"variableName":"sns_subject","variableType":"SCALAR","displayName":"SNS Subject","description":"SNS Subject"},{"slot":7,"variableName":"audit_table_flag","variableType":"SCALAR","displayName":"Write to Audit Table","description":"Writes metadata to an audit table if property is set to 'Yes' or 'True'"},{"slot":8,"variableName":"audit_table_name","variableType":"SCALAR","displayName":"Audit Table Name","description":"Audit table name. Table will be created if does not already exist."},{"slot":9,"variableName":"cloudwatch_flag","variableType":"SCALAR","displayName":"Publish CloudWatch Metrics","description":"Publishes Row Count & Duration to CloudWatch if property is set to 'Yes' or 'True'"},{"slot":10,"variableName":"cloudwatch_region","variableType":"SCALAR","displayName":"CloudWatch Region","description":"CloudWatch Region"},{"slot":11,"variableName":"cloudwatch_ns","variableType":"SCALAR","displayName":"CloudWatch Namespace","description":"CloudWatch Namespace"}]},"orchestrationJobs":["Audit"],"transformationJobs":["Populate Audit Table"],"imageMetadata":{"componentIcon":"iVBORw0KGgoAAAANSUhEUgAAACAAAAAgCAYAAABzenr0AAAChElEQVR42rVX30uTURh+sxK1KCyKLIKwqMuiW7GLCCLwRoSg/oS67kK6KLGiIIogqIvwXummiEokv++b2ygawXTpRbCWM8JJI2vqmtjbc75947gN9ZzX7cDD2L497/OcH9/7vofIcPAQbWWPzrBLfcBLYBxIB0jg2St26BY+z3KMtlOtBkdpDwLfhMh3gA0xC9zhCO2XCzM1YDZXEShrIVyJ38A1tXr2s/bo7SaEK+FhFQ+Yib+jQyBM1lC8hCRiH9145i5N1UG8hK8cora199ylN3UUL8KjMLZjW7UBl64YB4mdZl6YKkdkr42R3nLxMWq1Ou2xk1w1Qi02BnIcpoPagEc3rJbxfXu5+L8Cfm+w3Y4HOsO5NGNFjuwrN7CclZyHLM5Ck9r7TmtyqElNWxtY+iY7kA51UZBmLclbmFfy2kAuIX0jHqoVeCEiF+a0gfmo1ICrDMRF5KWkNpAdluaFlDIwLSLn4tpA5rnUwDwF9dye/CusDfwYkBr4Q34zISH/fK0NzDySGkiT38lIyJlBbSDVLzUwplbgtog80cWcvF7Epw5pHnis8sC5ulfAtTBKPaQaSHzJWJPDrcyJbubxC3ifG0UHkIdpR6kU37MT38WcT6/KAyOS5X+qqyH6Nb9EmpLj56vLsSpQ5gb+ogVor2xIeq0aktVjZQEFqtlm9nerOyK0SXgYNQ6S6ituw+IX5slLNrOP+2V4nY54uo4nf3bjzniUTojT8/rIYOanzO4GHh0G4WMNxScgfszudvSZGmGkH+T8JoQLEL6P+0az/I7o0BEYeeInDnPhRWAAr9rx2t2SHdoJIxdVAkHwD0H2XA4w52+ZQ8/wn8s8QrtN4/4Hu6I+6hximlwAAAAASUVORK5CYII=","smallIcon":"iVBORw0KGgoAAAANSUhEUgAAABAAAAAQCAYAAAAf8/9hAAABLUlEQVR42o1TzUoDMRgctLV46E3BBxAUDxXfyxcRtCgoiPgUPYgg2N0t9qDFixQsghehF38O1VZr2x2/NJGa3SQYGBaS+eb7mwUyh3WsMsIOY7Tk+2pwK/e7vMQafIctFKeBEUYCejAWVNnGQjZrQR5qgUAbMc4tEZPZJjXK5MO2RlzMi9Sx/7fnfNlXS9QnFYF5dzsJNtzZFZKSjh+/+1tRVZhpuwmTL3LYDc3jTlXw4iV8P5P9TkjgA2bPbsLnI9m7CQn0MTWJj9A9JZ+qIYG2EtjzEporehv+IR6qNa4bh2XWuKyHOHpz+yBCKtbe/DXSgdNIAxlg71oE5lzZj2dOPENJLi/+beUIMZtYtP8HLXIkmAQCU8FJLtgSSlAxQveCoUFHlSym28ryfwDtv2FASoZzEAAAAABJRU5ErkJggg=="},"description":"This job will write job metadata to an SNS Topic, Audit Table and CloudWatch.\nThe job can be configured to selectively use the above services by setting the relevant property to 'Yes' or 'True'\n\nRequires the following environment variables to be created:\naudit_completed_at\tText\tShared\tPublic\t\naudit_component\tText\tShared\tPublic\t\naudit_duration\tNumeric\tShared\tPublic\t-1\naudit_message\tText\tShared\tPublic\t\naudit_row_count\tNumeric\tShared\tPublic\t-1\naudit_started_at\tText\tShared\tPublic\t\naudit_status\tText\tShared\tPublic","helpHtml":"
This job will write job metadata to an SNS Topic, Audit Table and CloudWatch.\nThe job can be configured to selectively use the above services by setting the relevant property to 'Yes' or 'True'\n\nRequires the following environment variables to be created:\naudit_completed_at\tText\tShared\tPublic\t\naudit_component\tText\tShared\tPublic\t\naudit_duration\tNumeric\tShared\tPublic\t-1\naudit_message\tText\tShared\tPublic\t\naudit_row_count\tNumeric\tShared\tPublic\t-1\naudit_started_at\tText\tShared\tPublic\t\naudit_status\tText\tShared\tPublic
Property | Type | Description |
---|---|---|
Parent Job Name | Variable | Use automatic variable ${job_name} to populate this property |
Send SNS Message | Variable | Posts a message to SNS if property is set to 'Yes' or 'True' |
SNS Region | Variable | SNS Region |
SNS Topic | Variable | SNS Topic Name |
SNS Subject | Variable | SNS Subject |
Write to Audit Table | Variable | Writes metadata to an audit table if property is set to 'Yes' or 'True' |
Audit Table Name | Variable | Audit table name. Table will be created if does not already exist. |
Publish CloudWatch Metrics | Variable | Publishes Row Count & Duration to CloudWatch if property is set to 'Yes' or 'True' |
CloudWatch Region | Variable | CloudWatch Region |
CloudWatch Namespace | Variable | CloudWatch Namespace |