{"database":"bigquery","version":"1.34.3","metadata":{"identifier":{"packageName":"Matillion.Utilities","name":"Audit"},"rootJobReference":{"name":"Audit","type":"ORCHESTRATION","parameterMetadata":[{"slot":2,"variableName":"audit_table_flag","variableType":"SCALAR","displayName":"Write to Audit Table","description":"Writes metadata to an audit table if property is set to 'Yes' or 'True'"},{"slot":3,"variableName":"audit_job_name","variableType":"SCALAR","displayName":"Parent Job Name","description":"Use automatic variable ${job_name} to populate this property"},{"slot":4,"variableName":"audit_table_name","variableType":"SCALAR","displayName":"Audit Table Name","description":"Audit table name. Table will be created if does not already exist."},{"slot":5,"variableName":"pub_sub_flag","variableType":"SCALAR","displayName":"Publish to GCP Topic","description":"Publishes a message via Pub/Sub if property is set to 'Yes' or 'True'"},{"slot":6,"variableName":"pub_sub_topic","variableType":"SCALAR","displayName":"GCP Topic","description":"Publish/Subscribe topic in GCP."},{"slot":7,"variableName":"pub_sub_project","variableType":"SCALAR","displayName":"GCP Project","description":"Publish/Subcribe project in GCP."}]},"orchestrationJobs":["Audit"],"transformationJobs":["Populate Audit Table"],"imageMetadata":{"componentIcon":"iVBORw0KGgoAAAANSUhEUgAAACAAAAAgCAYAAABzenr0AAAChElEQVR42rVX30uTURh+sxK1KCyKLIKwqMuiW7GLCCLwRoSg/oS67kK6KLGiIIogqIvwXummiEokv++b2ygawXTpRbCWM8JJI2vqmtjbc75947gN9ZzX7cDD2L497/OcH9/7vofIcPAQbWWPzrBLfcBLYBxIB0jg2St26BY+z3KMtlOtBkdpDwLfhMh3gA0xC9zhCO2XCzM1YDZXEShrIVyJ38A1tXr2s/bo7SaEK+FhFQ+Yib+jQyBM1lC8hCRiH9145i5N1UG8hK8cora199ylN3UUL8KjMLZjW7UBl64YB4mdZl6YKkdkr42R3nLxMWq1Ou2xk1w1Qi02BnIcpoPagEc3rJbxfXu5+L8Cfm+w3Y4HOsO5NGNFjuwrN7CclZyHLM5Ck9r7TmtyqElNWxtY+iY7kA51UZBmLclbmFfy2kAuIX0jHqoVeCEiF+a0gfmo1ICrDMRF5KWkNpAdluaFlDIwLSLn4tpA5rnUwDwF9dye/CusDfwYkBr4Q34zISH/fK0NzDySGkiT38lIyJlBbSDVLzUwplbgtog80cWcvF7Epw5pHnis8sC5ulfAtTBKPaQaSHzJWJPDrcyJbubxC3ifG0UHkIdpR6kU37MT38WcT6/KAyOS5X+qqyH6Nb9EmpLj56vLsSpQ5gb+ogVor2xIeq0aktVjZQEFqtlm9nerOyK0SXgYNQ6S6ituw+IX5slLNrOP+2V4nY54uo4nf3bjzniUTojT8/rIYOanzO4GHh0G4WMNxScgfszudvSZGmGkH+T8JoQLEL6P+0az/I7o0BEYeeInDnPhRWAAr9rx2t2SHdoJIxdVAkHwD0H2XA4w52+ZQ8/wn8s8QrtN4/4Hu6I+6hximlwAAAAASUVORK5CYII=","smallIcon":"iVBORw0KGgoAAAANSUhEUgAAABAAAAAQCAYAAAAf8/9hAAABLUlEQVR42o1TzUoDMRgctLV46E3BBxAUDxXfyxcRtCgoiPgUPYgg2N0t9qDFixQsghehF38O1VZr2x2/NJGa3SQYGBaS+eb7mwUyh3WsMsIOY7Tk+2pwK/e7vMQafIctFKeBEUYCejAWVNnGQjZrQR5qgUAbMc4tEZPZJjXK5MO2RlzMi9Sx/7fnfNlXS9QnFYF5dzsJNtzZFZKSjh+/+1tRVZhpuwmTL3LYDc3jTlXw4iV8P5P9TkjgA2bPbsLnI9m7CQn0MTWJj9A9JZ+qIYG2EtjzEporehv+IR6qNa4bh2XWuKyHOHpz+yBCKtbe/DXSgdNIAxlg71oE5lzZj2dOPENJLi/+beUIMZtYtP8HLXIkmAQCU8FJLtgSSlAxQveCoUFHlSym28ryfwDtv2FASoZzEAAAAABJRU5ErkJggg=="},"description":"This job will write job metadata to a GCP Publish Top and Audit Table.\n\nThe job can be configured to selectively use the above services by setting the relevant property to 'Yes' or 'True'\n\nRequires the following environment variables to be created:\naudit_completed_at\tText\tShared\tPublic\t\naudit_component\tText\tShared\tPublic\t\naudit_duration\tNumeric\tShared\tPublic\t-1\naudit_message\tText\tShared\tPublic\t\naudit_row_count\tNumeric\tShared\tPublic\t-1\naudit_started_at\tText\tShared\tPublic\t\naudit_status\tText\tShared\tPublic","helpHtml":"
This job will write job metadata to a GCP Publish Top and Audit Table.\n\nThe job can be configured to selectively use the above services by setting the relevant property to 'Yes' or 'True'\n\nRequires the following environment variables to be created:\naudit_completed_at\tText\tShared\tPublic\t\naudit_component\tText\tShared\tPublic\t\naudit_duration\tNumeric\tShared\tPublic\t-1\naudit_message\tText\tShared\tPublic\t\naudit_row_count\tNumeric\tShared\tPublic\t-1\naudit_started_at\tText\tShared\tPublic\t\naudit_status\tText\tShared\tPublic
Property | Type | Description |
---|---|---|
Write to Audit Table | Variable | Writes metadata to an audit table if property is set to 'Yes' or 'True' |
Parent Job Name | Variable | Use automatic variable ${job_name} to populate this property |
Audit Table Name | Variable | Audit table name. Table will be created if does not already exist. |
Publish to GCP Topic | Variable | Publishes a message via Pub/Sub if property is set to 'Yes' or 'True' |
GCP Topic | Variable | Publish/Subscribe topic in GCP. |
GCP Project | Variable | Publish/Subcribe project in GCP. |