Create a Data Change Task
Security:
- Prism: Manage File Containersdomain in the Prism Analytics functional area when uploading a file.
- Prism: Manage Connectiondomain in the Prism Analytics functional area to use a source connection.
- Any of these security requirements:
- Prism: Tables Owner Managedomain in the Prism Analytics functional area.
- Prism: Tables Managedomain in the Prism Analytics functional area.
- Table Ownerpermission on the table.
- Table Editorpermission on the table.
- Can Delete Table Datapermission on the table.
- Can Insert Table Datapermission on the table.
- Can Truncate Table Datapermission on the table.
- Can Update Table Datapermission on the table.
You can change the rows of data in a table by creating and running a data change task. You can:
- Insert new rows.
- Update specific rows based on a key field.
- Delete specific rows based on a key field.
- Insert new and update existing rows in the same activity, known as an upsert operation.
How you change the rows in the table depends on the operation you select, such as upsert or delete, and the source data. The source you specify must contain the rows you want to change in the table, such as new rows to insert, or existing rows to update or delete.
To create, edit, or view a data change task on a target table, you must have permission on the target table. Example: To create a data change task using the upsert operation, you must have both insert and update permission on the target table.
- Access theData Catalogreport.
- Select .You can change the data change task name at the top of the left side panel.
- On theSourcestep, select the source that contains the data you want to change in the target table.Workday uses the file upload source type by default. ClickChange Connectionto select a different source type. As you select a source type, consider:
Option Description File UploadSelect 1 or more delimited files.When you upload multiple files, each file must use the same schema. Workday supports RFC 4180-compliant delimited files. For more information, see RFC 4180.When you select file upload as the source type, configure theSource Optionsto define how to parse the file.Amazon RedshiftSelect an Amazon Redshift connection.Define the data to retrieve when the data change task runs. You can select an Amazon Redshift table using theSelectbutton or enter a SQL SELECT statement in theQuery Expression.When you select a table, Workday populates theQuery Expressionwith the appropriate SQL statement and places backtick characters (`) around each Redshift table, catalog, and schema. You can edit the expression to refine the query further. The backtick characters are optional, but Workday adds them automatically just in case an Amazon Redshift table, schema, or catalog uses a SQL key word.When you run a data change task with an Amazon Redshift connection, Workday:- Connects to Amazon Redshift using basic authentication (username and password) or the AWS Identity and Access Management (IAM) credentials configured on the connection.
- Retrieves the data defined by the SQL Query Expression or Source Object.
Amazon S3Select an Amazon S3 connection.When you use an Amazon S3 connection, you define:- The objects to read when the data change task runs.
- The source schema so Workday knows how to read each object.
See Select an Amazon S3 Connection in a Data Change Task for details.When you run a data change task with an Amazon S3 connection, Workday:- Connects to Amazon using the access key credentials configured in the connection.
- Retrieves the objects defined in the data change taskObject Patternfield.
- Uses the parsing options defined in the data change taskSource Optionsstep to read the objects retrieved from the S3 bucket.
Azure SynapseSelect an Azure Synapse connection.Define the data to retrieve when the data change task runs. You can select an Azure Synapse table using theSelectbutton or enter a SQL SELECT statement in theQuery Expression.When you select a table, Workday populates theQuery Expressionwith the appropriate SQL statement and places backtick characters (`) around each Azure Synapse table, schema, and database. You can edit the expression to refine the query further. The backtick characters are optional, but Workday adds them automatically just in case an Azure Synapse table, schema, or database uses a SQL key word.When you run a data change task with an Azure Synapse connection, Workday:- Connects to Azure Synapse using the authentication configured on the connection.
- Retrieves the objects defined by the SQL Query Expression or Source Object.
Azure BlobSelect an Azure Blob connection.Define the data to retrieve when the data change task runs. You can select a CSV file using theSelectbutton or enter a SQL SELECT statement in theQuery Expression.When you select a CSV file, Workday populates theQuery Expressionwith the appropriate SQL statement and places backtick characters (`) around each CSV file. You can edit the expression to select data from the CSV file.When you run a data change task with an Azure Blob connection, Workday:- Connects to Azure Blob using the authentication configured on the connection.
- Retrieves the objects defined by the SQL Query Expression or Source Object.
When you selectAzure Blobas the source type, Workday adds a newSource Settingsoption to theSourcestep. You can clickAdd SettinginSource Settingsto override the source settings.For information on the different settings available in source settings that you can override, see Reference: Data Change Task Source Settings.BigQuerySelect a BigQuery connection.Define the data to retrieve when the data change task runs. You can select a BigQuery table using theSelectbutton or enter a SQL SELECT statement in theQuery Expression.When you select a table, Workday populates theQuery Expressionwith the appropriate SQL statement and places backtick characters (`) around each BigQuery table, catalog, and schema. You can edit the expression to refine the query further. The backtick characters are optional, but Workday adds them automatically just in case a BigQuery table, schema, or catalog uses a SQL key word.When you run a data change task with a BigQuery connection, Workday:- Connects to BigQuery using Google Service Account Key authentication configured on the connection.
- Retrieves the data defined by the SQL Query Expression or Source Object.
Google Cloud StorageSelect a Google Cloud Storage connection.Define the data to retrieve when the data change task runs. You can select a CSV file using theSelectbutton or enter a SQL SELECT statement in theQuery Expression.When you select a CSV file, Workday populates theQuery Expressionwith the appropriate SQL statement and places backtick characters (`) around each CSV file. You can edit the expression to select data from the CSV file.When you run a data change task with a Google Cloud Storage connection, Workday:- Connects to Google Cloud Storage using Google Service Account Key authentication configured on the connection.
- Retrieves the data defined by the SQL Query Expression or Source Object.
When you selectGoogle Cloud Storageas the source type, Workday adds a newSource Settingsoption to theSourcestep. You can clickAdd SettinginSource Settingsto override the source settings.For information on the different settings available in source settings that you can override, see Reference: Data Change Task Source Settings.Data CatalogSelect an existing dataset or table.SalesforceSelect a Salesforce connection.Define the data to retrieve when the data change task runs. You can select a Salesforce object using theSelectbutton or enter a SQL SELECT statement in theQuery Expression. When you select an object, Workday populates theQuery Expressionwith the appropriate SQL statement. You can edit the expression to refine the query further.When you run a data change task with a Salesforce connection, Workday:- Connects to Salesforce through BasicAuth or OAuth depending on how the connection is configured.
- Retrieves objects defined by the SQL query in theSource Objectsection.
SFTPSelect an SFTP connection that connects to an SFTP server containing 1 or more delimited files.When the SFTP connection contains multiple files, each file must use the same schema. Workday supports RFC 4180-compliant delimited files. For more information, see RFC 4180.For SFTP sources, you must also upload 1 local delimited file that uses the same schema as the files on the SFTP server. Workday uses the uploaded file to determine how to parse the SFTP files. Workday doesn't load the data from the uploaded file to the table.You can override the default directory and file pattern of an SFTP connection.When you select SFTP as the source type, configure theSource Optionsto define how to parse the uploaded file.SnowflakeSelect a Snowflake connection.Define the data to retrieve when the data change task runs. You can select a Snowflake table using theSelectbutton or enter a SQL SELECT statement in theQuery Expression.When you select a table, Workday populates theQuery Expressionwith the appropriate SQL statement and places backtick characters (`) around each Snowflake table, catalog, and schema. You can edit the expression to refine the query further. The backtick characters are optional, but Workday adds them automatically just in case a Snowflake table, schema, or catalog uses a SQL key word.When you run a data change task with a Snowflake connection, Workday:- Connects to Snowflake using basic or Key Pair authentication, depending on how the connection is configured.
- Retrieves the data defined by the SQL Query Expression or Source Object.
Workday ReportSelect an existing Workday custom report.Workday displays reports that meet the eligibility requirements for importing into tables. See Concept: Creating Reports to Import into Tables and Datasets.In thePromptssection, select how to specify the values for prompts defined in the report:- Specify Value. Select 1 or more values from the list.
- Determine Value at Runtime. Select an option from the list that Workday uses to determine the prompt value based on some context, such as the current date or current user.
You can selectReset from Reportto update all prompts and prompt settings with those defined in the report definition. You can use this button when there's a change in the custom report prompt settings that needs to be reflected in the data change task. If you previously changed a prompt value in the data change task, you need to change it again.Workday displays most dependent prompts. Workday does not display prompts dependent on other prompts using Time field data. - On theSource Optionsstep, define how to parse the data in the files you uploaded for file upload or SFTP sources.
- Review the fields Workday created based on the parsed file, and modify the fields if necessary.Select a field in the list and view the field details in the inspector panel on the right side. You might need to:
- Change theField Typewhen Workday assigns the wrong field type. Workday assigns the field type based on the first few rows only. Example: Workday assigns the Numeric field type to a field with ZIP code data because the example rows that it evaluates only contain numerals. However, based on your knowledge of the source data, you know that some ZIP code values contain letters or a hyphen, so you change the field type to Text.
- Change other field attributes based on the field type to ensure that Workday correctly parses the data, such as Digits Before, Digits After, or Date Format.
- On theTargetstep, select the target table that contains the data you want to change.(Optional) You can also create a table using the schema defined in theSourcestep, by clicking theCreate Table from Source Schemabutton (Security:Prism Datasets: Createdomain).Workday defines the table schema using the source schema. You can also:
- Select a field as an External ID.
- Select any required fields.
For more information on creating tables, see Steps: Create a Table Manually. - Select the target operation to perform on the target table using the source data.
Option Description InsertWorkday keeps the existing data in the table and adds the new data in the source. This operation is also known as Append.Truncate and InsertWorkday deletes the existing data in the table and replaces it with the data in the source. This operation is also known as Replace.DeleteWorkday deletes a row from the table when it matches a row in the source.UpdateWorkday updates a row in the table when it matches a row in the source.To select this operation, you must use a table where you configured 1 field as the external ID.UpsertWorkday updates a row in the table when a matching row already exists and inserts the row when it doesn’t exist.To select this operation, you must use a table where you configured 1 field as the external ID. - On theMappingstep, select a field in the target table to use as the operation key for delete, update, or upsert operations.You can specify 1 of these target table fields:
- The field configured as the external ID in the table: You can use this field for delete, update, or upsert operations.
- WPA_LoadID: You can use this field for delete or update operations only.
- WPA_RowID: You can use this field for delete or update operations only.
- Select a source field for each target field that you want to modify. Workday requires that you map any field used as the operation key.Workday lists the source fields that are compatible for a specific target field. If Workday doesn't list a source field you want, verify the source field attributes, such as the digits before, digits after, or business object. You can navigate to theSource Optionsstep to change the field attributes for file upload and SFTP sources.You can clickReset Matchesto revert all mappings you changed to the simple match algorithm that Workday uses by default. The simple match algorithm:
- Is case insensitive.
- Ignores spaces.
- Ignores underscore characters.
- Matches on the field API name.
- Won't match fields with different field types.
- On theReviewstep, verify the information. You can go back to any previous step and make any correction if necessary.
- ClickFinishand selectRun Without Saving,Save and Run Now, orSave.
When you save the data change task, Workday creates the data change task object and displays it on the
Data Change Tasks
tab of the Data Catalog
report.When you run the data change task, Workday starts a data change activity to change the data in the table based on the data in the source. You can view the data change activity progress and history on:
- TheActivitiestab of theView Table Detailsreport. To fix errors on a table following a data change, download the error file from the data change activity. Workday only creates an error file for data change activities that use a file upload as the source.
- TheData Change Activitiestab of theData Catalogreport.
- ThePrism Management Consolereport. You can view an active dashboard of all Prism-related activities for the last 180 days. For more information, see Concept: Prism Management Console.
- ThePrism Activities Monitorreport. You can view a detailed list of all types of Prism-related activities for a given date range.
To fix errors on a table following a data change, download the error file from the data change activity on the
Activities
tab of the View Table Details
report. Workday only creates an error file for data change activities that use file upload or SFTP sources.