Skip to main content
Workday User Guide
Last Updated: 2023-12-15
Select an Amazon S3 Connection in a Data Change Task

Select an Amazon S3 Connection in a Data Change Task

When you use an Amazon S3 connection in a data change task, you define:
  • The objects to read when the data change task runs.
  • The source schema so Workday knows how to read each object.
You define this information using these options on the
Source
step of the data change task:
  • Object Pattern
    . Specify an object pattern that defines the objects to read for each data change activity. Workday uses this object pattern each time the data change task runs.
  • Source Schema
    . Select 1 object in the bucket that has the same schema as the objects that will be read in each data change activity. Workday uses this object on the
    Source Options
    step of the data change task when you configure how to parse each object. Workday doesn't load the data from this object to the table.
When you run a data change task with an Amazon S3 connection, Workday:
  1. Connects to Amazon using the access key credentials configured in the connection.
  2. Retrieves the objects defined in the data change task
    Object Pattern
    field.
  3. Uses the parsing options defined in the data change task
    Source Options
    step to read the objects retrieved from the S3 bucket.
  1. Navigate to the
    Data Catalog
    .
  2. Select
    Create > Data Change Task
    .
  3. On the
    Source
    step, select the Amazon S3 connection you want to use.
  4. Select
    Amazon S3
    , and select the Amazon S3 connection you want to use.
  5. In the
    Object Pattern
    field, enter the Amazon S3 object pattern that matches every object you want Workday to read when the data change task runs.
    1. The object pattern is case-sensitive.
    2. You can use the asterisk (*) to specify zero or more characters.
    3. You can specify objects in folders in S3 by including the folder path prefix in the object pattern. Example:
      folder1/folder2/logs*.csv.gz
    4. Each object that matches the pattern must use the same schema.
  6. Select
    Source Schema
    .
  7. Enter an object pattern to view a list of objects that you can select from.
    When searching for an object to select as the source schema, Workday only lists matching objects that are 256 MB (uncompressed) or less that use a format supported by Workday.
  8. Select an object and click
    Select
    . Workday reads the schema of the object.
  9. Click
    Next
    .
  10. On the
    Source Options
    step, define how to parse the data in the object you selected. Review the fields Workday created based on the parse file, and modify the fields if necessary.
Finish configuring the data change task as usual.