Add Tables and Columns to Data Lake
See the Data Lake Setup in Workday section of Get Started with Workday Data Lake. This topic is part of a larger procedure.
Security:
Data Cloud: Manage Data Lake Application Configurations
domain in the Data Cloud functional area.Workday Data Lake uses an opt-in model: nothing from the Data Cloud Catalog is materialized until you configure it. Discovery (what's available in the catalog) is separate from materialization (what is stored in the lake and refreshed on a schedule). See Data Cloud Catalog for information about available tables and columns, core vs reference tables, and table associations via foreign keys.
Configuration happens in three stages:
- Table selection:Choose which core tables to register for Data Lake. This syncs table metadata into the lake environment; underlying records are not materialized until you select columns.
- Column selection:Choose which columns to include from each table. Only selected columns are materialized for zero-copy access. ID columns are included by default; other columns are excluded until you opt in. When you include multi-instance (array) columns, you can opt in related reference tables from theOpt-In Reference Tablesgrid.
- Frequency configuration:Set a refresh frequency for how often materialized data is updated.
New tables and columns added to the Data Cloud Catalog in future releases are not automatically added to your data lake. You must explicitly include them if you want them materialized.
- Add tables to your data lake.You can only select core tables at this step. Reference tables and core tables with foreign key associations can be added in step 2. SeeData Cloud Catalog for information on core tables, reference tables, and foreign keys.
- Access theData Lake Admin Consolereport.
- On theApplicationstab, selectEditfrom the actions menu of theWorkday Coreapplication.
- On theEdit Core Workday Catalog for Data Laketask that displays, select core tables that you want to add to your data lake from theTables for Data Lake Materializationprompt.
- ClickAdd.
- ClickOK.
- Select the columns to include from the tables selected in step 1.Aside from ID columns, all columns are excluded by default when you add a table.
- SelectManage Fieldsfor the table you added.
- On theManage Fields for Data Lake Materializationpage that displays, select theIncludecheck box for your desired fields.
- ClickOK.
- When you include multi-instance fields, anOpt-In Reference Tablesgrid appears. Select theIncludecheck box to add the desired tables/columns to your data lake.
- After adding your desired tables and columns, set a refresh frequency for your Data Lake data.
- On theView Core Workday Catalog for Data Lakepage, clickEdit.
- Select theScheduletab.
- Select aRun Frequency.The available options depend on your Data Cloud subscription and the type of tenant you’re working in:Data Cloud SubscriptionTenant TypeHighest Supported FrequencyPROProductionHourly refresh.COREProductionDaily refresh.PROCORESandboxSandbox PreviewImplementationWeekly refresh.
- Configure the recurrence criteria.
You can view the results of your configuration in the
Applications
tab of the Data Lake Admin Console
.