Steps: Configure Staging Tables and Columns for Spreadsheet Data Sources
- Import your spreadsheet data source.
- Security:
- Integration Operatorpermission.
- Data Designerpermission.
Staging tables display in the tabs in the
Tables to Import
section after you import from data
sources. Staging tables enable you to view the imported data and structure of your
data source. You can confirm and refine the structure before you load the data into
your model. In the staging tables you can:
- Compare the source with the staging table results.
- Use advanced filters to review smaller areas of the structure and data.
- Change the table settings.
- Add and remove staging tables from the import.
- Add and remove columns from the import.
- Sort the data in columns.
- Manage settings of columns. Example: You can change the data type for custom columns.
- Download the data from each staging table.
- Go to .
- From theData Sourcessection, select the spreadsheet data source.
- (Optional) From theSourceprompt, toggle between the 2 options to compare the source with staging table:
Optie Omschrijving StagingView the data in the staging tables.SpreadsheetView the data in the spreadsheet source. - (Optional) From theData Componentssection, drag and drop components into the staging table:
- Join tables and union tables when you expandCustom Table.
- SQL columns and subquery columns when you expandCustom Column.
- (Optional) Click the prompt on a tab of a staging table.As you complete the task, consider:
Optie Omschrijving Manage ColumnsAdd and remove columns from the import.Table Settings- Import Data Mode:
- All records replaced each time a data import is run: Default. Spreadsheet replaces the previous version in the staging area.
- Merge (add, update) received rows using the key columns: Spreadsheet merges with existing data by matching key columns. After selecting this option, you can set theKey Columnsarea.
- All received rows are new and so should be added: Spreadsheet adds to the table, leaving all existing data as-is.
- Sheet Has Header Row: Select to indicate rows that are headers instead of data.
- First Header/Data Row: Enter the row number of the first header row (if there’s a header row) or the first data row.
- Ignore Parsing Errors: Select when you want to ignore cells with errors, such as text appearing in a date column. Cells with errors import as empty. When you don't ignore parsing errors, the import fails if there are errors.You can use the error log to help identify parsing problems.
Key ColumnsSelect the key columns to match for merging spreadsheet data.Exclude table from importRemove the worksheet from the import.Delete TableRemove the entire table.Download DataDownload the data according to the structure in the staging tables. - (Optional) Click the prompt on each column.As you complete the task forColumn Settings, consider:
Optie Omschrijving Column TypeSelect the type of data used in the column.Convert Column TypeConvert the data type of the column. - (Optional) Create Advanced Filters for Staging Tables.Advanced filters enable you to review a subset of your structure as you refine the staging tables.
Create or use a loader.