Set Up Zero-Copy Data In with Google Cloud
Prerequisites
- Configure Google Cloud BigLake for zero-copy access to an Iceberg REST catalog.
- Take note of the GCS Warehouse Name and Project ID from your Google Cloud configuration.
Task 1: Configure Google Cloud Workload Identity Federation
Before creating the zero-copy connection in Workday, you need to configure Google Cloud Workload Identity Federation so that the external identity can impersonate the Google Cloud service account used to access BigLake.
- In the Google Cloud console, create a Workload Identity Pool. Use a descriptive name, such as Prism BigLake pool.
- Add a provider to the pool.
- Select OIDC as the provider type.Don't select SAML or AWS.
- Enter the issuer URL for the identity provider.
- Configure the audience for the provider.
- Create or identify the Google Cloud service account that will access the BigLake catalog.
- Take note of the service account email address. You'll enter it as thePrincipalwhen you create the connection in Task 2.
- Grant the service account the required read access to the catalog and underlying data.
- Link the service account to the Workload Identity Pool provider by selectingGrant Accessand configuring the required principal and attribute conditions.
- Download the client library config file associated with the service account with access to the Workload Identity Pool to obtain the connection values.
- Select the Workload Identity Pool and go to theConnection Service Accountstab.
- Download theClient library configassociated with the service account.
- Select the identity provider.
- Enter an OIDC ID token path. Example: /tmp/oidc-token.
- Select JSON as the format type.
- Download the configuration file.
- Record theaudienceandtoken_urlvalues exactly as they appear in the downloaded configuration file. You’ll need these values when you create the connection in Workday.
Task 2: Create a Zero-Copy Connection to Google Cloud
You can access Google Cloud table metadata without copying data by creating a zero-copy connection from Workday to your Google Cloud Iceberg catalog.
- In Workday, access the Prism Data Catalog report.
- Select+ Create>Connection.
- In theCreate Connectionwizard, underZero Copy Connectors, select theGoogle Cloudtile.
- Enter the connection details:FieldDescriptionNameThe connection name must be unique in the Data Catalog.Example:GoogleCloud_ZeroCopy_<first name><last initial>.Description(Optional) A brief description of the connection's purpose.Catalog URLThe Google Cloud BigLake Iceberg REST catalog URL.In the Lakehouse Runtime Catalog, select the catalog that you created and copy the REST catalog URL property value exactly from the Catalog Detail page.Example:https://biglake.googleapis.com/iceberg/v1/restcatalogCatalog NameThe GCS Warehouse Name configured for the BigLake catalog.In the Lakehouse Runtime Catalog, select the catalog that you created and copy the GCS warehouse property value exactly from the Catalog Detail page.Example:gs://some-warehouseUse SandboxSelect this option only when connecting to the applicable sandbox environment.Project IDThe Google Cloud project ID that hosts the catalog.In the Lakehouse Runtime Catalog, select the catalog that you created and copy the project property value exactly from the Catalog Detail page.Authentication TypeSelectOAuth 2.0 with Token Exchange.IssuerThe issuer URL configured on the OIDC Workload Identity Pool provider. The value must match the provider configuration exactly.PrincipalThe Google Cloud service account principal used by the connection.Example: biglake-client@gcp-eng.iam.gserviceaccount.comToken EndpointThetoken_urlvalue from the downloaded client library config file downloaded for the above service account in task 1.ScopesEnterhttps://www.googleapis.com/auth/cloud-platform.This is the standard cloud-platform scope used for service account impersonation.AudienceTheaudiencevalue from the downloaded client library config file downloaded for the above service account in task 1.
- Save the connection but do not test it yet. Before you test the connection, complete the following steps.
- On theView Connection Detailspage that displays, selectCertificate>Download>JWK.
- Update the Google Cloud workload identity provider with the JWK Certificate.
- In the Google Cloud console, edit the Workload Identity Pool provider you created in task 1.View JWK Fileshows all the existing JWK keys associated with the identity provider.
- Upload a new file containing all the existing keys you want to preserve and the new JWK key downloaded from the configured connection in Workday.
- Save your changes.In Workday, you can now test your connection and validate that it is successful.
- In Workday, on theView Connection Detailspage, selectTest Connection.If the test fails, verify:
- Catalog URL format.
- Token endpoint URL.
- Google Cloud project ID and service account principal values.
- Workload Identity Pool provider audience value.
- JWK certificate and Workload Identity configuration in Google Cloud.
- Service account permissions for the catalog and underlying data.
Task 3: Create an External Catalog
An external catalog acts as a virtual window into your external data, allowing you to browse tables in real-time.
- Access theData Catalogreport.
- Select+ Create>External Catalog.
- Enter the external catalog details:FieldDescriptionExternal Catalog NameEnter a name for your external catalog.ConnectionSelect the connection you just created.NamespaceThe exact namespace where the Iceberg connector tables reside. This information is provided by Google Cloud.Example:enterprise.finance.procurement.Description(Optional) The description of the external catalog.
- ClickSave.
- Wait for theSuccessnotification that the External Catalog was created.
- SelectBack to Data Catalog.
- SelectExternal Catalog, and validate that schema sync is successful on your External Catalog.
After you save the External Catalog, Workday automatically runs a
Schema Sync
to:- Read the metadata of Iceberg tables in the specified Google Cloud namespace.
- Register those tables asExternal Tablesin Workday.
- Make table structures visible in the Data Catalogwithout moving or copying data.
The duration of this sync depends on the number and complexity of tables in the namespace.
Task 4: Explore and Validate External Tables
Explore the external tables registered from Google Cloud and perform basic schema validation inside Workday.
- Locate the Google Cloud external tables.
- Access theData Catalogreport.
- In the left-hand menu, selectExternal Tables.
- Click on theRefreshbutton.
- In theExternal Tablesview, confirm that all Iceberg tables from Google Cloud are listed under the schema/namespace you selected during external catalog creation.
- Inspect an external table.
- Right-click or double-click the table name to openView External Table Details.
- On the details page, review:
- Column names
- Data types
- Any available column statistics
- Sample data preview (if present)
- Verify that:
- Data types (Example: Numeric vs. string) align with the definitions in the external system.
- Values appear as expected.