---
title: Data Ingestion
slug: rbc-hands-on/data-ingestion
createdAt: 2023-10-26T20:21:41.456Z
---

:::Iframe{iframeHeight="0" code="<iframe id=&#x22;DataIngestion&#x22;&#xA;  src=&#x22;https://adbecdn.blob.core.windows.net/demos/Data%20Foundation/data-ingestion-walkthrough.html&#x22;&#xA;  style=&#x22;width:100%;border:0;display:block&#x22; height=&#x22;800&#x22; scrolling=&#x22;no&#x22;&#xA;  title=&#x22;ingestion walkthrough&#x22;></iframe>"}

:::

# Ingesting Data From Snowflake

![](https://api.archbee.com/api/optimize/1Jp0iolWv35Z_mkI7oUiT/PwDB9uOFVUVCFBQRpSy50_screenshot-2026-10-21-at-23351-pm.png)

## Sources

1. Navigate to the **Sources** from the Connections in the navigation panel.
2. On the **catalog**, search for **snowflake**.
3. Click **Add Data&#x20;**&#x62;utton.

## Accounts

1. Select the **RBC\_DEMO&#x20;**&#x61;ccount and click **Next.**
2. Search for your "Lab User Number" table. Type: **LAB\_U##** in the search box
3. Select the Table
4. Click Next

![](https://api.archbee.com/api/optimize/1Jp0iolWv35Z_mkI7oUiT/_LXxkGqorOvDYDVCn0M1J_screenshot-2026-10-21-at-23812-pm.png)

## Dataflow Detail

1. &#x20;Select the **Existing Dataset** option
2. &#x20;Search and select your dataset by name from the dropdown
3. &#x20;Enable **Partial Ingestion**. Set threshold to the default 5%
4. Click **Next**

::Image[]{src="https://api.archbee.com/api/optimize/1Jp0iolWv35Z_mkI7oUiT/vzQDXD3ND3iZ_DNGz3ukm_2024-06-17-09-46-15.png" size="60" width="2926" height="1716" position="center" darkWidth="2926" darkHeight="1716" showCaption="false"}

## Mapping source columns to XDM schema fields

You might get a lot of errors. This is intentional. This is a mapping exercise. We are required to map the source table columns to the XDM schema fields we defined. There are other faster alternatives than manually doing this, so we will explore that now.

### Import Mapping

1. Click on the **Import Mapping** button
2. Select **Import mapping from flow**
3. Select the dataflow name: **Dataflow - LAB\_U25\_PROFILES**
4. Click **Select**

![](https://api.archbee.com/api/optimize/1Jp0iolWv35Z_mkI7oUiT/LK7XZHTtYIBPQRM9z13VL_screenshot-2026-10-21-at-31049-pm.png)

## Scheduling

- **Frequency: Once**
- Click **Next**
- Click **Finish**

![](https://api.archbee.com/api/optimize/1Jp0iolWv35Z_mkI7oUiT/fCtr0ErS_JAPDFHH7hcYT_screenshot-2026-10-21-at-31247-pm.png)

## Monitoring Dataflows

1. Navigate to **Datasets**
2. Search and select your newly created dataset (By Initials)

::Image[]{src="https://adbecdn.azureedge.net/labs/archbee/toyotaaephandsonlabs/ScreenShot2023-09-16at12.05.46PM.png" size="40" isUploading="false" width="1588" height="1200" darkWidth="1588" darkHeight="1200" showCaption="false"}

- Notice a batch is created as a result of the ingestion workflow that was triggered

::Image[]{src="https://adbecdn.azureedge.net/labs/archbee/toyotaaephandsonlabs/ScreenShot2023-09-16at12.08.22PM.png" size="50" isUploading="false" width="2172" height="1208" darkWidth="2172" darkHeight="1208" showCaption="false"}

1. Once the status for the batch says **"Success"**, click on the **Preview Dataset** button on the top right of your screen. This allows for validation of source columns to XDM schemas with the corresponding values.

