Configure Snowflake as a Source

Overview

This article outlines the process of configuring Snowflake as a data source in DvSum, enabling integration for data cataloging and profiling. The steps provided apply to both DvSum Data Insights (DI) and DvSum Data Quality (DQ), with only minor variations based on the specific platform.

Adding Snowflake source in DvSum:

Prerequisite: Enabling Query History for Snowflake
Before configuring Snowflake as a source, ensure that query history is enabled for your Snowflake account. This is crucial for tracking data lineage and gaining insights into usage patterns. For more information, refer to the Enabling Query History for Data Sources article.

You can follow the steps mentioned below to configure and authenticate a Snowflake source:

Steps to Configure Snowflake as a Source 

Step 1: Add Snowflake as a Source 

1. Navigate to the Data Sources tab. 
2. Click the Add Source button. 
3. In the modal that appears:  
4. Select Snowflake as the data source. 
5. Provide a meaningful Source Name. 
6. Click Save. 

Step 2: Configure Connection Settings 

1. After saving, you will be redirected to the Connection Settings page. 
2. Enable the checkbox for On-premise Web Service (if applicable). 
3. Select the SAWS (Secure Agent Web Service) that is set up and currently running. 
4. Enter the required connection details:  

• • • URL 
    • Warehouse 
    • Database Login 
    • Password 
    • Click Authenticate to validate the connection. 

Note: By Default the SAWS type will be cloud. For more information regarding Cloud SAWS, click here

Step 3: Select Database & Schema 

1. Once authenticated, the Database Selection section appears. 
2. Choose the database you need to scan (only one database can be selected).
3. Choose one of the following options:  

• • • Scan all schemas (leave the schema checkbox unchecked). 
    • Scan specific schemas (check the schema checkbox and select schemas from the list). 

Once it is checked then the list of available schemas will be displayed. User can select single or multiple schemas from the Available Schemas list and move them to the Selected Schemas tab on the right. 

Step 4: Save the Source Configuration 

1. Scroll to the top of the page. 
2. Click the Done button in the top-right corner. 
3. Click Save to complete the setup. 

Step 5: Run a Scan 

1. Navigate to the Scan History page. 
2. Click the Scan Now button. 
3. A job will be created, and once the status shows Completed, the scan will be successful. 

After the scan completion, click on Scan Name and it will open the Scan Summary page of this scan.

On the Scan Summary page, it will show all the insights of the scan i.e how many new tables and columns are fetched in this scan from the schemas we selected earlier.

Review Data Dictionary 

• Navigate to the Data Dictionary tab from the sidebar. 
• Click on the Recently Refreshed tab. 
• This tab displays all tables fetched in the most recent scan. 
• Click on the table name to access more detailed metadata and structure information. 

By following these steps, you can successfully integrate Snowflake as a source in DvSum, enabling advanced data profiling and cataloging capabilities. 

Watch this quick video tutorial of how to add and configure an Snowflake source into DvSum app.