Configure Azure SQL or Azure Synapse Analytics

Overview:

This article outlines the process of configuring Azure SQL or Azure Synapse Analytics as a data source in DvSum, enabling integration for data cataloging and profiling. The steps provided apply to both DvSum Data Insights (DI) and DvSum Data Quality (DQ), with only minor variations based on the specific platform.

Prerequisite: Enabling General Query Log for MySQL
Before proceeding, ensure that the general query log is enabled for your Azure server. This is essential for tracking data lineage and obtaining insights into usage patterns. For more information, refer to the Enabling General Query Log for Data Sources article.

You can follow the steps mentioned below to configure and authenticate a Azure SQL or Azure Synapse Analytics source:

Step-by-Step Configuration

Step 1: Adding a Databricks Source in DvSum

1. Navigate to Administration → Data Sources in DvSum. 
2. Click "⊕ Add Source" to open the wizard.
3. Select the appropriate Data Source Type. 
4. Enter a name for the data source. 
5. Click Save. 

2. Configure Source 

1. The Connection tab opens automatically after saving. 
2. Alternatively, navigate to: Administration → Data Sources → Settings → Connection. 
3. Click Edit and configure the connection details:  

• • • Server Name 
    • Database Name 
    • Authentication 
    • Click Authenticate to test the connection. 
    • After authentication, select a database and optionally, specific schemas. 
    • Click Done and Save to complete the process. 

3. Scan Data Source 

1. Navigate to Administration → Data Sources → Scan History. 
2. Click "Scan Now" to perform an initial scan. 
3. The scan will progress from Scheduled → Running → Completed.
4. After completion, click the Scan Name to open the Scan Summary. 
5. Review the scan insights 

4. Review Data Dictionary 

1. Navigate to Data Dictionary in the DvSum menu. 
2. Click on the "Recently Refreshed" tab to find recently scanned tables. 
3. Click on the table name for detailed information. 

Watch this quick video tutorial on how to add and configure an Azure Data Source into DvSum app.

Additional Resources

Read more about DvSum Web Service (Cloud SAWS)

Read more about DvSum Edge Gateway (On-Premises SAWS)