Architecture

1. Data Source: HTTP (GitHub)
2. Data Ingestion: Azure Data Factory
3. Raw Data Store: Azure Data Lake Gen 2 (Bronze Layer)
4. Transformed Data Store: Azure Data Lake Gen 2 (Databricks) (Silver Layer)
5. Serving Layer: Azure Synapse Analytics (Gold Layer)
6. Reporting: Power BI
7. Security: Azure Entra ID, Azure Certificates, and Secrets
8. File Format: CSV, Parquet

Dataset

It contains 10 tables:

• AdventureWorks_Calendar.csv
• AdventureWorks_Customers.csv
• AdventureWorks_Product_Categories.csv
• AdventureWorks_Product_Subcategories.csv
• AdventureWorks_Products.csv
• AdventureWorks_Returns.csv
• AdventureWorks_Sales_2015.csv
• AdventureWorks_Sales_2016.csv