Back to projects
Azure Databricks Analyst Bootcamp
A hands-on Azure Databricks bootcamp that takes analysts from raw files in Azure Blob Storage to Delta tables and Power BI reports.
What It Covers
- Medallion architecture with bronze, silver, and gold layers
- Provisioning ADLS Gen2, an Access Connector, Unity Catalog, and Azure Data Factory with Terraform
- Orchestrating Databricks notebooks through Azure Data Factory pipelines
- Building dimension and fact tables with PySpark and Delta Lake
- Loading Parquet output into Power BI for business reporting
- Two worked examples: WHO suicide-rate analytics and a sales reporting pipeline
Architecture
How It Works
The repository ships a Python setup command that provisions Azure infrastructure, configures Unity Catalog storage credentials and schemas, and uploads the course notebooks to the Databricks workspace. Students then create an interactive cluster, an ADF linked service, and a pipeline in the Azure and Databricks interfaces, run the notebooks, and connect the output to Power BI.
Tech Stack
- Azure Databricks, PySpark, Delta Lake, Unity Catalog
- Azure Data Factory, Azure Blob Storage (ADLS Gen2)
- Terraform, Python, uv
- Power BI