Description
In this course, you will learn :
- How to use Azure Databricks and Spark Core to create a real-world data project.
- How to transform and analyse data in Azure Databricks using Spark SQL.
- Discover how to build Azure Data Factory pipelines to run Databricks notebooks.
- Professional level data engineering skills in Azure Databricks, Delta Lake, Spark Core, Azure Data Lake Gen2 and Azure Data Factory (ADF) will be acquired.
Syllabus:
Module-1 Azure Databricks
- Understanding Azure Databricks
- Spark Basics
- Azure databricks workspace
- Running notebooks with spark transformation
- Accessing BLOB data in ADB notebooks
- 6 Integrating ADF with ADB notebooks using job clusters