Azure Data Engineering Course

• What are the different cloud concepts?
• Types of Clouds(Public, Private, Hybrid)
• What is Azure?
• IaaS, PaaS, SaaS
• What is Regions and Region Pairs
• What is Resource Groups & Subscriptions
• What is Role-Based Access Control (RBAC)

Hands On :
• Setting up free account for Azure
• Functionaality and usage of the Azure Portal, Azure PowerShell, Azure CLI

• Azure Policy
• Role based Access Control (RBAC)
• Creating and managing Azure Resource Manager (ARM)
• Azure Powershell
• CLI
• Active Directory
• What isresource locks & functionality and usage of tags
• Herarchy ofservice 

Hands On :
• Create Resource group
• Apply Tags or locks
• ARM
• Overview of the services
• Azure Services provisioning with portal or ARM

Doubt Clearing, Revision of AZ-900 and Assessment

• Different types ofstorage
• Access Tiers & Redundancy
• Difference between Blob storage & Datalake
• Implementation of Datalake storage gen 2
• Different authentication & security option
• Understand Life cycle management
• Working with Azure Storage Containers
• Serving layer
• Soft delete

Hands On :
• Deploying Azure Storage
• Apply ACL & Lifecycle managements
• Implement File partitioning
• Maintain differentserving layer on ADLS forstoring data from multiple sources

• Different types of azure sql & understand the use cases
• Differentservice tiersfor sql
• Understand dynamic data masking
• Row levelsecurity
• Encryption & threat protection

Hands On :
• Deploy Azure SQL
• Enable AD Authentication
• Implement Dynamic Data Masking & Row level Security

• Azure Data Factory Architecture
• Linked Service, Dataset & Activities
• Pipeline Executions & Scheduling
• Pipeline Trigger Schedules, Modifications
• Debugging: ADF Managed Executions
• Dataflow debug session
• Cluster allocation for dataflowdebug

Hands On :
• Deploy ADF With key components
• Setting up source & sink for ADF
• Build pipeline for data ingestion

Understand different types of IR
• Setup self hosted IR
• Onboard data from on-prem to azure with Selfhosted
• Handling different files format
• Work within multiple serving layer
• Table_Schema for Column Mapping
• Writing Expressions For Dynamic Loads
• Transformation Editor and Parameters

Hands On :
• Onboard data from on-prem to azure
• Dynamic data load

Rerun adf pipelines
• Error handling in ADF
• Incremental Loads
• Incremental Load Pipeline Design in ADF
• Stored Procedures, Loops in ADF Pipelines
• Configure ETL Sources, Pre-Copy Scripts

Hands On :
• Incremental Data load
• Email configuration with ADF

• Introduction to Azure Databricks
• Working with various note books like python,scala,spark etc.
• Read and write data in Azure Databricks
• Data processing in Azure Databricks
• Work with DataFramesin Azure Databricks
• Platform architecture,security, and data protection in Azure Databricks

Hands On :
• Read and write data in Azure Databricks
• Data processing in Azure Databricks
• Work with DataFramesin Azure Databricks

Azure Databricks Configuration with Datalake
• Datalake mounting
• Proccess data
• Understand dataframes
• Understand function in databrick
• Handle data transformation scenerio with ADB
• Work with duplicate data
• Handle different time format with ADB
• Work with schema in adb

Hands On :
• Write code for converting csv filesrecord into JSON
• Work with different functionsin ADB

• RBAC, ACCESS TOKEN, Managed identity, keyvault, service principle

Hands On :
• Use keyvaultsecret for handling credentials
• Design pipeline while storing the credentialsin Keyvault

• Log analytics&azure monitor, application insight

Hands On :
• Configure log analytics& azure monitor for auditing

• Microsft recommendation , best practices, recap & QnA
Hands On :
• Best Practices