Azure Data Factory -Delete files from ADLS Gen2 based on Last modified date (delete more than 7 days ) using ADF
In this we are deleting files from Azure Data Factory based on the last modified date (as per requirement) , using this we can perform clean up for unwanted or stale data.
Azure Data Factory - Create a Customer Managed Key and encrypt ADF using that CMK
By default, data is encrypted with a Microsoft-managed key that is uniquely assigned to your data factory. For extra security , you can use customer-managed keys feature in Azure Data Factory.
When you specify a customer-managed key, Data Factory uses both the factory system key and the CMK to encrypt customer data. Missing either would result in Deny of Access to data and factory.
Azure Data Factory - Send an alert email when a blob is created or deleted from ADLS Gen2 using ADF
Notifying about the alerts is an important part in ADF, we can achieve that by following the steps in the video. Here we are getting email alerts to GMAIL whenever a file is removed and created in our Storage account.
Refer the below video to get custom alert email when pipeline failed : https://youtu.be/KorFyv5FntY
An Azure Data Engineer and having vast experience on Azure Data Engineering Services and building ETL Pipelines.
With passion on learning Cloud Technologies with hands-on learning and Certified with
- Microsoft Azure Data Engineer (DP-203)
- Microsoft Certified Power BI Data Analyst (PL-300)
- Microsoft Certified Azure Administrator (AZ-104)
- Data bricks Certified Lakehouse Fundamentals
- AWS Certified Solutions Architect - Associate
- AWS Certified Cloud Practitioner
- Microsoft Certified Azure Fundamentals (AZ-900)
- Microsoft Certified Azure Data Fundamentals (DP-900)
- Microsoft Certified Azure Security, Compliance, and Identity Fundamentals (SC-900)
"Evolve ourselves along with the trending technology by learning and enhance the skill set to master it"
