Using Azure Durable Functions with Azure Data Factory - HTTP Long Polling (2020-Dec-21 ) While working with Azure Functions that provide a serverless environment to run my computer program code, I’m still struggling to un…
Using Durable Functions in Azure Data Factory - Support for long running processes in Azure Functions (2020-Oct-14 ) Ok, here is my problem: I have an Azure Data Factory (ADF) workflow that includes an Azure Function call to perform external operatio…
Row Numbers in Azure Data Factory Data Flows (2020-Oct-05 ) Adding a row number to your dataset could a trivial task. Both ANSI and Spark SQL have the row_number() window function that can enr…
Custom deployment parameters in Azure Data Factory - Forget Me Not (2020-Sep- 26) Last week one of my Azure Data Factory (ADF) deployment pipelines failed with an error that it couldn’t find some of the deployment p…
Setting default values for Array parameters/variables in Azure Data Factory (2020-Aug-14) Setting default values for my parameters or variables in Azure Data Factory (ADF) may be a trivial task, but it gets more interesting …
Transforming JSON data with the help of Azure Data Factory - Part 5 - Comparing it with Databricks (2020-July-29 ) There is a well known and broadly advertised message from Microsoft that Azure Data Factory (ADF) is a code-free environment to he…
Send a Database Query Result as Email via Logic App in HTML format using Azure Data Factory (2020-June- 07) It is a very simple concept, you have a database query result, either a direct database table output or a stored procedure returne…
Transforming JSON data with the help of Azure Data Factory - Part 4 - Passing Arrays around (2020-May- 24) It has never been my plan to write a series of articles about how I can work with JSON files in Azure Data Factory (ADF). While worki…