Azure Databricks Overview workshop

I haven’t written about Databricks for quite a while (since April 2018 actually) but I had the pleasure to lead an Azure Databricks workshop with a local customer recently.

For that I prepared quite a few demos now available on GitHub.

I covered quite a few angles so I thought it would...

My ultimate ingestion process for historical data at scale with Kusto

In my last article, we discussed different architecture aspects of large historical data ingestion.

In this article, I want to be more prescriptive and share an approach that works well for me.

Is that the ultimate process? Of course not, that is clickbait. As we discussed at length in the previous article, different...

Ingesting historical data at scale with Kusto

There are many ways to ingest data in Kusto.

There is batching vs streaming, queued vs command, plugins, SDK, etc. . There is also a plethora of tools / techniques to achieve this, e.g. Azure Data Factory, LightIngest, .ingest into, etc. .

In this article I want to look...

Starting / Stopping Kusto cluster with Logic App

In past articles, we looked at how to archive Azure Monitor data using Kusto (ADX) & how to automate that process using Azure Logic Apps.

If the sole purpose of that specific Kusto Cluster is to archive Azure Monitor Data (as it is in my case for my blog), there is no...

Automating archiving Azure Monitor Data with Kusto

In our last article, we laid down a method on how to archive Azure Monitor Data using Kusto (Azure Data Explorer). This allows us to later analyse that data on a much longer period than the Azure Monitor retention period.

In this article, we will automate that archiving...