Azure Databricks - Transforming Data Frames in Spark

In previous weeks, we’ve looked at Azure Databricks, Azure’s managed Spark cluster service.

We then looked at Resilient Distributed Datasets (RDDs) & Spark SQL / Data Frames.

We wanted to look at some more Data Frames, with a bigger data set, more precisely some...

Azure Databricks - Spark SQL - Data Frames

We looked at Azure Databricks a few weeks ago.

Azure Databricks is a managed Apache Spark Cluster service.

More recently we looked at how to analyze a data set using Resilient Distributed Dataset (RDD).  We used the Social characteristics of the Marvel Universe public dataset,...

Solution SLAs in Azure

Let’s talk about Service Level Agreement (SLA) of your solution in Azure.

Hal Berenson wrote a great article about SLA lately.  It is a great conceptual background for the present today.

Here we want to focus on how you should proceed to come up with an SLA for...

Azure Databricks - RDD - Resilient Distributed Dataset

We looked at Azure Databricks a few weeks ago.  Azure Databricks is a managed Apache Spark Cluster service.

In this article, we are going to look at & use a fundamental building block of Apache Spark:  Resilient Distributed Dataset or RDD.  We are going to use the...

Finding a VM Image Reference, Publisher & SKU

Automation is great.

I love to script solutions in Azure.

But most of the time, that automation started with me fumbling and trialing different approaches in the portal.  Once I got something around what I wanted I’ll automate.

I suspect you do the same thing.

This is why today we’re going...