Improve Spark pool utilization with Synapse Genie
Synapse Genie Framework improves Spark pool utilization by executing multiple Synapse notebooks on the same Spark pool instance. It considers the sequence and dependencies between notebook activities in an ETL pipeline which results in higher usage of a full cluster for resources available in a Spark pool.
Create DNS alias for dedicated SQL pool in Synapse workspace for disaster recovery
This blog will walk through the details on how to enable custom DNS (Domain Name System) entries on an Azure Synapse dedicated pool inside an Azure Synapse workspace in case of disaster recovery.
Synapse Connectivity Series Part #2 – Inbound Synapse Private Endpoints
This blog article will feature Synapse Private Endpoint. The foundation of this article was based on a previous post – Azure SQL DB Private Link / Private Endpoint – Connectivity Troubleshooting) which I will go more in depth with Synapse specific features.
Synapse – Creating a serverless Data Warehouse
Would you be interested in creating an end-to-end solution of serverless modern data warehouse data processing?
Monitoring Synapse serverless SQL pool query history
This article will walk you through the different ways of how to monitor serverless SQL requests. By reviewing this article, you will understand what to see, compare and how to troubleshoot the query execution behavior. At the end of this article, I will also share how to create a solution to retain historical data from SQL requests forever.
Structured streaming in Synapse Spark
In this post we are going to look at an example of streaming IoT temperature data in Synapse Spark. I have an IoT device that will stream temperature data from two sensors to IoT hub. We’ll use Synapse Spark to process the data, and finally write the output to persistent storage.
How to read Data Lake with Synapse Serverless – Part 1
There are two ways to read data inside Data Lake using the Synapse Serverless engine. In this article, we’ll look at the first method which uses OPENROWSET to query a path within the lake.
How to read Data Lake with Synapse Serverless – Part 2
There are two ways to read data inside Data Lake using the Synapse Serverless engine. In this article, we’ll look at the second method which uses an external table to query a path within the lake.
For more information, view the blog here: January 2023 | Microsoft Azure Synapse Analytics Blog | Microsoft Azure Synapse
Contact us today for a more in-depth conversation around Azure Synapse.