// Learn Synapse Data Explorer

Kusto/adx Data Explorer Kusto 2 min.

featured image Learn Synapse Data Explorer Do you want to learn Synapse Data Explorer and do you want to read only one book about it? Then you should read the book by Pericles (Peri) Rocha (Li) - Learn Synapse Data Explorer. The writer Peri Rocha is a Senior Product Manager for Azure Synapse Analytics from Microsoft. He shows a great knowledge in the book around Synapse Data Explorer and the way of working with KQL in the services. [...]

// T-SQL Tuesday 159

SQL server t-sql 3 min.

featured image T-SQL Tuesday 159 This months T-SQL Tuesday is number 159 and is hosted by Deepthi Goguri - you can read the original invitation here or by clicking the image below. The topic of this month is two fold: Favorite feature from SQL Server 2022 or SQL server in Azure What is my new year resolution and how to keep the discipline My favorite new feature in SQL server. This must be the new Optimized Locking feature released to Azure SQL Database. [...]

// Azure Services vs. Roles in Data

Datacorner Roles in data 4 min.

featured image Azure Services vs. Roles in Data Have you ever been overwelmed by all the different services in Azure and so confused that you don’t know what to choose and how to get started? Here is an approach for demystifying all the data servicesm, where I try to guide you through the jungle and keep things simple. The approach is based on roles in the team of data professionals: The Data Engineer The Data Scientist The IoT Engineer The Power BI developer The Data Engineer The Data Engineer is a must have in every data organisation and is the one who moves data from sources in the business to the data storage for further work. [...]

// Stream your Kusto data to Data Lake

Kusto/adx Data Lake Kusto 3 min.

featured image Stream your Kusto data to Data Lake When working with Azure Data Explorer (ADX or Synapse Data Explorer (SDX)) the data is often streamed to the Kusto engine to be available almost instantly to the end user or application accessing the Kusto engine. This is really the power of the Kusto engine - but it would also be really good to have the data off loaded to a blob storage as Parqute files for other processes (ex. [...]

// T-SQL Tuesday 158

SQL server t-sql 2 min.

featured image T-SQL Tuesday 158 This months T-SQL Tuesday is number 158 (wow, tempo fugit) and are hosted by Raul Gonzalez - you can read the original invitation here or by clicking the image below. The topic of this month is if there exists a “worst practice” that actually has some use case in the real world. Interesting topic indeed - and I’ll have the following to bring to the table. Cursors for bulk loading data 😱 Now this should get some of you up from the chair. [...]

// Call REST API Directly From SQL Server

SQL server T-SQL 4 min.

featured image Call REST API Directly From SQL Server When I attended the PASS Summit in Seattle in November 2022, we got a list of new releases from Microsoft. Among those releases we got the ability to call an external REST API directly from the SQL server in Azure. The feature is, at this post is written, in public preview, so you might see or experience some minor problems. The approach The SQL server in Azure (all versions in Azure - besides the one on a VM) has now gotten a new stored procedure named: [...]

// Learn Kusto - Week 3

Kusto/ADX Azure Data Explorer 4 min.

featured image Learn Kusto - Week 3 Hello - and welcme back to this series of posts around Kusto and learning the language. In this post I’ll guide you through the methods of doing joins and what to be aware of when designing your queries using joins. In Kusto the join method is a bit more complex than compared to T-SQL. But don’t worry - with this guide you’ll know how to use the features. Join types As with other data query languages, we can do joins to join two or more tables together for a selection of data across those tables. [...]

// Learn Kusto - Week 2

Kusto/ADX Azure Data Explorer 4 min.

featured image Learn Kusto - Week 2 Last week I tried to lay the foundation to understand the engine that supports and drives the Kusto language and the Azure Data Explorer. We learned that the engine is using Shards as a primary storage method and how the engine handles the queries and executes them. This week we’ll start at the beginning of the Kusto language and do some basic data discovery. The setup and demo data For you to be able to follow along, you have to set up your own Kusto demo environment. [...]

// Learn Kusto - Week 1

Kusto/ADX Azure Data Explorer 2 min.

featured image Learn Kusto - Week 1 Hello, and welcome to the first issue of Learn Kusto. In this serie of blogpost I’ll guide you from zero to hero on using the Kusto query language and in the same time you’ll learn how to implement and use the methods to do live reporting on timeseries data. In this first edition I’ll start with the engine and the setup from Microsofts implementation with Azure Data Explorer and the Kusto query engine. [...]

// Timeout Script in ADF

Synapse Data Factory 1 min.

featured image Timeout Script in ADF I’ve stumbled upon a brand new feature in Azure Data Factory. The new timeout setting under advanced when you implement a custom script task in your pipeline. The UI As with all other things from Data Factory, the UI is pretty straight forward. Under the advanced tab in your script task, you now the option to set the timeout for the execution of this specific script. The information modal when you hover the (i) is: [...]