I’ve stumbled upon an error a few weeks ago when working with a client and trying to read some Parquet files from a new Blob container from the build-in Storage account in an existing Synapse Workspace. If you’ve only worked with CSV untill now, you should also try out the Parquet files - they know how to perform fast when done right - but that’s possibily another blogpost. The database has been setup months ago to read data from “old” Blob containers and things was working out pretty nice.
Do you want to learn Databricks and do you want to read only one book about it? Then you should read the book by Vihag Gupta (Li/Tw) - Business Intelligence with Databricks SQL. The writer Vihag Gupta is Solutions Architect in Data & AI at the Databricks company. He shows a great knowledge in the book around Databricks and the way of working with SQL in the services. With a good match of text, downloadable demos and easy to understand illustrations, Vihag Gupta makes it an easy read.
I recently wrote about an approach to dynamically load CSV files to Power BI through Power Query without the engine to clutter up the UI in Power BI with helper queries. You can read it here. The approach also had some functionallity for getting the first file and traversing the headers automatically. This has now been re-coded to fit a folder from your source containing JSON files. The JSON file structure is somewhat easier to handle, as it is using the Json.
Wow, time goes by! Welcome back to the last and final installment of the SQL Server Performance Tuning series. Today I will talk in more details about database maintenance in SQL Server, especially about index maintenance operations, and how to perform database maintenance. Index Maintenance Database maintenance is a very crucial part for your job as a DBA to make sure that you get the best possible performance out of your database.
In today’s installment of the SQL Server Performance Tuning series we talk about TempDb - the public toilet of SQL Server, as I describe that special database in SQL Server. Everyone of us uses TempDb regularly. Some people use it directly, some people use it indirectly. Today I want to give you an overview of TempDb usage in SQL Server, and I will give you some best practices on how to configure TempDb for better performance.
Hello and welcome back to the 22th week of the SQL Server Performance Tuning series. Last week I have talked about baselining in SQL Server, and today I will continue by talking about Wait Statistics and I/O Latency Statistics in SQL Server. When I perform SQL Server Health Checks, I always use these two metrics to get the big picture about the health of SQL Server. Wait Statistics Every time you execute a query in SQL Server, the query will wait.
Hello and welcome back to the last and final month of the SQL Server Performance Tuning series. Over the last 5 months we have covered various performance related topics about SQL Server, and we have covered specific performance tuning techniques and problems. But what are your options, when you have a SQL Server in front of you that doesn’t perform as expected? To help you with that situation, we will cover performance monitoring techniques today, and next week we will have a more detailed look at the so-called Wait Statistics in SQL Server.
Hello and welcome back to the SQL Server Performance Tuning series. Today we will complete the 5th month by talking about Deadlocking in SQL Server. A deadlock occurs when 2 queries are waiting for each other, and no query can continue its work anymore. In the first step I want to give you an overview how SQL Server handles deadlocks. And finally I will show you some specific deadlock types in SQL Server, and how you can avoid and resolve them.
Hello and welcome back to the SQL Server Performance Tuning seriesn. In the last 2 weeks we have talked about pessimistic and optimistic locking in SQL Server. Today I want to talk about one phenomenon in SQL Server that is specific to locking: so-called Lock Escalations. Before we go into the details of that problem, I want to talk a little bit more about the Lock Hierarchy that SQL Server uses internally.
Hello and welcome back to the SQL Server Performance Tuning series. Last week I have kicked-off the 5th month of the training plan by talking about pessimistic concurrency. Today we will continue by talking about Optimistic Concurrency. Row Versioning Optimistic concurrency was introduced back with SQL Server 2005 and is based on the principle of Row Versioning. The idea behind row versioning is that readers (SELECT queries) don’t acquire shared locks anymore.