A Big Week for the Data Platform (DBW 2019-11-09)

 Database Weekly for November 9, 2019 Problems displaying this newsletter? [View online](. [Database Weekly]( The Complete Weekly Roundup of SQL Server News Hand-picked content to sharpen your professional edge Editorial  A Big Week for the Data Platform This week was a big one in terms of changes for the Microsoft Data Platform. Arguably it was a big change for Microsoft itself, but certainly there were lots of Data Platform items announced at either the 2019 Ignite conference in Orlando or the 2019 PASS Summit in Seattle. Both conferences were scheduled on the same week, which meant that many data professionals had to choose one or the other. I was in Seattle for a couple days for two pre-conference sessions, but then returned home. I also avoided a scheduled trip to Orlando for Wednesday, as I felt that might be a bit much for me. The big announcement for SQL Server users is [SQL Server 2019 has been released](. This was announced on Monday at Ignite in [the keynote]( and reinforced at the opening PASS Keynote. I hope the PASS keynote becomes available to stream, as I only saw a portion of it on Wednesday. This is a big release, and to me, an inflection point for the data platform. With containers, the ability to scale out, and the enhancements in Polybase, this is a big release for SQL Server. Most of us might not see these features for years, but this will change the world. A couple nice things are no licensing cost increases, and the addition of the Secure Enclaves for better Always Encrypted implementation. In addition to this, we get SQL Server Edge, which is a version of SQL Server that can run on ARM processors. This means we can do some processing closer to the data, in remote situations, without moving the data to a central place. The demos seem to involve AI/ML work, but this could be pre-processing of some data in a remote office and then reporting or making decisions and only sending some data back across a network. It is definitely built more for embedded or sensor work, but the ability to handle time-series data and not make a round trip to a central server is useful. One of the more impressive demos at Ignite was [the query of a trillion rows in 9 sec](. This is obviously a shot at Google's BigQuery and Amazon's Redshift, and it's an impressive demo. It's amazing to me that we are talking about trillions of rows and PB of data now in relational systems. This is Azure Synapse, which combines the previous Azure SQL Data Warehouse and Azure Data Lake products into one. Perhaps an announcement that might not seem like it's a big data related one is [Azure Arc](. This extends the Azure Resource Manager to on-premises systems, but also to other clouds (AWS, GCP, etc.). What wasn't quite emphasized, but is important, is that this can manage data services, which means we can start to more easily stand up and spin down database resources. With containers growing, and more desire to get consistent dev, test, and production systems, I think Azure Arc is something more and more of us will be using. If you're looking for more coverage, we've got a series of blogs linked below that cover the announcements at the events from the perspective of attendees. Read through some of those in the Community section below. Steve Jones - SSC Editor [Join the debate, and respond to the editorial on the forums](  [Redgate University]( The Weekly News All the headlines and interesting SQL Server information that we've collected over the past week, and sometimes even a few repeats if we think they fit. Vendors/3rd Party Products [SQL Clone PowerShell Scripting: The Basics]( Phil Factor demonstrates some simple examples of how to use SQL Clone's PowerShell library to pass objects between cmdlets, and simplify common tasks, such as creating and deploying clones from various images. He then documents the objects and cmdlets, and illustrates their inputs and outputs. [Unwrapping, Unboxing and Installing SQL Clone]( If you are evaluating a tool such as a text editor or spreadsheet, it is easy: you just install it, you run it, you decide whether you need it. Job done. However, a similar 'unboxing' or 'unwrapping' of SQL Clone, and installing across a network, is not so quick and easy. Phil Factor's solution is to install and run a complete installation of SQL Clone on a single box. This allows you to try everything out, creating images and deploying clones, while isolated from the network. It can then be extended across a network, subsequently, when it's been fully tested. [Take the 2020 State of Database DevOps Survey – win a new iPad]( Redgate’s 2020 State of Database DevOps Survey is open now. Share your views on Database DevOps today for a chance to win a new 65GB iPad Air. Plus, for every entry, Redgate will donate $1 to UNICEF. Take the survey now. .NET Related Articles [The Good and Bad of Responsive Web Design]( In today’s world, people expect any web page to look and work flawlessly whether they are viewing through a monitor or a tiny smartphone and everything in between. In this article, Dino Esposito discusses one attempt to make developing web pages easier for any device or browser. AI/Machine Learning/Cognitive Services [New R Support in Azure Machine Learning]( Azure Machine Learning has added support for the R... [MLPerf Releases Official Results For First Machine Learning Inference Benchmark]( Since launching their organization early last year... [How terrible software design decisions led to Uber’s deadly 2018 crash]( NTSB says the system "did not include consideratio... [MLIR: Accelerating AI]( This is a keynote from TensorFlow World in Santa C... [Choosing Azure Analysis Services for large datasets]( I often get questions about use cases for Azure An... Administration [What SQL Server Agent Alerts Do I have setup?]( I am in a situation where I have to incorporate SQ... [Finding out the most cached database in the buffer cache - The DMV Way]( While there are many ways and criteria to find out... [SQL Server Diagnostic Information Queries for November 2019]( This month, I have just done more minor formatting... [Resumable online index rebuild]( continue on whats new SQL Server 2017 their is a g... [Checking To See If Intel Speed Shift Is Enabled]( Back in 2015, as part of the Skylake architecture,... [Troubleshooting Deadlocks with Extended Events]( Recently I started getting random alerts that a jo... [Redgate Data Masker]( Azure SQL Database [Configure Azure SQL Database Performance Insight – Analyzing SQL Server Query Plans – Part 5]( Let us discuss different aspects of Analyzing SQL ... [SQL Server Backup / Restore from URL]( I think many have covered how you should backup yo... [Deadlocks – Azure SQL Database]( Would you like to troubleshoot a deadlock in Azure... Azure Synapse (SQL Data Warehouse and Data Lake) [Simply unmatched, truly limitless: Announcing Azure Synapse Analytics]( Today, businesses are forced to maintain two types... Career Growth and Certifications [Rounding Out PASS Summit 2019]( If you are like me, when certain events end, it is... [Building an Azure Sandbox]( It’s that time of the year again. No, not fall, ... [Good Resume Examples]( I talk about resumes, enhancing your career, and f... Community Interests and PASS [Bacon, Bloggin’ and First Day Keynote at PASS Summit 2019!]( After a flurry of release announcements at MSIgnit... [PASS Summit 2019 – Day 1 Keynote]( Today is the first full day of the PASS Summit, an... [Voting for the PASS Board]( Voting is open for the PASS Board, as of yesterday... [PASS Summit 2019: Day 1 Keynote – my takeaways]( I’ve been at the bloggers table for two years no... [Pass Summit 2019 Keynote Day 2]( I’m blogging they Keynote! One of my bucket list... [PASS Summit 2nd Day Keynote]( Woohoo, we’ve made it to the second day of PASS ... Computing in the Cloud (Azure, Google, AWS) [What is Azure Arc?]( A first look at Microsoft Azure's new cross-platfo... Conferences, Classes, Events, and Webinars [SQLSaturday #916 - Bangladesh 2019]( SQL Saturday comes to Bangladesh on Nov 16. [SQLSaturday #916 - Bangladesh 2019]( A one day free training event on Nov 16, 2019. [SQLSaturday Orlando Notes – SpeedPASS]( This year for the first time in a long time we pre... [The SQLSaturday pitch to host facilities]( Not being able to find a good, affordable venue to... Data Privacy, Compliance, and GDPR [New bill would create Digital Privacy Agency to enforce privacy rights]( The bill proposes sweeping reforms to privacy righ... [Obfuscation as a Privacy Tool]( This essay discusses the futility of opting out of... Data Warehousing [Snowflake for SQL Server Users – Part 14 – Internal storage in Micropartitions]( If you want to learn a lot about how Snowflake wor... Database Design, Theory and Development [Understanding Auctions]( We participate in auctions all the time even when we don’t realize it. In this article, Joe Celko discusses the many different types of auctions and how they work. DevOps and Continuous Delivery (CI/CD) [How to Configure CI/CD in AzureDevOps]( Take advantage of the CI/CD pipeline in Azure DevOps to build, test, and deploy continuously to deliver value to your customers consistently with ease. In this article, Joydip Kanjilal shows you how to get started with Azure DevOps using a .NET Core app. [Controlled chaos: The inevitable marriage of DevOps and security]( This is a keynote highlight from the O’Reilly Ve... HA/DR/Always On/Clustering [SQL Server High availability: Add new disk to an existing failover cluster instance]( Total: 0 Average: 0In my previous article, I have ... Hardware [Intel Trims Cascade Lake Xeon Scalable Lineup]( Intel this week initiated end-of-life plan for two... [Western Digital Begins Shipments of 96-Layer 3D QLC-Based SSDs, Retail Products]( Western Digital announced this week that it has st... [Dell’s Latitude 7220 Rugged Extreme Tablet Gets Quad-Core CPUs & 1000-Nits Display]( Dell has introduced a new version of its high end ... [Surface Pro X Review: A Classic Look For The New Mobile Worker]( Microsoft's newest Surface device, the Surface Pro... [Seagate: 18 TB HDD Due in First Half 2020, 20 TB Drive to Ship in Late 2020]( Seagate last week clarified its high-capacity HDD ... Microsoft News [Microsoft Ignite Announcements]( Microsoft Ignite has always announced many new pro... [MS Ignite Day#1 Recap](  What an amazing first day at Microsoft Ignite t... Performance Tuning SQL Server [Are Long Compile Times Bringing You Down?]( Rarities I ran into a very funny situation while w... [Startup Expression Predicates And Parameter Sniffing]( Sounds Great Startup Expression Predicates can be ... [Create Efficient Query Plans Using Query Store – Analyzing SQL Server Query Plans – Part 3]( I will be discussing different aspects of Analyzin... [Why Not Exists Makes More Sense Than Left Joins]( Checklist This is always fun to talk to people abo... [How to Think Like the SQL Server Engine: Building Wider Indexes to Deal with Bad T-SQL]( In our last episode, we were running into problems... [Why Spills In Parallel Plans Can Be Weird]( Go Along, Get Along This is a somewhat complicated... [Capture Query Plans Using Extended Events and Traces – Analyzing SQL Server Query Plans – Part 1]( I will be discussing different aspects of Analyzin... [Identify Poorly Performing Query Plan Operators – Analyzing SQL Server Query Plans – Part 2]( I will be discussing different aspects of Analyzin... [SQL Undercover TV – Using Excel to Visualise SQL Performance Data]( Adrian looks at how you can use Excel to visualise... [How to Think Like the SQL Server Engine: When Statistics Don’t Help]( In our last episode, we saw how SQL Server estimat... PowerPivot/PowerQuery/PowerBI [Different ways to work with Microsoft Excel in Power BI]( Adam looks at the different ways you can use Micro... [Next Level Power BI – SVG Symbols]( In this first post in a series called "Next Level ... [Can What If parameters help in Power BI reports?]( Patrick looks at the What if parameters in Power B... [Power BI Report Builder And RSCustomDaxFilter]( If you’re building DAX queries using Power BI Re... [Power BI: Creating a TopoJSON file of Australian postcodes for use with Shape Map]( In a recent consulting project, I needed to plot a... [Power BI datasets vs. Power BI dataflows – What gets refreshes?]( Adam looks at what actually happens when you refre... Product Reviews and Articles [Redgate’s journey to DevOps]( At Redgate, we research DevOps, write articles, wh... [Teams in SQL Clone and SQL Provision]( SQL Clone v4 is out, and the big change is the add... [SQL Prompt 10: What’s New?]( Tony Davis reviews the major new features of SQL P... Product Upgrades and Releases [SQL Server Management Studio 18.4 and sqlpackage v18.4 generally available]( Today we're announcing the release of SQL Server Management Studio (SSMS) 18.4. This update has full support for SQL Server 2019 capabilities as well as some bug fixes. [The November 2019 release of Azure Data Studio is now available]( Today we are announcing the November release ofAzure Data Studio is now available.Download Azure Data Studioand review therelease notesto get started. [SQL Server 2019 is now generally available]( As you saw from our launch announcement earlier today, over a year ago at Microsoft Ignite we announced our first preview of SQL Server 2019 and today our latest release is now generally available. [New release: SQL Prompt 10](  [SQL Server Diagnostic Information Queries for November 2019]( This month, I have just done more minor formatting... Python [Overview scientific Python packages]( There are lots of Python packages available on the... [Learn How To Implement a Simple E-mail Spam Detector in Python]( Nowadays, many e-mail are being sent and many of t... [Calculating Trimmed Means (SQL and Python Variations)]( Data can often have extreme outliers, which can he... Reporting Services [There is already an object named 'RSExecRole' in the database]( When migrating an instance of SSRS, I performed a ... SQL Server News [Contest: Guess the SQL Server 2020 Release Date]( When will Microsoft officially release SQL Server ... [TDE in Standard Edition on SQL 2019]( Recently Microsoft quietly let us know that TDE (T... Security News and Issues [Facebook Groups API flaw exposed data to 100 developers, company says]( "Developers had access to data they shouldn't" is ... [Tech-support scammers used data stolen by Trend Micro employee]( Support-scam callers used leaked data about Trend ... [Spanish companies’ networks shut down as result of ransomware]( Apparent BitPaymer variant strikes major IT consul... [Actively exploited bug in fully updated Firefox is sending users into a tizzy]( Fraudulent tech-support sites cause Firefox to fre... T-SQL [SQL: Rolling up or archiving transactions past a cutoff date in T-SQL]( Another question that I recently saw on Stack Over... [SQL SERVER – Stored Procedure and RETURN Keyword]( The stored procedure was very long and we had to d... The Lighter Side [These electric hot rods point the way to future restomods]( Mustang Lithium has 900hp, and the E-10 paves the ... [SpaceX goes for two big reuse milestones with next launch]( On Tuesday, the company completed a static test fi... Tools for Development [Trying out Visual Studio Online - Using the cloud to manage and compile your code is amazing]( Visual Studio Online was announced in preview, so ... [Create Azure Data Studio SQL Notebooks with PowerShell](  [Powerhell Notebooks in ADS–A Minor Issue]( I heard about the addition of PoSh as a kernel for... [Installing SSIS, SSRS and SSAS with Visual Studio 2019]( Visual Studio 2019 brings new installation of SQL ... [PowerShell Notebooks are Available in Azure Data Studio]( PowerShell Notebooks are now available in the Nove...  [RSS Feed]( This email has been sent to {EMAIL}. To be removed from this list, please click [here](. If you have any problems leaving the list, please contact the webmaster@sqlservercentral.com. This newsletter was sent to you because you signed up at SQLServerCentral.com. Note: This is not the SQLServerCentral.com daily newsletter list, and unsubscribing to this newsletter will not stop you receiving the SQL Server Central daily newsletters. If you want to be removed from that list, you can follow the instructions on the daily newsletter. ©2019 Redgate Software Ltd, Newnham House, Cambridge Business Park, Cambridge, CB4 0WZ, United Kingdom. All rights reserved. webmaster@sqlservercentral.com  - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - -