Manage Elastic jobs in Azure using Azure Elastic Jobs Manager (2024-05-24)

SQLServerCentral Newsletter for May 24, 2024 Problems displaying this newsletter? [View online](. [SQL Server Central]( Featured Contents - [Manage Elastic jobs in Azure using Azure Elastic Jobs Manager]( - [Takeaways from Data Grillen 2024]( - [How to Build Metadata Driven Pipelines in Microsoft Fabric]( - [From the SQL Server Central Blogs - Reading JSON Data with Python]( - [From the SQL Server Central Blogs - Friday Basics: Authentication vs. Authorization]( - [The Phoenix Project]( Question of the Day - [Inserting Transaction Marks]( The Voice of the DBA  The Costs and Rewards of Speaking Most of the people I know who speak at [SQL Saturday]( or user groups aren't paid for their efforts. At many of the community events, the speakers are volunteering their time. Many are also paying for their own way to those events not located in their area. A few, such as me, might get a company to cover their travel expenses, but often this doesn't include time. Often if I attend a SQL Saturday, I still have a bunch of work on M-F that needs to be done. That being said, I'm happy to donate some time and money to community events. Some speakers build and teach full-day sessions, usually called pre-conference sessions, for which they are paid. There can be competition at large events like the PASS Data Community Summit and SQL Bits to get a session since the payment can be rewarding. I've seen some speakers make USD$1k or so, which can cover travel expenses, and others make over USD$10k, which is a nice payday. Most of us don't want to teach a full day of sessions, usually because it's a lot of work to build a day of training. It's also very nerve-wracking to try and teach people who have paid you. A lot of speakers don't really want to deal with that stress. I've done it, and it is hard work. I don't deliver pre-cons at events because I get expenses covered at lots of events and prefer not to compete with others who might want to earn some money while growing their careers. However, lots of people want to share their knowledge and teach others something useful. It's been amazing to me how many people have stepped up to submit sessions and present them at events all over the world. I've been lucky and honored to meet many of these volunteers and call them friends. When Andy, Brian, and I started SQL Saturday, we weren't sure there would be enough speakers to run 10 events in a year in 10 cities. At the time, the PASS Summit and a few other conferences were the only places to speak outside of user groups and we weren't sure there would actually be enough people in a community to run a conference. We also weren't sure that many people would travel outside their home area to speak. I'm thrilled we were wrong. So many people have volunteered their time and energy to build a session and then deliver it at user groups and local events that there are often more speakers than spaces available for them. Speaking can be intimidating, but I know many of you can do it. It's scary, it's a lot of work, it interrupts your free time, and it doesn't pay you any hard currency after a session. However, it's also thrilling to help others, exciting to have them listen to you, it hones your communication skills, and it is impressive to employers. On balance, I'd say that even delivering a presentation at your local user group is a profitable endeavor and a memorable experience. I hope we continue to see more of you willing to deliver a session for your peers, share some of your knowledge. I also hope that we see more of you stepping up to help organize a [SQL Saturday]( or another local event in your community. Steve Jones - SSC Editor [Join the debate, and respond to today's editorial on the forums](   Featured Contents [SQLServerCentral Article]( [Manage Elastic jobs in Azure using Azure Elastic Jobs Manager]( Kunal Rathi from SQLServerCentral Microsoft Azure offers Azure Elastic Job agent as a managed service, enabling efficient scheduling of T-SQL workloads on Azure SQL Databases. Learn how to configure the service in this article. [SQLServerCentral Article]( [Takeaways from Data Grillen 2024]( Tonie Huizer from SQLServerCentral Two days of Data, Beer and Bratwurst. What did it bring me, find out by reading this photo-rich article. [External Article]( [How to Build Metadata Driven Pipelines in Microsoft Fabric]( Additional Articles from SimpleTalk Over the past years, “traditional” ETL development has morphed into data engineering, which has a more disciplined software engineering approach. One of the benefits of having a more code-based approach in data pipelines is that it has become easier to build metadata driven pipelines. [Blog Post]( From the SQL Server Central Blogs - [Reading JSON Data with Python]( Steve Jones - SSC Editor from The Voice of the DBA Recently I’ve been looking at archiving some data at SQL Saturday. As a start, I needed to read some of the archive data I have in Python. This post... [Blog Post]( From the SQL Server Central Blogs - [Friday Basics: Authentication vs. Authorization]( K. Brian Kelley from Databases – Infrastructure – Security Another security fundamentals topic is authentication versus authorization. For those who have a clear understanding of the difference between the two, like with Recovery Point Objective (RPO) vs. Recovery... [The Phoenix Project]( [The Phoenix Project]( Additional Articles from SQLServerCentral In this newly updated and expanded edition of the bestselling The Phoenix Project, co-author Gene Kim includes a new afterword and a deeper delve into the Three Ways as described in The DevOps Handbook.   Question of the Day Today's question (by Steve Jones - SSC Editor):  Inserting Transaction Marks When is a transaction mark first inserted into the msdb.dbo.logmarkhistory table? Think you know the answer? [Click here]( and find out if you are right.    Yesterday's Question of the Day (by Steve Jones - SSC Editor) LOGON Trigger Count I have the need in SQL Server 2022 to create a complex set of checks for logins. I want to use Longon triggers, but I'd like to separate out logic. How many Logon Triggers can I create? Answer: There is no limit specified, but multiple logon triggers are allowed. Explanation: Multiple logon triggers are allowed, but there is no limit specificed. Ref: Logon Triggers - [ [Discuss this question and answer on the forums](    Database Pros Who Need Your Help Here's a few of the new posts today on the forums. To see more, [visit the forums](. --------------------------------------------------------------- SQL Server 2017 - Administration [Backup with Checksum Show No Issues, While DBCC CHECKDB Reports Errors]( - I took a backup with the CHECKSUM option, which was successful and showed no errors. However, when I restored the same backup, it showed DBCC CHECKDB errors. I want to understand why the checksum did not detect any issues, but DBCC CHECKDB did. What are the issues that a checksum will not detect but DBCC […] [Linked Server Product Name?]( - Just came across something weird. Was wondering if anyone else has ever seen this. All the years I've worked with SQL server linked server objects, I have always put "SQL Server" in product name. All the code examples on the internet include that or mention (in BOL) "Product name Type the product name of the […] [Can index fragmentation cause the database to enter suspect mode?]( - My database was in suspect mode, and when I checked using DBCC CHECKDB, it returned errors. As mentioned in the link below, I used the REPAIR_ALLOW_DATA_LOSS option with the DBCC CHECKDB command, but few errors persisted. Later, I dropped and recreated the indexes. This resolved the issue. My question is whether index fragmentation could […] SQL Server 2016 - Development and T-SQL [Multiple deadlocks occurring with contentious code]( - We are seeing multiple frequent deadlocks occurring with the following extract of code, which forms part of a stored procedure called sp_WS_Save_Record_Details. We have a web service that calls multiple instances of this stored procedure simultaneously. Records in the Record_Stub table are identified by an external reference. The code is trying to ensure that if […] [select string removing two sets of characters]( - Hi , I need help replacing a certain strings from a query response. My searches are pointing to a replace in the actual table but I am looking for sql that returns a different value than what is in the table. I am selecting a varchar(25) field and want to return the characters without the […] [View generating different plan]( - Hello  I have a view based upon a number of tables I'm selecting the same data from this view on 3 identical servers (same memory, processors, tempdb, settings etc.) The amount of data is nearly the same - Same on most dimensional tables; 10's of thousand out of millions of the fact (so < .5%) […] SQL 2012 - General [getting logged in user name to the pc that running the report]( - hi all, is there anyway in SQL to getting logged in user name to windows on the pc that running the power bi report connected to SQL as i've tried some scripts but it retrieved the logged in user to the SQL server itself I did search on some and found that script but it […] SQL Server 2019 - Administration [Swapping ports between 2 instances - can't understand results]( - Have 2 instances on the same TestServer 1. Default 2014 Dev edition on port 1433 2. Named 2019 Express instance "SQLExpress2019" on port 15191 SQLBrowser is working. TCP=1433 port is open on this TestServer. I swapped ports between the 2 instances and restarted the services. Can't tell if UDP 1434 is open.. UDP port 1434 […] [SQL JOB add/modified]( - Is there a trigger to notify when a new SQL Agent job is created/modified? SQL Server 2019 - Development [Unable to connect to SQL 2019 using Pyodbc]( - Development Environment I am learning how to use pyodbc and accessing database in SQL server 2019. Here are the software versions I am using: SQL server 2019 VS Code 1.89.1 Microsoft ODBC driver 18 for SQL Server Python 3.12.3 pyodbc 5.1.0 Developer laptop: Windows 11 Connection Errors: When running python test program in VS, it […] [Aggregating over multiple columns]( - Hello friends, See setup code below. I have a working solution but I am concerned that the DISTINCT is going to kill performance. I am hoping to see some alternative ways to solve this problem so I can compare performance with my real data. DROP TABLE IF EXISTS #Sales CREATE TABLE #Sales ( Country VARCHAR […] Connecting [Can you connect Power Apps to SQL Server if you work in the government?]( - My agency has been using the combo of on-premises SQL Server for the back end and local desktop software for the front end. Now upper management is saying that they want web applications only. And they really want to use our MS 365 license rather than have to pay for anything else. I'm investigating Power […] Design Ideas and Questions [Database design help and tips for a small app used to coach tennis players.]( - Hi, I hope this isn't too long of a question- I tried to make as brief as simplified as possible but maybe I am posting to the wrong place. I am a tennis coach and creating a database/app to automate tasks related to students, programs, practices, performances, and testing. I am finishing the database design […] SQL Server 2022 - Development [I have few snapshot transactions, now i need to put noloc in all tables.]( - I have few snapshot transactions , now my admin has informed me that put no lock in all tables in snapshot transactions, as it was blocking locking deadlocking with others. so I suggested to put read uncommited instead of snapshot when u are putting no lock in all tables of the transaction. q1) snapshote takes […] [Querystore bug(?), not showing data]( - My company where I worked recently upgraded to SQL Server 2022 Enterprise and Querystore started to behave odd (the problem was detected then anyway). If I start Querystore, and filter data, "last hour/last 12 hours" etc everything seems to work ok. But if I pick "custom" and manually specify date+time (even if it's the same […]   [RSS Feed]( This email has been sent to {EMAIL}. To be removed from this list, please click [here](. If you have any problems leaving the list, please contact the webmaster@sqlservercentral.com. This newsletter was sent to you because you signed up at SQLServerCentral.com. ©2019 Redgate Software Ltd, Newnham House, Cambridge Business Park, Cambridge, CB4 0WZ, United Kingdom. All rights reserved. webmaster@sqlservercentral.com  - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - -