An Introduction to Flowlets in Azure Data Factory (2022-04-15)

SQLServerCentral Newsletter for April 15, 2022 Problems displaying this newsletter? [View online](. [SQL Server Central]( Featured Contents - [An Introduction to Flowlets in Azure Data Factory]( - [Flyway Gotchas]( - [Tips and tricks with DAX table functions in paginated reports]( - [From the SQL Server Central Blogs - Talk to the duck.]( - [From the SQL Server Central Blogs - KQL Series – quick intro to Azure Data Explorer]( Question of the Day - [Choosing Business Continuity Options]( The Voice of the DBA  Daily Coping Tip Make sleep a priority and go to bed at a good time. I also have [a thread at SQLServerCentral]( dealing with coping mechanisms and resources. Feel free to participate. For many of you out there working in a new way, I'm including a thought of the day on how to cope in this challenging time from [The Action for Happiness Coping Calendar](. My items will be on [my blog](, feel free to share yours. Your User Manual Many of us have spent time looking through manuals or the documentation for some software or product. I know I'm on the [MS docs site]( regularly for work, and there are no shortage of times I've used various manuals to help me fix something around the house. We usually use a manual when we want to learn how something is supposed to work, or how to get it to do what we want. I saw [a post on a personal user manual]( that I thought was a good idea for some people, maybe many people. This isn't a manual for how you should live your life, but rather, how others might interact with you. It describes how you work, what motivates you, stimulates you, pleases you, and even the environment. Whether or not this is something you might give to co-workers (or your boss), it likely is a good exercise for you to undertake personally. You might better understand yourself, and you might learn something. Sometimes the things we think we like or want aren't really the things that actually make something great. I know I enjoy traveling, but too much creates a lot of stress. I like speaking in front of groups, but within certain boundaries. I like running, but my joints and bones will tell me that I really can't have that in my life anymore. I'm going to make a quick, outline of my manual here. I like independent work, creative work, and the chance to decide how to do things. I like to work with deadlines, but without micromanagement. I want to be at home much of the time, but go to an office and other places to interact with people periodically and regularly. I like working asynchronously most of the time, but synchronous brainstorming sessions are valuable. I like feedback to be written overall, and with some thought and reasoning behind it, not a like/dislike/emotional response. I think I could better flesh out different ideas with more detail and organize things better, but I enjoyed taking five minutes and thinking about my first reactions. Now I need to go back and revise this draft with a little more insight and consideration. Let me know today what you would think your user manual should say. Steve Jones - SSC Editor [Join the debate, and respond to today's editorial on the forums](   Featured Contents [SQLServerCentral Article]( [An Introduction to Flowlets in Azure Data Factory]( arindamxs from SQLServerCentral Learn how you can re-use parts of your pipeline in Azure Data Factory. Save off some tasks as a flowlet for use in multiple pipelines. [External Article]( [Flyway Gotchas]( Additional Articles from Redgate Explaining some of the 'gotchas' that can trip up the unwary Flyway user, and how to avoid them. One or two of these you'll encounter quickly, such as the case-sensitivity of parameters and arguments. Others, such as potential problems with undo scripts or running scripted callbacks, only when you are tackling more complex development processes. [External Article]( [Tips and tricks with DAX table functions in paginated reports]( Additional Articles from SimpleTalk There are several common challenges when creating paginated reports from Power BI datasets. In this article, Adam Aspin explains how to work around several of these issues. [Blog Post]( From the SQL Server Central Blogs - [Talk to the duck.]( Kenneth.Fisher from SQLStudies Over the years, one of the best pieces of problem solving advice I’ve been able to give my kids is ... Continue reading [Blog Post]( From the SQL Server Central Blogs - [KQL Series – quick intro to Azure Data Explorer]( HamishWatson from The Hybrid DBA's Blog Azure Data Explorer is a PaaS offering from Azure providing an end-to-end solution for data exploration. Here is a quick introduction of the features: This service from...   Question of the Day Today's question (by Steve Jones - SSC Editor):  Choosing Business Continuity Options Which of these business continuity topics are deprecated in SQL Server 2019? Think you know the answer? [Click here]( and find out if you are right.    Yesterday's Question of the Day (by Steve Jones - SSC Editor) Cross Platform Migration If I needed to migrate an Oracle database to SQL Server, which tool is best suited for this? Answer: SQL Server Migration Assistant Explanation: Only the SQL Server Migration Assistant is used to move a database from other platforms to SQL Server. The Data Migration and Database Experimentation Assistant are used with SQL Server only. Ref: SQL Server Migration Assistant - [Discuss this question and answer on the forums](    Database Pros Who Need Your Help Here's a few of the new posts today on the forums. To see more, [visit the forums](. --------------------------------------------------------------- SQL Server 2016 - Administration [Column Level Encryption In SQL Server 2016]( - Hello, I'm planning to use different certificate instead of self signed certification while implementing Column level encryption in SQL server 2016. So, it is like we have to create a Symmetric key but in order to secure a Symmetric key, we should have a 'different ( not self signed) digitally certificate. How can I accommodate […] [Possible to Side Load a DB to AOAG then rename]( - Hi, I have a large database within an 2016 AOAG that needs to be refreshed quite in a test environment from a copy in production. In order to minimise restore time due to tight maintenance windows, i was looking at an option to restore a copy of the database alongside the existing database in a […] [Failover Clustering Queries]( - Hello, We are planning to setup failover clustering on windows server. We are currently having sql server 2016 standard edition. I have few queries in mind. Do we need to move on to enterprise edition/ sql 2019 before configuring clustering nodes, in case we want to move on future so is it better to move […] Administration - SQL Server 2014 [Trigger or Notification]( - Hi I want if record added/updated in particular table before a particular date i should get message or notification or email should go. Log should also get maintained of that entry Thanks  SQL 2012 - General [First post here - help with installation of 2012 or 2019 Sql Server Express]( - Hi everyone! This is my first post on this subreddit. I'm absolutely new to the Sql world and I just signed up for a Udemy course to start learning about SQL. The first thing the teacher requires us to do is to install Microsoft Sql Express 2012 from the Microsoft website. However, when I went […] SQL Server 2012 - T-SQL [Comparison in the WHERE condition]( - Hi all, I would like to add some condition to the query but not for how it will be correct. For example, my query: SELECT Product_Id, Product_Name, Created_Date FROM Product I want to add condition: if product_id are 1 and 2 them created_date < 20220301, if not - any filtering. Could you please help me? […] SQL Server 2019 - Administration [Transactional Replication [CLOUD Publisher/Distributor] to [OnPrem Subscriber]]( - We are on the planning stages on moving our production servers to the [C] (Cloudwave). This includesa replicated DB that we use for all reporting needs. Before we do a cutover, we wanted to test any issues with TR so we setup a copy of our [C] test sql server and another [OP] sql server […] [Linked Server back to on prem SQL 2017 connects then cuts off intermittently]( - SQL 2019 instance is on a VM up in Azure (OS is Win 2019 Datacenter 64 bit). I setup a linked server with the Microsoft OLE DB Provider for SQL Server back to an on premises SQL 2017 server running Win 2016 standard. When running a simple SELECT using the linked server, the query will […] SQL Server 2019 - Development [Parsing / importing Costco Receipt data]( - OMG. I think CostCo doesn't want anyone to do anything with their own purchase data. If you've ever tried to read a Costco receipt, it's some brutal horrible shorthand. If you try to import it, it's even worse. So I asked Costco to e-mail a PDF of my last 6 months of purchases. Either that's […] [SS2019 Running Extremely Slow]( - Hi everyone I got a new computer and copied over the DB from my old machine. I backed up the DB from the old machine onto an external drive and then restored it on the new computer. I ran one stored procedure and it is super slow on the new machine. On the old machine […] [Having a case or if statement in where clause on Max Date]( - The issue is that I need to select the MAX date when: If the Max Date from my_column is equal to today's date, I need to select the Max Date from yesterday. If the Max Date from my_column is not equal to today's date, I can select the Max Date from today. I am trying […] Azure Data Factory [Any good resource to learn Data Factory ?]( - I just joined a company and I'm new to Azure. It's a powerful tool but I don't like Data Factory because it reminds me of SSIS and I think it's just clumsy and quite difficult to create pipelines, let alone debug them. Although, I don't know of I hate it because I don't know how […] Powershell [make script more robust]( - This script works, but I would like to add a few more things to the process, and need some help. 1) Search multiple folders 2) Search for multiple strings patterns (error,failed) 3) use a dynamic error log filename instead of hard coded in the export-csv 4) Email results. Get-ChildItem ` -Path "\\ftpsrv\logs\" | ` Select-String […] Integration Services [dynamic excel connection in ssis]( - Hi Expert, i wanted to user variable name in connection string . I tried [User:IntegrationFIle] in table or variable name property of excel connection string but did not worked  also tried entering in connection manager properties but did not work Provider=Microsoft.ACE.OLEDB.12.0;Data Source=@[User::IntegrationFile].xlsx;Extended Properties="EXCEL 12.0 XML;HDR=YES";  PostgreSQL [AWS RDS PostgreSQL to MySQL Replication]( - Hi, I have a client requirement to replicate data from AWS RDS Postgres DB (Source) to AWS RDS MySQL DB (Target). Need to replicate data from one source table to multiple target tables [Example: Column 1 from Source Table to Column 1 in Target Table 1 & Column 2 from Source Table to Column 1 […]   [RSS Feed]([Twitter]( This email has been sent to {EMAIL}. To be removed from this list, please click [here](. If you have any problems leaving the list, please contact the webmaster@sqlservercentral.com. This newsletter was sent to you because you signed up at SQLServerCentral.com. ©2019 Redgate Software Ltd, Newnham House, Cambridge Business Park, Cambridge, CB4 0WZ, United Kingdom. All rights reserved. webmaster@sqlservercentral.com  - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - -