Architecture & Design Round-Up

A Collection of Top Architecture & Design News, Articles, Presentations August 2023 [InfoQ] Architecture & Design Round-Up Sponsored by [ScyllaDB] [Latest Content](#latest-content), [Top Viewed Content](#top-viewed-content), [Top News](#news), [Top Articles](#top-articles), [Top Presentations](#top-presentations-and-interviews) In this special newsletter we bring you up to date on all the new content and news related to Architecture & Design on InfoQ. We are also maintaining a portal page for this content on InfoQ at: [(. [] Latest Content on InfoQ [Microservices Retrospective – What We Learned (and Didn’t Learn) from Netflix]( (presentations, Jul 28, 2023) [Grab Reduces Traffic Cost for Kafka Consumers on AWS to Zero]( (news, Jul 28, 2023) [Pfizer Uses Serverless Architecture on AWS to Scale Processing of Digital Biomarkers]( (news, Jul 26, 2023) [Introduction of Auth0 Templates for .NET]( (news, Jul 31, 2023) [Microsoft Previews Azure Boost to Improve Remote Storage Throughput and IOPS Performance]( (news, Jul 30, 2023) [7 Reasons Not to Put an External Cache in Front of Your Database]( Read this white paper to learn common approaches to caching data, 7 specific reasons why external caching can be a bad choice, real-world examples of successfully eliminating external cache by companies such as Comcast, and more. [Download now](. Sponsored content [7 Reasons Not to]( [] Top Viewed Content on InfoQ [Prime Video Switched from Serverless to EC2 and ECS to Save Costs]( (news, May 03, 2023) [LinkedIn Adopts Protocol Buffers for Microservices Integration and Reduces Latency by up to 60%]( (news, Jul 19, 2023) [Azure API Center for Centralized API Discovery and Governance in Preview]( (news, Jun 15, 2023) [Google Introduces a Standalone Integration Platform as a Service on Their Cloud Platform]( (news, Jul 23, 2023) [Banking on Thousands of Microservices]( (articles, May 08, 2023) [] Top News [Grammarly Replaces its in-House Data Lake with Databricks Platform Using Medallion Architecture]( Grammarly adopted the medallion architecture while migrating from their in-house data lake, storing Parquet files in AWS S3, to the Delta Lake lakehouse. The company created a new event store for over 6000 event types from 40 internal and external clients and, in the process, improved data quality and reduced the data-delivery time by 94%. [Implementing Application Level Encryption at Scale: Insights from Atlassian’s Use of AWS and Cryptor]( Atlassian recently published how it performs Application Level Encryption at scale on AWS while utilising high cache hit rates and maintaining low costs. Atlassian's solution runs over 12,500 instances and manages over 1,540 KMS keys. It performs over 11 billion decryptions and 811 million encryptions daily, costing $2,500 per month versus a potential $1,000,000 per month using a naive solution. [Yelp Rebuilds Corrupted Cassandra Cluster Using Its Data Streaming Architecture]( Yelp created a solution to sanitize data from the corrupted Apache Cassandra cluster utilizing its data streaming architecture. The team explored many potential options to address the data corruption issue, however, ultimately had to move the data into a new cluster to remove corrupted records in the process. [SQL to NoSQL: Architecture Differences and Considerations for Migration]( Read this white paper to learn about the architectural differences Between SQL and NoSQL, the tradeoffs between flexibility, scale and cost, and considerations for successful SQL to NoSQL migrations. [Download now](. Sponsored content [SQL to NoSQL]( [Micronaut 4.0.0 Brings Java Virtual Threads, GraalVM Support and Experimental HTTP/3 Features]( The Micronaut Foundation has recently announced the general availability (GA) release of Micronaut Framework 4.0.0. This major release brings a plethora of updates and improvements to the popular JVM-based framework, enhancing its performance, modularity, and compatibility with other technologies. [Enhanced Testcontainers and Development-Time Containers Support in Spring Boot 3.1]( Spring Boot 3.1, the latest version of the popular Java-based framework for building stand-alone, production-grade applications, introduces enhanced support for development-time containers. This new feature was the focus of a recent livestream by Josh Long, a Spring developer advocate, on his YouTube channel "Coffee + Software with Josh Long." [] Top Articles [Tales of Kafka at Cloudflare: Lessons Learnt on the Way to 1 Trillion Messages]( Cloudflare relies on Kafka clusters to process massive data volumes using Protobuf for structured communication, balancing flexibility and simplicity for standardized pipelines. [article]( [Start Your Architecture Modernization with Domain-Driven Discovery]( This article presents a guided approach to starting an architecture modernization project with Domain-Driven Discovery (DDD), illustrated with a medical supply company migrating systems to the cloud. [article]( [Enhancing Your Definition of Done Can Improve Your Minimum Viable Architecture]( By including architectural considerations, along with typical functional aspects of quality, in a Definition of Done, teams can strengthen the quality and sustainability of their products. [article]( [Adaptive, Socio-Technical Systems with Architecture for Flow: Wardley Maps, DDD, and Team Topologies]( This article provides an introduction to combining Wardley Mapping, Domain-Driven Design, and Team Topologies to design and build adaptive, socio-technical systems optimized for a fast flow of change. [article]( [A Comprehensive Guide to Building Event-Driven Architecture on Azure, AWS, and Google Cloud]( In this article, you'll find guidance to Azure, AWS, and Google Cloud resources, along with unique architecture examples that incorporate EventBridge, SNS, Service Bus, Eventgrid, and GC Eventarc. [article]( [7 Essentials When Selecting a NoSQL Database-as-a-Service (DBaaS)]( With the move into the “Zettabyte era,” many are looking at database-as-a-service (DBaaS) options. This paper outlines 7 key considerations that help teams realize the many benefits a DBaaS has to offer — without falling into some of the common traps. [Download now](. Sponsored content [7 Essentials When Selecting a NoSQL]( [] Top Presentations [Honeycomb: How We Used Serverless to Speed up Our Servers]( Jessica Kerr reviews the benefits (user experience on demand!) and constraints (everything in AWS has a limit!) of serverless-as-accelerator, and gives practical advice. [Jessica Kerr]( [API Evolution without Versioning]( Brandon Byars patterns of evolution in addition to versioning, the tradeoffs that exist between API elegance, obviousness, and stability, broadening the conversation from API evolution to PM. [Brandon Byars]( [From Zero to a Hundred Billion: Building Scalable Real-Time Event Processing at DoorDash]( Allen Wang discusses the design of the event system including major components of event producing, event processing with Flink and streaming SQL, event format and schema validation. [Allen Wang]( [Dark Energy, Dark Matter and the Microservices Patterns?!]( Chris Richardson describes how dark energy and dark matter are excellent metaphors for the competing forces (a.k.a. concerns) that must be resolved by the microservices pattern language. [Chris Richardson]( [Ubiquitous Caching: a Journey of Building Efficient Distributed and In-Process Caches at Twitter]( Juncheng Yang discusses three trends in hardware, workload, and cache usage that shape the design of modern caches. [Juncheng Yang]( [Connect with InfoQ on Twitter]( [Connect with InfoQ on Facebook]( [Connect with InfoQ on LinkedIn]( [Connect with InfoQ on Youtube]( You have received this message because you are subscribed to the “Special Reports Newsletter”. To stop receiving this email, please click the following link: [Unsubscribe]( C4Media Inc. (InfoQ.com), 2275 Lake Shore Boulevard West, Suite #325, Toronto, Ontario, Canada, M8V 3Y3