InfoQ Homepage Performance & Scalability Content on InfoQ
-
Content Discovery at Scale with Hexagons and Elasticsearch at DoorDash
DoorDash recently published an article on how it is solving scaling challenges with content discovery using Elasticsearch and H3, a geospatial indexing system that partitions the world into hexagonal cells.
-
BBC New Serverless Platform Improves Scalability and Performance
One year into the transition to their new WebCore serverless platform, the BBC has started to reap the benefits of an architecture that removes the burden on engineers to solve performance and operational challenges and allows them to focus on the value they deliver to customers.
-
Netflix’s RENO Keeps Experience Consistent across Devices
Netflix has developed the Rapid Event Notification System (RENO) to create a consistent user experience across various platforms and devices. RENO reacts more quickly and consistently than the traditional request/response model to user-generated actions ranging from watching a title to changing profile information.
-
.NET 6: Threading Improvements
While numerous libraries exist to abstract away the complexities of asynchronous and concurrent programming, developers still need to drop down to lower thread-handling logic from time to time. Continuing our API changes for .NET 6 series, we look at some new tricks for multi-threading.
-
Introducing System.Threading.RateLimiting for .NET
While rate limiting is a well-known problem for web servers, there are many other situations where similar capabilities are needed. With the introduction of System.Threading.RateLimiting, developers will be able to add this capability without writing it themselves.
-
AWS Launches EC2 Auto Scaling Warm Pools
AWS recently released Warm Pools for EC2 Auto Scaling, which reduces the time and cost to scale out (aka horizontal scaling) applications by maintaining a pool of pre-initialized instances.
-
Google Announces the General Availability of A2 Virtual Machines
Recently, Google announced A2 Virtual Machines (VMs)' general availability based on the NVIDIA Ampere A100 Tensor Core GPUs in Compute Engine. According to the company, the A2 VMs will allow customers to run their NVIDIA CUDA-enabled machine learning (ML) and high-performance computing (HPC) scale-out and scale-up workloads efficiently at a lower cost.
-
How Project Cyclop Enabled GitHub to Reduce Push Failures to Nearly Zero
GitHub spawned Project Cyclop several months ago to identify what caused occasional push failures and to find a fix. It turns out there was no single culprit, and a careful analysis led to identifying a number of changes that improved push traffic by at least an order of magnitude, according to GitHub.
-
Microsoft Announces Azure Monitor SQL Insights for Azure SQL in Public Preview
Recently Microsoft announced Azure Monitor SQL Insights for Azure SQL in public preview. With the preview, customers will get a flexible canvas for telemetry collection, analysis, and rich custom visualization.
-
Dropbox Improves Sync Performance Using a Modified Brotli
After analyzing the performance of several common lossless compression algorithms, Dropbox engineers have slightly modified Google's Brotli encoder to improve their engine sync performance. This reduced median latency and data transfer by more than 30%, Dropbox engineers Rishabh Jain and Daniel Reiter Horn maintain.
-
GitHub Was down Multiple Times Last February: Here's Why
GitHub completed its internal investigation about what caused multiple service interruptions that affected its service last February for over eight hours. The root cause for this was a combination of unexpected database load variation and database configuration issues.
-
Network Automation at Fastly
Ryan Landry, the senior director for TechOps at Fastly, has shared how network automation enables them to manage traffic peaks during popular live-streamed events such as the Super Bowl LIV. Fastly is directly connected to numerous ISPs across the US and tries to keep their live video traffic on these direct paths with their partners to deliver video streams as close to the end-user as possible.
-
TCMalloc, Google's Customized Memory Allocator for C and C++, Now Open Source
Google's TCMalloc can be used as a replacement for C and C++ default memory allocators to provide greater efficiency at scale and better support for parallelism, says Google.
-
Dynein – an Asynchronous Background Job Service from Airbnb
At Airbnb, they move time consuming, resource intensive tasks over to asynchronous background jobs to improve scalability. The job scheduling system has become a very important component and they have therefore built Dynein, a distributed delayed job queueing service and scheduler. In a blog post, Andy Fang from Airbnb describes the background and challenges in designing and building the service.
-
HAProxy EBtree: Design for a Scheduler, and Use (Almost) Everywhere
At QCON New York 2019, Andjelko Iharos presented how CTO Willy Tarreau and the HAProxy team implemented a scheduler using an EBtree data structure to optimize performance and memory usage of the HAProxy load balancer.
Sponsored Content
7 Essentials When Selecting a NoSQL Database-as-a-Service (DBaaS)
This paper outlines 7 key considerations that help teams tap the many benefits a DBaaS has to offer — without falling into some of the common traps that impact agility, productivity, costs, and growth. Download Now.
SQL to NoSQL: Architecture Differences and Considerations for Migration
Learn the tradeoffs between flexibility, scale and cost, plus what to consider for successful SQL to NoSQL migrations. Download Now.
7 Reasons Not to Put an External Cache in Front of Your Database
Read this white paper to learn common approaches to caching data, 7 specific reasons why external caching can be a bad choice. real-world examples of successfully eliminating external cache by companies such as Comcast, and more. Download Now.