InfoQ Homepage Load Balancing Content on InfoQ
-
Load Balancing Search Traffic at Algolia with NGINX and OpenResty
Algolia’s engineering team made the switch from round-robin DNS load-balancing to a mix of DNS and NGINX with OpenResty. The solution, which uses custom Lua and Go code, and Redis-based service discovery of backend servers, helped in distributing load across their app servers and preventing latency issues.
-
Highly Available MySQL Clustering at WePay Using Orchestrator, Consul and HAProxy
WePay’s engineering team talks about their new highly available MySQL cluster built with HAProxy, Consul and Orchestrator. It improves upon their previous architecture by reducing any downtime from 30 minutes to 40-60 seconds.
-
Scaling Global Traffic at Dropbox with Edge Locations and GSLB
The Dropbox engineering team shared their experience of architecting and scaling their global network of edge locations. Located around the globe, these run a custom stack of nginx and IPVS and connect to the Dropbox backend servers over their backbone network. A combination of GeoDNS and BGP Anycast ensures availability and low latency for end users.
-
Serverless Challenges in Hybrid Environments
Sam Newman, independent consultant and author of the book "Building Microservices", talked at the Velocity conference in London on the challenges faced when hybrid systems rely on both serverless architectures and traditional infrastructure. In particular, Newman discussed how serverless changes our notion of resiliency and how the two paradigms clash at times of high load in the system.
-
AWS Adds Scale-Friendly Network Load Balancer to its Arsenal
AWS expanded the Elastic Load Balancer (ELB) service with a new product catered to high-performing applications. The Network Load Balancer is a Layer 4 TCP component designed to handle bursts of traffic and millions of requests per second.
-
HelloFresh's Migration to a New API Gateway to Enable Microservices
HelloFresh recently migrated their applications to a new API gateway with zero downtime. Their Director of Engineering, Ítalo Lelis de Vietro, shared the challenges and the migration process in a recent article.
-
How GitHub Designed its New Load Balancer
GitHub has been at work for the last year to develop a new load balancer, the GitHub Load Balancer (GLB), aimed to be able to scale to billions of connections per day running on commodity hardware. GitHub engineers Joe Williams and Theo Julienne explain how GLB was designed.
-
Improved Options for Service Load Balancing in Docker 1.12.0
With its 1.12.0 release, Docker introduced new options for load balancing of services via DNS and IP Virtual Server (IPVS) when the services are started in a Swarm cluster.
-
Google Maglev: A Load Balancer on Commodity Servers
A group of engineers from Google, UCLA, and SpaceX are presenting the paper "Maglev: A Fast and Reliable Software Network Load Balancer" at the 13th USENIX Symposium on Networked Systems Design and Implementation (NSDI '16) taking place this week. Maglev is Google’s network load balancer.
-
DigitalOcean Adds Floating IPs
DigitalOcean recently introduced floating IPs that can be manually reassigned to any Droplet – what DigitalOcean calls a virtual machine – within a data center. While neither novel nor a standalone high-availability solution, this service fills a gap for the fast-growing cloud provider.
-
Amazon Web Services Stability and the September 13th US East 1 Outage
Amazon Web Services (AWS) suffered another outage of its US East 1 region during the morning of Friday 13th September. A number of popular applications such as Heroku, Github and CMSWire were disrupted along with many other customers in Amazon’s largest, oldest and busiest location.
-
Closing the Gap: Latest Windows Azure Release Beefs Up Database, Load Balancing
Microsoft VP Scott Guthrie announced a range of updates to Windows Azure that fill in platform gaps while leapfrogging market leader AWS in one particular area. The new database export service provides a much-needed backup capability – albeit with controversial pricing – and the updated Traffic Manager delivers a cross-region load balancing experience that appears superior to what AWS offers.
-
Learning to Scale Websites at Mozilla
Mozilla is scaling websites from thousands to hundreds of millions of users through simple scaling patterns they have learned internally according to Brandon Burton, web operations engineer at Mozilla. The lessons learned include caching, scaling out web servers, asynchronous jobs, and databases.
-
Netflix Open Sources Their AWS Service Registry, Eureka
Netflix has open sourced yet another piece of their architecture, Eureka – a RESTful service used to locate middle tier services running within AWS regions.
-
Scalable System Design Patterns
Ricky Ho revisited his three year old post on that question and realized that a lot had changed since then.