InfoQ Homepage Clusters Content on InfoQ
-
Uber Redesigns M3DB Sharding with Subclusters to Limit Failure Impact
Uber has redesigned shard placement in M3DB with fixed size subclusters to limit the impact of node failures, maintenance, and cluster scaling. The approach bounds shard dependencies, preserves replica isolation, and uses a greedy algorithm to select shard migrations while avoiding a separate rebalancing pass and unnecessary data movement.
-
Kubernetes Multi-Cluster Project Karmada Reaches CNCF Graduation
The Cloud Native Computing Foundation (CNCF) announced on September 2026 that Karmada, a multi-cluster and multi-cloud Kubernetes orchestration project, has graduated. This multi-cluster and multi-cloud Kubernetes orchestration project reached CNCF's highest maturity tier.
-
Netflix Moves toward Open Source Flink Autoscaler for 30,000+ Streaming Jobs
Netflix is moving toward the open-source Apache Flink Autoscaler for more than 30,000 streaming jobs across multiple AWS regions. The operator-level approach addresses limitations of Netflix’s cluster level autoscaler for complex, stateful pipelines. Netflix reports a 58% reduction in annualized Flink compute expenditure for one team, saving approximately $1.1 million annually.
-
Netflix Cuts Cassandra Read Latency from Seconds to Milliseconds with Dynamic Partition Splitting
Netflix engineers introduced dynamic partition splitting for Cassandra to address wide partitions in time series workloads. The metadata-driven approach detects oversized partitions, splits them smaller units, and routes reads across child partitions. Netflix reported lower read latency from seconds to milliseconds, reduced timeouts, and improved cluster stability while maintaining transparency.
-
From Minutes to Seconds: Uber Boosts MySQL Cluster Uptime with Consensus Architecture
Uber redesigned its MySQL fleet using a consensus-driven architecture based on MySQL Group Replication, reducing cluster failover time from minutes to seconds. By moving leader election and failure detection into the database layer, Uber improved availability, simplified external orchestration, and strengthened consistency across thousands of production clusters.
-
Cilium at Ten Years: Stronger Encryption, Safer Policies, and Clearer Visibility for Large Clusters
Cilium 1.19 has been released, marking ten years of development for the eBPF-based networking and security project. There isn’t a flagship feature in this release; instead, it focuses on security hardening, tightening encryption, refining network policy behaviour, and improving scalability for large Kubernetes clusters.
-
Google Cloud Demonstrates Massive Kubernetes Scale with 130,000-Node GKE Cluster
The team behind Google Kubernetes Engine (GKE) revealed that they successfully built and operated a Kubernetes cluster with 130,000 nodes, making it the largest publicly disclosed Kubernetes cluster to date.
-
Google Cloud Announces Kubernetes History Inspector to Visualise Cluster Logs
Google Cloud has released a new open-source tool that visualises cluster logs chronologically to simplify troubleshooting in Kubernetes environments. Kubernetes History Inspector (KHI) is intended to help administrators to debug problems inside Kubernetes clusters and identify root causes.
-
Hugging Face Publishes Guide on Efficient LLM Training across GPUs
Hugging Face has published the Ultra-Scale Playbook: Training LLMs on GPU Clusters, an open-source guide that provides a detailed exploration of the methodologies and technologies involved in training LLMs across GPU clusters.
-
Uber Completes Major MySQL Fleet Upgrade, Boosting Performance and Security
Uber has detailed improvements to its MySQL database fleet by upgrading from version 5.7 to 8.0. The team wanted to take advantage of performance and concurrency improvements in newer versions of MySQL, and because MySQL 5.7 was reaching end-of-life in October 2023. The work took over a year and involved upgrading more than 2,100 clusters and 16,000 nodes across 19 production zones in 3 regions.
-
KubeCon EU: Mercedes-Benz’s Migration From Pod Security Policies to Validation Admission Policies
During KubeCon EU the Mercedes Benz team presented their migration journey from Pod Security Policies to Validation Admission Policies to secure their 1000+ Kubernetes clusters. The solution was chosen in favour of Kyverno due to its improved performance.
-
TikTok Owner Open-Sources Next Gen Kubernetes Federation Tool
ByteDance, the company behind popular global platforms like TikTok, has unveiled KubeAdmiral, its next-generation cluster federation system for Kubernetes, designed to manage multiple clusters with the efficiency and effectiveness comparable to a seasoned navy admiral commanding a fleet. KubeAdmiral scales to run more than 10 million pods across dozens of federated Kubernetes clusters.
-
Public Preview of the Arc Visual Studio Code Extension
Microsoft recently introduced the Arc Visual Studio Code Extension in public review. This extension improves the developer experience for both workloads that are running on the Edge and services that are built to be published on the Azure Marketplace.
-
Pinterest Revamps Its Asynchronous Computing Platform with Kubernetes and Apache Helix
Pinterest created the next-generation asynchronous computing platform, Pacer, to replace the older solution, Pinlater, which the company outgrew, resulting in scalability and reliability challenges. The new architecture leverages Kubernetes for scheduling job-execution workers and Apache Helix for cluster management.
-
Karmada 0.7: Next-Gen Multi-Cloud and Multi-Cluster Kubernetes Orchestration
Karmada (Kubernetes Armada) 0.7, featuring a promising Kubernetes management system in the hybrid cloud era, became available on July 12, 2021. It brought multi-cluster service discovery, precise cluster status management, replica scheduling based on cluster resources, and more convenient APIs to divide replicas by weight list.