InfoQ Homepage Scaling Content on InfoQ
-
Developing Software to Manage Distributed Energy Systems at Scale
Functional programming techniques can make software more composable, reliable, and testable. For systems at scale, trade-offs in edge vs. cloud computing can impact speed and security.
-
Microsoft Announces the Preview of Serverless for Hyperscale in Azure SQL Database
Recently, Microsoft announced the preview of serverless for Hyperscale in the Azure SQL Database, which brings together the benefits of serverless and Hyperscale into a single database solution.
-
Scalable Automation Frameworks for Functional and Non-Functional Testing
Separating the capabilities of a testing framework from the actual tests can enable scaling automated testing for complex enterprise products. According to Alexander Velinov, we should agree on the types of tests to execute automatically during release and what should be kept as manually triggered tests.
-
Slack Implements Circuit Breakers to Improve CI/CD Pipeline Availability
Slack recently published how it implemented the Circuit Breaker pattern to improve its CI/CD pipeline availability. Before this project, engineers at Slack saw challenges as peak request volumes in internal tooling caused cascade failures in dependent systems. Since completion, engineers saw increased service availability and fewer bad developer experiences like flakiness from failing services.
-
Fitting Presto to Large-Scale Apache Kafka at Uber
The need for ad-hoc real-time data analysis has been growing at Uber. They run a large Apache Kafka deployment and need to analyse data going through the many workflows it supports. Solutions like stream processing and OLAP datastores were deemed unsuitable. An article was published recently detailing why Uber chose Presto for this purpose and what it had to do to make it performant at scale.
-
AWS Releases the Second Version of Amazon Aurora Serverless with Independent Scaling
Recently, AWS announced the general availability of the second version of Amazon Aurora Serverless, an on-demand, auto-scaling configuration for Amazon Aurora. The second version is generally available for both Aurora PostgreSQL and MySQL, featuring the independent scaling of compute and storage.
-
Using Team-Set Salaries for Company-Wide Compensation
Team-set salaries (TSS) can be scaled up by doing appraisals across teams where results are automatically calibrated. The scores indicate where conversations are needed. TSS encourages people to learn new skills and adapt.
-
Scaling Video Quality Measurements at Netflix with Cosmos
Netflix relies heavily on measuring perceptual video quality for different business purposes. As metrics evolve and become part of more workflows, their measurement tool needs to scale too. Netflix recently described how a new video quality measurement workflow was implemented using Cosmos microservices to foster innovation in quality metrics, with good scalability and loose data coupling.
-
How Pinterest Scaled up Its Ad-Serving Architecture
On the Pinterest Engineering Blog, Nishant Roy wrote about their strategy to overcome a scaling problem with their ad corpus. Their existing solution had hit its scaling limit, but further growth was necessary. Its redesign offloaded the ad index to a key-value store and optimised garbage collection in their Go applications to increase their ad corpus size by a factor of 60.
-
Google Introduces Minimum Instances to Reduce Cold Starts
Google’s Function as a Service (FaaS) offering Cloud Functions now supports minimum (“min”) instances. With this new feature, Google aims to take away a well-known friction point of FaaS called "cold-starts".
-
Paving the Road to Production at Coinbase: QCon Plus Q&A
As Coinbase scaled both their number of engineers and customers, they needed more projects, faster iteration, and more control over their growing infrastructure. In developing their in-house deployment tool by looking at what developers were doing and trying to help them, they created a culture of self-service.
-
Safe and Fast Deploys at Planet Scale: QCon Plus Q&A
Uber has automated the deployment of services using a hybrid cloud model. All services are deployed using the same rollout techniques and workflows, ensuring safe deployment and mitigation of any issues. Abstracting away the differences between clouds supports engineers in building services that run on any platform.
-
Q&A on Container Scaling with Fargate
Vlad Ionescu, an AWS Container Hero, in early April reported on his experiments with scaling Amazon Fargate for batch processing or background jobs.
-
How N26 Scales Technology through Hypergrowth
As N26 grew fast, they had to scale their technology to keep up. This meant scaling not only their infrastructure, but also their teams; for instance, they had to decide how to distribute work over teams and what technology to use or not use. Folger Fonseca, software engineer and Tech Lead at N26, shared his experience from scaling technology at N26 at QCon London 2020.
-
Scaling Tech to Keep Building the Right Product During Hyper-Growth
When your organization is growing fast and steadily, change has to be part of your culture. People are recruited, people leave, and people change teams; you have to learn to adapt fast and keep tech and business synchronized. At FlowCon France 2019 Nicholas Suter and Nicolas Nallet spoke about scaling tech at Younited.