InfoQ Homepage Scalability Content on InfoQ

Articles

RSS Feed

Newer Older

AI, ML & Data Engineering

Design Pattern Proposal for Autoscaling Stateful Systems

In this article, Rogerio Robetti discusses the challenges in auto-scaling stateful storage systems and proposes an opinionated design solution to automatically scale up (vertical) and scale out (horizontal) from a single node up to several nodes in a cluster with minimum configuration and interference of the operator.

Rogerio Robetti
on Jan 25, 2023
Development

Build, Test, and Deploy Scalable REST APIs in Go

In this article, we'll look at how to use the gin framework to create a simple Go application. We will also learn how to use CircleCI, a continuous deployment tool, to automate testing and deployment.

Oghenevwede Emeni
on Nov 02, 2022
Architecture & Design

Building & Operating High-Fidelity Data Streams

At QCon Plus 2021 last November, Sid Anand, chief architect at Datazoom and PMC Member at Apache Airflow, presented on building high-fidelity nearline data streams as a service within a lean team. In this talk, Anand provides a master class on building high-fidelity data streams from the ground up.

Sid Anand
on Sep 30, 2022
Cloud

A Recipe to Migrate and Scale Monoliths in the Cloud

In this article, I want to present a simple cloud architecture that can allow an organization to take monolithic applications to the cloud incrementally without a dramatic change in the architecture. We will discuss the minimal requirements and basic components to take advantage of the scalability of the cloud.

Luciano Mammino
on May 13, 2022
AI, ML & Data Engineering

The Next Evolution of the Database Sharding Architecture

In this article, author Juan Pan discusses the data sharding architecture patterns in a distributed database system. She explains how Apache ShardingSphere project solves the data sharding challenges. Also discussed are two practical examples of how to create a distributed database and an encrypted table with DistSQL.

Trista Pan
on Jan 12, 2022
Development

Picking an Active-Active Geo Distribution Strategy: Comparing Merge Replication and CRDT

Modern distributed applications are fuelling the growing demand for distributed active-active, multi-master databases. While most popular databases support multi-master deployment, different databases employ different techniques. LWW, MVCC, merge replication and CRDTs deliver eventual consistency, offering read and write access with local latency and remaining available during network partitions.

Roshan Kumar
on Jun 12, 2018 1
Architecture & Design

Microservices and the Economics of Small Things

In this article Mark Burgess explores the process of "decentralizing intent" and the effect it has on the predictability of our systems including what we can know as we scale systems.

Mark Burgess
on May 25, 2018
Development

A Comparison between Rust and Erlang

This article will focus on a comparison between Erlang and Rust, detailing their similarities and differences. It may be interesting to both Erlang developers looking into Rust and Rust developers looking into Erlang. A final section will detail more about each of the language capabilities and shortcomings and argue for the possibility of leveraging both languages' strengths in the same project.

Krishna Kumar Thokala
on Mar 13, 2018 6
DevOps

Five Lessons Security Can Learn from DevOps

Just as DevOps emerged to meet new business needs, new approaches in security are now needed to address the challenges of a DevOps-driven world. These new security approaches themselves must incorporate DevOps practices that rely on modularity, automation, standardization, auditability, and mirrored systems.

Wei Lien Dang
on Nov 30, 2016
Book Review and Q&A - The Art of Scalability

The Art of Scalability is a book on scaling organisations to adapt to web scale growth of their products and services. As well as having technical and architectural implications, scale needs to be dealt with on the organizational level. The goal is to show the reader how to organize technology, people and processes to result in a virtuous circle, a path of continuous improvement to scalability.

Grischa Ekart
on Aug 16, 2015
Storm Applied Review and Q&A with the Authors

Storm is a distributed, fault-tolerant, real-time computation system that was originally developed at BackType and later open sourced by Twitter. Storm Applied is a new book from Manning that aims to provide a practical guide on using Storm, both in a development and in a production setting. InfoQ has spoken with two of the book’s authors, Sean T. Allen and Matthew Jankowski.

Sergio De Simone
on Jul 27, 2015
Jonas Bonér on Reactive Systems Anti-Patterns

Taking the opportunity offered by the update to the Reactive Manifesto, InfoQ asked Jonas Bonér, TypeSafe CTO and original author of the first Reactive Manifesto, some questions about his vision of “Reactive” applications. Jonas offered his thoughts about both desirable features of reactive applications and what is not reactive programming.

Sergio De Simone
on Oct 20, 2014 1