BT

InfoQ Software Architects' Newsletter

A monthly overview of things you need to know as an architect or aspiring architect.

View an example

We protect your privacy.

Facilitating the Spread of Knowledge and Innovation in Professional Software Development

Write for InfoQ

Logo - Back to homepage

News Articles Presentations Podcasts Guides

Topics

Development

Featured in Development

How to Compute Without Looking: A Sneak Peek into Secure Multi-Party Computation

This article shows how you can compute a function across multiple parties that do not trust each other without forcing them to share their individual inputs. This technique can be used to split secrets among parties, perform logical operations, or count votes in a way that ensures data privacy is preserved.

All in development

Architecture & Design

Featured in Architecture & Design

OpenSearch Cluster Topologies for Cost Saving Autoscaling

Amitai Stern discusses cost-saving autoscaling topologies for OpenSearch. He explains the inherent challenges in autoscaling unstructured data systems like OpenSearch and Elasticsearch, using analogies to illustrate the complexities beyond simply adding nodes. He shares architectural patterns (burst indexes, burst clusters) to optimize resource utilization and handle fluctuating loads effectively.

All in architecture-design

AI Infrastructure

Featured in AI, ML & Data Engineering

Rockset - Building a Modern Analytics Database on Top of RocksDB

Igor Canadi discusses the architecture of their real-time search analytics SQL database built on RocksDB. He explains their cloud-native design, custom RocksDB replication, shared hot storage solution, and how they optimized RocksDB for efficient analytical queries. Learn about their approach to scalability, low latency, and high concurrency for application-focused databases.

All in ai-ml-data-eng

Culture & Methods

Featured in Culture & Methods

Bringing a Product Mindset to an Infrastructure Platform Team

Stéphane Di Cesare discusses DKB's experience introducing a product mindset within their platform team, explaining their definition of a platform team, the rationale behind the shift, and their journey including challenges, goals, and key learnings around user value, platform definition, maturity models, and effective communication strategies for senior software developers and engineering leaders.

All in culture-methods

DevOps

Featured in DevOps

Checklist for Kubernetes in Production: Best Practices for SREs

This article provides SREs with a checklist for managing Kubernetes in production environments. It identifies common challenges including resource management, workload placement, high availability, health probes, storage, monitoring, and cost optimization. By implementing consistent GitOps automation across these areas, teams can significantly reduce complexity, and prevent downtime.

All in devops

Events

Helpful links

Choose your language

Discover emerging trends, insights, and real-world best practices in software development & tech leadership. Join now.

InfoQ Dev Summit Boston

Learn how senior software developers are solving the challenges you face. Register now with early bird tickets.

InfoQ Dev Summit Munich

Learn practical solutions to today's most pressing software challenges. Register now with early bird tickets.

QCon San Francisco

Explore insights, real-world best practices and solutions in software development & leadership. Register now.

InfoQ Homepage Performance & Scalability Content on InfoQ

Presentations

RSS Feed

Newer Older

Architecture & Design

OpenSearch Cluster Topologies for Cost Saving Autoscaling

Tech lead Amitai Stern shares insights on OpenSearch autoscaling, covering common pitfalls and innovative architectural approaches.

Amitai Stern
on Mar 31, 2025

Icon

45:01
Architecture & Design

Lessons Learned in the Financial Market about Performance and Observability in Front-End Projects

Jessica Felix discusses how to navigate the intricate balance between performance and observability, and the challenges of maintaining equilibrium.

Jessica Felix
on Feb 13, 2025

Icon

36:37
Architecture & Design

Unveiling the Tech Underpinning FinTech's Revolution

Wojtek Ptak, Andrzej Grzesik discuss how to avoid wasting time, problems of scaling architecture, imposing constraints and restrictions, and practical tips for increasing collaboration and ownership.

Wojtek Ptak Andrzej Grzesik
on Feb 06, 2025

Icon

50:45
AI, ML & Data Engineering

Why a Hedge Fund Built Its Own Database

James Munro discusses ArcticDB and the practicalities of building a performant time-series datastore and why transactions, particularly the Isolation in ACID, is just not worth it.

James Munro
on Aug 20, 2024

Icon

51:15
Architecture & Design

Delivering Millions of Notifications within Seconds During the Super Bowl

Zhen Zhou discusses how they built/test an on-demand notification system, what it takes to manage cloud resources/site-reliability at the same time, and how to mitigate reliability issues.

Zhen Zhou
on Jul 09, 2024

Icon

47:49
AI, ML & Data Engineering

LIquid: a Large-Scale Relational Graph Database

Scott Meyer discusses LIquid, the graph database built to host LinkedIn, serving a ~15Tb graph at ~2M QPS.

Scott Meyer
on Jun 07, 2024

Icon

49:39
Development

From Mainframes to Microservices - the Journey of Building and Running Software

Suhail Patel discusses the platforms and software patterns that made microservices popular, and how virtual machines and containers have influenced how software is built and run at scale today.

Suhail Patel
on May 22, 2024

Icon

43:26
AI, ML & Data Engineering

Modern Compute Stack for Scaling Large AI/ML/LLM Workloads

Jules Damji discusses which infrastructure should be used for distributed fine-tuning and training, how to scale ML workloads, how to accommodate large models, and how CPUs and GPUs can be utilized.

Jules Damji
on May 08, 2024

Icon

52:19
Architecture & Design

Sleeping at Scale - Delivering 10k Timers per Second per Node with Rust, Tokio, Kafka, and Scylla

Lily Mara and Hunter Laine walk through the design of a system, its performance characteristics, and how they scaled it.

Lily Mara Hunter Laine
on Apr 26, 2024

Icon

48:39
Web Development

Several Components are Rendering: Client Performance at Slack-Scale

Jenna Zeigen discusses front-end performance issues encountered by Slack as they continue to grow and evolve the desktop app.

Jenna Zeigen
on Apr 25, 2024

Icon

42:07
DevOps

Effective Performance Engineering at Twitter-Scale

Yao Yue recapitulates scaling a project at Twitter while summarizing some key lessons learned about effective performance engineering.

Yao Yue
on Apr 12, 2024

Icon

49:45
Culture & Methods

Scaling Organizations with Platform Engineering

Lesley Cordero focuses on how Platform Engineering can drive sustainability for growing organizations through DevOps principles, centralization, and scalable technical practices.

Lesley Cordero
on Mar 26, 2024

Icon

50:17

Newer Presentations

Older Presentations

BT