InfoQ Homepage Database Content on InfoQ

Articles

RSS Feed

Newer Older

Architecture & Design

Turning Microservices Inside-Out

Turning microservices inside-out means moving past a single, request/response API to designing microservices with an inbound API for queries and commands, an outbound APIs to emit events, and a meta API to describe them both. A database can be supplemented with Apache Kafka via a connecting tissue such as Debezium.

Bilgin Ibryam
on Aug 03, 2021
Architecture & Design

Building Latency Sensitive User Facing Analytics via Apache Pinot

At QCon, a virtual conference for senior software engineers and architects covering the trends, Chinmay Soman talked about how you can use Apache Pinot as part of your data pipelines for building rich, external, or site-facing analytics.

Chinmay Soman
on Jun 28, 2021
AI, ML & Data Engineering

Accelerating Deep Learning on the JVM with Apache Spark and NVIDIA GPUs

In this article, authors discuss how to use the combination of Deep Java Learning (DJL), Apache Spark v3, and NVIDIA GPU computing to simplify deep learning pipelines while improving performance and reducing costs. They also show the performance comparison of this solution with GPU vs CPU hardware, using Amazon EMR and NVIDIA RAPIDS Accelerator.

Haoxuan Wang Qing Lan Carol McDonald
on Jun 11, 2021 2
Cloud

Evolution of Azure Synapse: Apache Spark 3.0, GPU Acceleration, Delta Lake, Dataverse Support

At Microsoft Build 2021, Azure Synapse has announced significant improvements for its Apache Spark pool, its performance, and data querying and integration capabilities. This article outlines the improvements and provides the context.

Lena Hall
on May 29, 2021
Architecture & Design

Case Study: a Decade of Microservices at a Financial Firm

Microservices are the hot new architectural pattern, but the problem with “hot” and “new” is that it can take years for the real costs of an architectural pattern to be revealed. Fortunately, the pattern isn’t new, just the name is. So, we can learn from companies that have been doing this for a decade or more.

Jonathan Allen
on May 21, 2021 1
.NET

Deep Diving into EF Core: Q&A with Jeremy Likness

Entity Framework (EF) Core is a cross-platform, extensible, open-source object-database mapper for .NET. Since its first release in 2016, EF Core evolved until reaching its current form: a powerful and lightweight .NET ORM. InfoQ interviewed Jeremy Likness, program manager for .NET Data at Microsoft, to understand more about EF Core and what we should expect for its next release later this year.

Jeremy Likness Arthur Casals
on May 12, 2021
AI, ML & Data Engineering

Why a Serverless Data API Might Be Your Next Database

In this article, author Pieter Humphrey discussed database as a service (DBaaS) and serverless data API for cloud based data management.

Pieter Humphrey
on May 05, 2021
Cloud

Indestructible Storage in the Cloud with Apache Bookkeeper

At Salesforce, we required a storage system that could work with two kinds of streams, one stream for write-ahead logs and one for data. But we have competing requirements from both of the streams. Being the pioneers in cloud computing, we also required our storage system to be cloud-aware as the requirements of availability and durability are ever more increasing.

Anup Ghatage
on Apr 28, 2021
AI, ML & Data Engineering

How Optimizing MLOps Can Revolutionize Enterprise AI

In this article, author Monte Zweben discusses data science architecture, containerization, and how new solutions like Feature Store can help with the full lifecycle of machine learning processes.

Monte Zweben
on Mar 06, 2021
AI, ML & Data Engineering

The Future of Data Engineering

Chris Riccomini examines the current and future states of the art in data pipelines, data streaming, and data warehousing. He presents a six-stage evolution that data ecosystems follow, from a simple monolith to a complex data-microwarehouse architecture as the data engineers who manage them solve problems and clarify their roles as infrastructure engineers, rather than data stewards.

Chris Riccomini
on Feb 16, 2021 1
Culture & Methods

Who is on the Team?

Ahmad Fahmy and Cesario Ramos take the changes to the new Scrum Guide as an opportunity to explore what it means to be "on a team." They draw on research to create an ACID test to differentiate who is on the team and who isn't. They discuss different mental models around the idea of a team with the hopes that you take this opportunity to discuss and elevate the roles within your organization.

Cesario Ramos Ahmad Fahmy
on Feb 12, 2021
AI, ML & Data Engineering

The Evolution of Precomputation Technology and its Role in Data Analytics

In this article, author Yang Li discusses the importance of precomputation techniques in databases, OLAP and data cubes, and some of the trends in using precomputation in big data analytics.

Yang Li
on Feb 11, 2021