InfoQ Homepage Distributed Query Content on InfoQ
News
RSS Feed-
CSIRO Uses Serverless Architecture to Query 100x More Genomic Variants on AWS
CSIRO has developed Serverless Beacon, a serverless architecture for querying genomic variants without copying VCF files into a central database. The system combines Amazon S3, Lambda, Athena and DynamoDB, using metadata indexes and HTTP byte range requests to query compressed genomic regions. Tests reported 1.52 second average latency for 10,000 base pair queries.
-
Inside Uber’s Query Architecture: Simplifying Layers and Improving Observability
Uber rebuilt its Apache Pinot query architecture, replacing the Presto-based Neutrino system with a lightweight proxy called Cellar and Pinot’s Multi-Stage Engine Lite Mode. The redesign simplifies SQL execution, improves resource management, and ensures predictable performance for large-scale analytics workloads.
-
Basic Concepts and the Future of Axon, a CQRS and Event Sourcing Framework
At the recent Event-Driven Microservices Conference in Amsterdam, Allard Buijze described in a presentation the basic concepts, the history and future of Axon, a framework for systems based on DDD, event sourcing and CQRS. The adoption of Axon Framework is growing rapidly and recently hit one million downloads.
-
Optimizing Distributed Queries in Splunk
Optimizing queries in Splunk’s Search Processing Language is similar to optimizing queries in SQL. The two core tenants are the same: Change the physics and reduce the amount of work done. Added to that are two precepts that apply to any distributed query.