InfoQ Homepage Infrastructure Content on InfoQ
-
Using Code Instrumentation for Fault Injection at the Application Level at eBay
eBay engineers have been using fault injections techniques to improve the reliability of the notification platform and explore its weaknesses. While fault injection is a common industry practice, eBay attempted a novel approach leveraging instrumentation to bring fault injection within the application level.
-
Cloudflare Servers Share IP Addresses for Egress Traffic
Cloudflare recently detailed how it manages its servers' egress traffic using "soft-unicast ". Soft-unicast allows multiple servers to share a single IPv4 address for their egress traffic while redirecting the response packets to the correct physical server. It provides a scalable, cost-efficient solution for Cloudflare to offer various products that require tagged egress IP addresses.
-
How Twitter Automated Data Quality Check Process
Twitter engineering has recently shared a blog post on how they architected and developed a quality automation platform. Twitter digests and creates thousands of data sets for different data products and applications. The next natural step is to make sure of the quality of the data by adding automation on top of it. In this news post, we explore this architecture in more detail.
-
AWS Key Management Service Now Supports External Key Stores
AWS recently announced the availability of AWS Key Management Service (AWS KMS) External Key Store (XKS), allowing organizations to store and manage their encryption keys outside the AWS KMS service.
-
AWS Previews VPC Lattice for Service-to-Service Communication
To simplify networking for service-to-service communication, AWS recently announced the preview of Amazon VPC Lattice. The new capability of Virtual Private Cloud (VPC) abstracts network complexity and creates a logical application layer network that connects clients and services across different VPCs and accounts.
-
AWS Announces Clean Rooms for Secure Collaboration with Analytics Data
During the recent re:Invent conference, AWS announced the preview of Clean Rooms for analytics data. The new service provides safe environments where multiple customers can securely share and analyze data with control of how the data is used, reducing the risk of sharing personal data.
-
Uber Reduces Logging Costs by 169x Using Compressed Log Processor (CLP)
Uber recently published how it dramatically reduced its logging costs using Compressed Log Processor (CLP). CLP is a tool capable of losslessly compressing text logs and searching them without decompression. It achieved a 169x compression ratio on Uber's log data, saving storage, memory, and disk/network bandwidth.
-
Cloudflare Releases Cache Reserve in Open Beta
Recently, Cloudflare announced the open beta of Cache Reserve, which provides a way to serve all static content from Cloudflare’s global cache persistently. It is a large, persistent data store implemented on top of R2.
-
AWS Opens New Region in Spain
AWS recently opened a new region in Spain to offer cloud services in the Iberian Peninsula and address in-country data residency and compliance requirements. The new eu-south-2 region is based in Aragón and has three availability zones.
-
AWS Announces Redis 7 Compatibility to Amazon ElastiCache for Redis
Recently AWS announced Redis 7 compatibility with Amazon ElastiCache for Redis, which brings several new features, such as Redis Functions, ACL improvements, and Sharded Pub/Sub.
-
Momento Announces Serverless Cache Service
The startup Momento recently emerged from stealth mode launching a serverless cache. The new service is generally available and offers a highly available cache with an on-demand pricing model based on data transferred in/out.
-
Meta Announces Next Generation AI Hardware Platform Grand Teton
Meta recently announced Grand Teton, their next-generation hardware platform for AI training. Grand Teton features several improvements over the previous generation, including 2x the network bandwidth and 4x the host-to-GPU bandwidth.
-
Uber Freight Near-Real-Time Analytics Architecture
Uber Freight is the Uber platform dedicated to connecting shippers with carriers. Providing reliable service to shippers is crucial for Uber Freight. This is why the Carrier Scorecard was developed, with several metrics including on-time pickup/delivery, tracking automation, and late cancellations.
-
Unraveling Techno-Solutionism: How I Fell out of Love with “Ethical” Machine Learning
At the recent QCon San Francisco conference, Katherine Jarmul gave a talk on unravelling techno-solutionism, in which she explored the inherent bias in AI training datasets, the bias that assumes there will be a technical solution to almost any problem and that those technical solutions will be beneficial for mankind. She posed questions for technologists to consider when building products.
-
AWS Introduces AWS Parameters and Secrets Lambda Extension to Improve Performances and Security
AWS recently announced the Parameters and Secrets Lambda Extension, a new way for developers to retrieve parameters from Systems Manager Parameter Store and secrets from Secrets Manager. The Lambda extension caches parameters and secrets, reducing latency and costs.