InfoQ Homepage Hashing Content on InfoQ
News
RSS Feed-
Cloudflare Reclaims 100 TB of RAM by Optimizing Consistent Hashing
Cloudflare recently documented how it reduced the memory footprint of its internal load-balancing service by more than 100 TB by optimizing the Rust implementation of consistent hashing in pingora-ketama. The changes compacted hash-ring entries and used statistical analysis of hash distribution and collision rates to reduce the number of hashes per backend by about 90%.
-
Cursor Uses S3 WAL to Scale Git Storage to More than 300 Pushes per Second
Cursor has introduced Continuity, a Git storage architecture that uses an S3 backed write ahead log as the source of truth. The design turns local NVMe repositories into warm caches and separates replica coordination from consistency. Cursor reports linear read scaling with up to 100 replicas and more than 300 pushes per second with S3 Express One Zone in synthetic tests.
-
Git 2.29 Introduces Experimental Support for SHA-256
The latest version of Git experimentally enables using SHA-256 instead of SHA-1 for file hashing, thus removing a long-standing vulnerability which in principle allowed an attacker to forge a counterfeited repository with a HEAD not distinguishable from the original's.
-
BLAKE3 Is an Extremely Fast, Parallel Cryptographic Hash
BLAKE3 is the most recent evolution of the BLAKE cryptographic hash function. Created by Jack O'Connor, Jean-Philippe Aumasson, Samuel Neves, and Zooko Wilcox-O'Hearn, BLAKE3 combines general purpose cryptographic tree hash bao with BLAKE2 to provide a big performance improvement over SHA-1, SHA-2, SHA-3, and BLAKE2.