InfoQ Homepage Data Lake Content on InfoQ
Presentations
RSS Feed-
From S3 to GPU in One Copy: Rethinking Data Loading for ML Training
Onur Satici discusses Vortex, an open-source columnar file format designed to bypass CPU bottlenecks, enabling ultra-fast S3-to-GPU data streaming and dynamic query pruning at up to 60 Gbps.
-
Efficient Incremental Processing with Netflix Maestro and Apache Iceberg
Jun He discusses how to use an IPS to build more reliable, efficient, and scalable data pipelines, unlocking new data processing patterns.