InfoQ Homepage Infrastructure Content on InfoQ
-
In-Memory Caching: Curb Tail Latency with Pelikan
Yao Yue introduces Pelikan - a framework to implement distributed caches such as Memcached and Redis. She discusses the system aspects that are important to the performance of such services.
/presentations/pelikan-distributed-caching/en/mediumimage/Yaobig.JPG)
-
Data Preparation for Data Science: A Field Guide
Casey Stella presents a utility written with Apache Spark to automate data preparation, discovering missing values, values with skewed distributions and discovering likely errors within data.
/presentations/tool-data-preparation/en/mediumimage/Casbig.JPG)
-
Challenging Perceptions of NHS IT
Edward Hiley, Dan Rathbone talk about how NHS Digital has built a highly secure and resilient system for processing patient data, applying techniques more often used in the cloud to bare metal servers
/presentations/nhs-digital-immutability-scalability/en/mediumimage/doibig.JPG)
-
AI from an Investment Perspective
The panelists discuss AI from an investment perspective, the challenges, the risks, trends, the role of Deep Learning, successful AI use cases, and more.
/presentations/ai-investment/en/mediumimage/Panelbig.jpg)
-
Testing Programmable Infrastructure with Ruby
Matt Long talks about some approaches to environment infrastructure testing that his team at OpenCredo has created using Ruby.
/presentations/opencredo-ruby/en/mediumimage/Matbig.JPG)
-
Causal Consistency for Large Neo4j Clusters
Jim Webber explores the new Causal clustering architecture for Neo4j, how it allows users to read writes straightforwardly, explaining why this is difficult to achieve in distributed systems.
/presentations/causal-clustering-neo4j/en/mediumimage/Jimbig.JPG)
-
Big Data Infrastructure @ LinkedIn
Shirshanka Das describes LinkedIn’s Big Data Infrastructure and its evolution through the years, including details on the motivation and architecture of Gobblin, Pinot and WhereHows.
/presentations/big-data-infrastructure-linkedin/en/mediumimage/Shibig.JPG)
-
Real-Time Recommendations Using Spark Streaming
Elliot Chow discusses the data pipeline that they built with Kafka, Spark Streaming, and Cassandra to process Netflix user activities in real time for the Trending Now row.
/presentations/netflix-recommendation-spark/en/mediumimage/Ellbig.JPG)
-
Building a Data Science Capability from Scratch
Victor Hu covers the challenges, both technical and cultural, of building a data science team and capability in a large, global company.
/presentations/building-data-science/en/mediumimage/Vicbig.JPG)
-
Data Science in the Cloud @StitchFix
Stefan Krawczyk discusses how StitchFix used the cloud to enable over 80 data scientists to be productive and have easy access, covering prototyping, algorithms used, keeping schema in sync, etc.
/presentations/stitchfix-cloud/en/mediumimage/STebig.JPG)
-
Petabytes Scale Analytics Infrastructure @Netflix
Tom Gianos and Dan Weeks discuss Netflix' overall big data platform architecture, focusing on Storage and Orchestration, and how they use Parquet on AWS S3 as their data warehouse storage layer.
/presentations/netflix-big-data-infrastructure/en/mediumimage/doiBIG.JPG)
-
Big Data in the Real World: Technology and Use Cases
Mike Olson presents several use cases where big data is collected and analyzed to gather insights from the automotive, insurance, financial, and other sectors.
/presentations/big-data-use-cases/en/mediumimage/Mikebig.JPG)