InfoQ Homepage Presentations Apache Beam: The Case for Unifying Streaming APIs
Apache Beam: The Case for Unifying Streaming APIs
33:35
Summary
Apache Beam aims to provide a unified stream processing model along with a set of language-specific SDKs for defining and executing complex data processing, data ingestion and integration workflows. This will simplify how we implement and think about large-scale batch and streaming data processing. Pipelines can be run on Apache Flink, Apache Spark, and Google Cloud Dataflow with more to come.
Bio
Andrew Psaltis has a wealth of experience in software design and in the construction of large-scale data-intensive systems. He is deeply entrenched in streaming systems and obsessed with delivering insight at the speed of thought. He is the author of Streaming Data by Manning and an international speaker and trainer.
About the conference
Software is changing the world. QCon empowers software development by facilitating the spread of knowledge and innovation in the developer community. A practitioner-driven conference, QCon is designed for technical team leads, architects, engineering directors, and project managers who influence innovation in their teams.
Jul 30, 2016