Facilitating the Spread of Knowledge and Innovation in Professional Software Development

Write for InfoQ


Choose your language

InfoQ Homepage Presentations Lambda Architectures in Practice

Lambda Architectures in Practice



Gian Merlino presents the advantages, challenges, and best practices to deploying and maintaining lambda architectures in the real world, using the infrastructure at Metamarkets as a case study.


Gian Merlino is a senior software engineer at Metamarkets, responsible for the infrastructure behind its data ingestion pipelines and is a committer on the Druid project.

About the conference

Software is Changing the World. QCon empowers software development by facilitating the spread of knowledge and innovation in the developer community. A practitioner-driven conference, QCon is designed for technical team leads, architects, engineering directors, and project managers who influence innovation in their teams.

Recorded at:

Mar 22, 2015

Hello stranger!

You need to Register an InfoQ account or or login to post comments. But there's so much more behind being registered.

Get the most out of the InfoQ experience.

Allowed html: a,b,br,blockquote,i,li,pre,u,ul,p

Community comments

  • Are there closed-source alternatives which fare any better?

    by Jonathan Woods,

    Your message is awaiting moderation. Thank you for participating in the discussion.

    Really enjoyed the presentation, Gian. I can see it saving huge swathes of time for people looking at similar problems.

    At the moment I'm working at a large UK organisation which is looking to replace large-scale log processing infrastructure with a more generic event processing solution. I fear they may choose a costly closed source solution just because that's what enterprises do, though I know that Kafka etc are in the mix. Clearly their particular requirements are different from yours, but I wonder: are the shortcomings you've highlighted in the open source stable addressed by anything in the closed source world, to your knowledge, or do they reflect the state of play in large scale event processing in general?

Allowed html: a,b,br,blockquote,i,li,pre,u,ul,p

Allowed html: a,b,br,blockquote,i,li,pre,u,ul,p