Facilitating the Spread of Knowledge and Innovation in Professional Software Development

Write for InfoQ


Choose your language

InfoQ Homepage Presentations Lessons Learned Building Storm

Lessons Learned Building Storm



Nathan Marz shares lessons learned building Storm, an open-source, distributed, real-time computation system.


Nathan Marz is currently working on a new startup. He was the lead engineer at BackType before being acquired by Twitter in 2011. At Twitter, he started the streaming compute team which provides and develops shared infrastructure to support many critical real-time applications throughout the company. Nathan is the creator of many open source projects, including projects such as Cascalog and Storm.

About the conference

Software is Changing the World. QCon empowers software development by facilitating the spread of knowledge and innovation in the developer community. A practitioner-driven conference, QCon is designed for technical team leads, architects, engineering directors, and project managers who influence innovation in their teams.

Recorded at:

Aug 11, 2013

Hello stranger!

You need to Register an InfoQ account or or login to post comments. But there's so much more behind being registered.

Get the most out of the InfoQ experience.

Allowed html: a,b,br,blockquote,i,li,pre,u,ul,p

Community comments

  • Not a hater either

    by Arturo Hernandez,

    Your message is awaiting moderation. Thank you for participating in the discussion.

    For people like me that have used SQL for a very long time, is clear that the heroic effort of ORM writers has not been awarded with good results. I'd say that the biggest shortcoming of SQL technology is that it doesn't do the whole work. I mean SQL code is not only parsed/compiled but is decomposed, analyzed to produce an execution plan. When was the last time C++, Haskell or any language created an execution plan!? Never! Oracle goes so far as to statistically analyze my data and then deciding if an index does not have enough values to be useful. I don't think we need an ORM, we don't need to map, we need an "SQL extender". We need to write more code with less execution information, and in consequence we need more automatic execution planners. Something that we can write code and do statistical analysis on my network latency so it can decide what to reduce first. If I only had time!!!

  • Re: Not a hater either

    by Arturo Hernandez,

    Your message is awaiting moderation. Thank you for participating in the discussion.

    Sorry, previous comment belongs to a different presentation., it can be removed.

Allowed html: a,b,br,blockquote,i,li,pre,u,ul,p

Allowed html: a,b,br,blockquote,i,li,pre,u,ul,p