BT

Facilitating the Spread of Knowledge and Innovation in Professional Software Development

Write for InfoQ
News Articles Presentations Podcasts Guides

Topics

Choose your language

QCon New York

Find real-world practical inspiration from the world’s most innovative software leaders. Attend in-person or online.
QCon San Francisco

Learn what's next in software from world-class leaders pushing the boundaries. Attend in-person or online.
The Software Architects' Newsletter

Your monthly guide to all the topics, technologies and techniques that every professional needs to know about. Subscribe for free.

InfoQ Homepage Presentations Stream Processing: Philosophy, Concepts, and Technologies

Building field-level lineage for modern data systems (Live Webinar Apr 13, 2023) - Save Your Seat

Stream Processing: Philosophy, Concepts, and Technologies

Bookmarks
42:04

Summary

Dan Frank discusses stream data processing and introduces NSQ – Bitly’s open source queuing system – and other new technologies used for communication between streaming programs.

Bio

Dan Frank grew up in Brooklyn, with the mathematical distinction of occupying the zip code corresponding to the first five digits of the Fibonacci sequence. He earned a degree in Math from Yale, and has since been working as a developer at small startups that process large quantities of data. He is currently a member of the data science and infrastructure engineering teams at Bitly.

About the conference

The ETE Conference has established itself as the most diverse and interesting conference on the East Coast. Curated by developers, for developers, it brings together the brightest minds in software development. Visit emergingtech.chariotsolutions.com we provide content throughout the year and you can subscribe to our Chariot TechCast podcast.

Recorded at:

Nov 10, 2013

This content is in the Database topic

Related Topics:

Hello stranger!

You need to Register an InfoQ account or or login to post comments. But there's so much more behind being registered.

Get the most out of the InfoQ experience.

Allowed html: a,b,br,blockquote,i,li,pre,u,ul,p

Community comments

  • There's so much prior art

    by peter lin,

    Your message is awaiting moderation. Thank you for participating in the discussion.

    Why do people ignore prior art and research? Event processing, and stream processing are techniques used to build event based architectures. Not all event processing problems are sequential messages. Topics like temporal logic, event correlation, partially ordered sets and totally ordered sets are critical aspects of solving event related problems.

    The research goes back decades and lots of it came out of AI research. People should keep in mind that often times order affects the processing and analytics. Proper discussion of event processing should at minimum touch on these important aspects.

    Back to top

Allowed html: a,b,br,blockquote,i,li,pre,u,ul,p

Allowed html: a,b,br,blockquote,i,li,pre,u,ul,p

BT