Joseph Paulchell discusses the journey from batch-oriented processes using databases to a real-time data streaming solution and the significant benefits achieved. He describes challenges on this journey including connecting to our HDFS cluster, working with multiple Mongo stores, using Kerberos, and ensuring protection and encryption of sensitive data end-to-end.
Joseph Paulchell is Lead Software Engineer, Senior Manager and Architect. He leads a team of engineers implementing new framework capabilities, Spring XD use cases, and UI components.
This is a one-of-a-kind conference for application developers, solution and data architects: people who develop business applications, create multi-device aware web applications, process vast quantities of enterprise data, design cloud architectures, and manage high performance infrastructure. The sessions are specifically tailored for Developers and Architects using the popular open source Spring IO Projects, Groovy & Grails, Cloud Foundry, RabbitMQ, Redis, Geode, Hadoop and Tomcat technologies. Whether you're building mission-critical web or business applications, crunching huge amounts of distributed data, or designing the next killer cloud native application, SpringOne2GX will keep you up to date with the latest enterprise technology.
BI snapshot reporting from event streams
I was wondering if you could expand on how you're using Tableau/BI tools. Is this still based on an ETL process (presumably to combine streams), or something like Drill?