InfoQ Homepage AI, ML & Data Engineering Content on InfoQ
-
LinkedIn Details Open-Sourced Kafka Monitor
LinkedIn recently detailed open-sourced Kafka Monitor service that they're using to monitor production Kafka clusters as well as extensive testing automation, leading them to identify bugs in the main Kafka trunk and contribute solutions to the open-source community.
-
Spring Releases Version 1.1 Statemachine Framework
Spring releases version 1.1 of their state machine framework, dubbed Statemachine, featuring support for Spring Security, built-in support for Redis, and support for UI modeling.
-
Confluent Platform 3.0 Supports Kafka Streams for Real-Time Data Processing
Confluent Platform 3.0 messaging system from Confluent, the company behind Apache Kafka messaging framework, supports Kafka Streams for real-time data processing. The company announced last week the general availability of the latest version of the open source Confluent platform.
-
Combine SQL Server with Hadoop Using PolyBase
With the recently released SQL Server 2016, you can now use SQL queries against Hadoop and Azure blob storage. Not only do you no longer need to write map/reduce operations, you can also join relational and non-relational data with a single query.
-
Cloudera Announces Partnership with the Broad Institute
Cloudera announced their partnership with MIT & Harvard's Broad Institute and detailed some of their experience with the Genome Analytics Toolkit pipeline.
-
Apache Spark 2.0 Technical Preview
Two years after the first release of Apache Spark, Databricks announced the technical preview of Apache Spark 2.0 , based on upstream branch 2.0.0-preview. The preview is not ready for production, neither in terms of stability nor API, but is a release intended to gather feedback from the community ahead of the general availability of the release.
-
AWS Launches Massive X1 Instances Targeting High Memory Workloads
AWS recently added a new instance type with nearly 2 terabytes of memory and 128 virtual CPUs. This is the largest virtual server available today in the public cloud, and is a target for memory-intensive workloads such as SAP HANA.
-
Google Details New TensorFlow Optimized ASIC
The machine learning and engineering communities weigh in on news of Google's new TensorFlow optimized processor, the TPU and possibly influence several industry leaders in the hardware space like Intel and Nvidia.
-
Precision Medicine Modeling Demonstration with Spark on EMR, ADAM, and the 1000 Genomes Project
AWS engineers Christopher Crosbie and Ujjwal Ratan detail using Spark on EMR for precision medicine data analysis on the ADAM platform with data from the 1000 genomes project.
-
3 weeks until QCon New York: New Talks, Podcasts, & Workshops
Marking its 5th anniversary, QCon New York returns June 13-15. This is QCon New York’s last year holding the event in Brooklyn. Next year, QCon moves to a new venue in Manhattan.
-
The Broad Institute Migrates Genome Sequencing Pipeline to Google Cloud Platform
Genomic data sequencing and subsequent analysis faces large data volume challenges that several organizations are solving with cloud services. The Broad Institute detailed their experience with petabyte scale sequencing pipelines last month through the Google Research Blog and is detailed here by InfoQ.
-
Buddy Presents IoT-Enabled Lego City at Internet Of Things World 2016
The third Internet of Things World Conference took place in Santa Clara, California, USA on May 10-12. The star of the exhibition hall may have been the Australian start-up Buddy's booth, which presented a demo of Buddyville, a smart city built with 13,000 Lego pieces, its power monitored by IoT smart sensors and managed by the Buddy Platform's scalable backend data services technology.
-
QCon SF 2016 Registrations Open, Program Committee Announced, & Last year’s Top 10 Lists
The 10th Annual QCon San Francisco, a practitioner-driven conference designed for software architects/tech leads/leaders who influence innovation in their teams, has opened registrations. QCon SF will be held at the Hyatt Regency San Francisco and has tickets on sale for $1695 through May 14th. There will be a full 3-day conference from Nov 7-9 and two days of workshops from Nov 10-11.
-
Lessons Learned from Eight Years of Using NoSQL
NoSQL database adoption in a large organization takes significant effort and time for the transition from using relational database models to NoSQL databases. Mike Bowers, Enterprise Data Architect at LDS Church, spoke at the recent Enterprise Data World Conference about lessons learned from eight years of using NoSQL databases.
-
Deep Mind Discloses Details to InfoQ about NHS Partnership amid Reports of Vast Patient Data Access
After months of awaiting details about the NHS and Google DeepMind partnership InfoQ gains insights into recent claims of widespread patient data access.