BT
AI, ML & Data Engineering Follow 1058 Followers

Agile Data Modeling for NoSQL Databases

by Srini Penchikala Follow 40 Followers on  Oct 30, 2018

Pascal Desmarets recently spoke at Data Architecture Summit 2018 Conference about agile modeling and best practices for NoSQL databases.

AI, ML & Data Engineering Follow 1058 Followers

A Team's Transformation from Software Development to ML: Golestan Radwan at QCon NY

by Srini Penchikala Follow 40 Followers on  Jul 12, 2018

As companies start to add Big Data and Machine Learning initiatives to their project portfolios, they face several challenges including the teams' transition from software engineering to data engineering and machine learning. Golestan "Sally" Radwan spoke at QCon New York 2018 Conference about her experience in leading a traditional software engineering team on a machine learning/AI journey.

AI, ML & Data Engineering Follow 1058 Followers

Distributed Messaging Framework Apache Pulsar 2.0 Supports Schema Registry and Topic Compaction

by Srini Penchikala Follow 40 Followers on  Jun 25, 2018

The latest version of open-source distributed pub-sub messaging framework Apache Pulsar enables companies to move “beyond batch” by acting on data in motion. Streamlio recently announced the availability of Apache Pulsar 2.0 streaming messaging solution. The new version supports Pulsar Functions, Schema Registry and Topic Compaction.

AI, ML & Data Engineering Follow 1058 Followers

eBay's Accelerator Data Processing Framework Provides Parallel Execution and Live Recommendations

by Srini Penchikala Follow 40 Followers on  May 31, 2018

eBay's Accelerator data processing framework provides parallel execution and automatic organization of source code, input data, and results. It can be used for data analysis, and algorithm development, as well as a live recommendation system.

AI, ML & Data Engineering Follow 1058 Followers

PayPal's Gimel Analytics Platform Provides Unified Data API and GSQL

by Srini Penchikala Follow 40 Followers on  Apr 17, 2018

Romit Mehta and Deepak Chandramouli from PayPal spoke at the recent QCon.ai Conference  about Gimel data analytics platform and how it can be used to commoditize data access. InfoQ spoke with Mehta and Chandramouli about the data platform and its support in the areas of security, 

AI, ML & Data Engineering Follow 1058 Followers

Fighting Financial Fraud with Machine Learning at Airbnb

by Srini Penchikala Follow 40 Followers on  Mar 20, 2018

Airbnb, the online marketplace that matches people who rent out their homes with people who are looking for a place to stay, uses machine learning (ML) techniques to fight financial fraud. They use targeted friction to battle the chargebacks while minimizing impact to good guests using their online reservation system.

DevOps Follow 1010 Followers

XebiaLabs Announce DevOps Intelligence Engine

by Helen Beal Follow 5 Followers on  Nov 29, 2017

XebiaLabs, the developers of Continuous Delivery and DevOps tooling XL Release and XL Deploy, has announced availability of the first release of XL Impact, a goal-based, data-driven recommendation and decision making tool for DevOps organisations. XebiaLabs claims this is the first tool of its kind and the capability is essential for organisations to prove DevOps performance improvements.

AI, ML & Data Engineering Follow 1058 Followers

Confluent Releases KSQL, a Distributed Streaming SQL Engine for Apache Kafka

by Srini Penchikala Follow 40 Followers on  Oct 25, 2017

Confluent released KSQL: interactive, distributed streaming SQL engine for Apache Kafka. KSQL supports stream processing operations like aggregations, joins, windowing, and sessionization on topics in Apache Kafka. Confluent announced the open source streaming SQL engine at the recent Kafka Summit conference.

Cloud Follow 353 Followers

Microsoft Updates AI Services and Tools for Data Scientists and Developers

by Kent Weare Follow 11 Followers on  Sep 30, 2017

At the recent Ignite conference, Microsoft released several updates related to its Artificial Intelligence (AI) services and tools. These updates include the release of the Azure ML Experimentation service, Azure ML Model Management service, Azure ML Workbench and the general availability of Microsoft Cognitive Services.

AI, ML & Data Engineering Follow 1058 Followers

Q&A with Andrew Brust of Datameer Regarding Big Data's Role in AI

by Rags Srinivas Follow 11 Followers on  Jul 31, 2017

Rags Srinivas talks to Datameer's Andrew Brust about the larger role of Big Data in AI and how it's operationalized with SmartAI.

Cloud Follow 353 Followers

Microsoft Updates Azure IoT Platform: Adds Connectivity, Time Series Insights and Edge Analytics

by Kent Weare Follow 11 Followers on  Apr 29, 2017

Microsoft has recently made some announcements regarding their Internet of Things (IoT) capabilities within Azure. Microsoft’s news includes adding a new service called Azure Time Series Insights, additional connectivity platform support for OPC UA/DA and Azure Stream Analytic support on edge devices. In addition, Microsoft also announced a new SaaS-based IoT Solution called Azure IoT Central.

AI, ML & Data Engineering Follow 1058 Followers

Data Preparation Pipelines: Strategy, Options and Tools

by Srini Penchikala Follow 40 Followers on  Apr 16, 2017

Data preparation is an important aspect of data processing and analytics use cases. Business analysts and data scientists spend about 80% of their time gathering and preparing the data rather than analyzing it or developing machine learning models. Kelly Stirman spoke last week at Enterprise Data World 2017 Conference about the data preparation best practices.

AI, ML & Data Engineering Follow 1058 Followers

Julien Le Dem on the Future of Column-Oriented Data Processing with Apache Arrow

by Alexandre Rodrigues Follow 1 Followers on  Dec 08, 2016 1

Julien Le Dem, the PMC chair of the Apache Arrow project, presented on Data Eng Conf NY on the future of column-oriented data processing. Apache Arrow is an open-source standard for columnar in-memory execution. InfoQ interviewed Le Dem to find out the differences between Arrow and Parquet.

AI, ML & Data Engineering Follow 1058 Followers

Microservices and Stream Processing Architecture at Zalando Using Apache Flink

by Srini Penchikala Follow 40 Followers on  Oct 31, 2016 1

Javier Lopez and Mihail Vieru spoke at Reactive Summit 2016 Conference about cloud-based data integration and distribution platform used for stream processing in business intelligence use cases. Their solution is based on technologies such as Flink, Kafka and Elasticsearch.

AI, ML & Data Engineering Follow 1058 Followers

Stream Processing and Lambda Architecture Challenges

by Alexandre Rodrigues Follow 1 Followers on  Oct 19, 2016 4

Lambda architecture has been a popular solution that combines batch and stream processing. Kartik Paramasivam at LinkedIn wrote about how his team addressed stream processing and Lambda architecture challenges using Apache Samza for data processing. The challenges described are the late arrival of events and the processing of duplicated messages.

BT