BT
AI, ML & Data Engineering Follow 816 Followers

A Team's Transformation from Software Development to ML: Golestan Radwan at QCon NY

by Srini Penchikala Follow 34 Followers on  Jul 12, 2018

As companies start to add Big Data and Machine Learning initiatives to their project portfolios, they face several challenges including the teams' transition from software engineering to data engineering and machine learning. Golestan "Sally" Radwan spoke at QCon New York 2018 Conference about her experience in leading a traditional software engineering team on a machine learning/AI journey.

AI, ML & Data Engineering Follow 816 Followers

Distributed Messaging Framework Apache Pulsar 2.0 Supports Schema Registry and Topic Compaction

by Srini Penchikala Follow 34 Followers on  Jun 25, 2018

The latest version of open-source distributed pub-sub messaging framework Apache Pulsar enables companies to move “beyond batch” by acting on data in motion. Streamlio recently announced the availability of Apache Pulsar 2.0 streaming messaging solution. The new version supports Pulsar Functions, Schema Registry and Topic Compaction.

AI, ML & Data Engineering Follow 816 Followers

eBay's Accelerator Data Processing Framework Provides Parallel Execution and Live Recommendations

by Srini Penchikala Follow 34 Followers on  May 31, 2018

eBay's Accelerator data processing framework provides parallel execution and automatic organization of source code, input data, and results. It can be used for data analysis, and algorithm development, as well as a live recommendation system.

AI, ML & Data Engineering Follow 816 Followers

PayPal's Gimel Analytics Platform Provides Unified Data API and GSQL

by Srini Penchikala Follow 34 Followers on  Apr 17, 2018

Romit Mehta and Deepak Chandramouli from PayPal spoke at the recent QCon.ai Conference  about Gimel data analytics platform and how it can be used to commoditize data access. InfoQ spoke with Mehta and Chandramouli about the data platform and its support in the areas of security, 

Architecture & Design Follow 2023 Followers

Chile’s Energy Regulator to Adopt Blockchain

by Kent Weare Follow 9 Followers on  Mar 28, 2018

PV magazine, a publication focused on reporting photovoltaics (solar power generation), has announced the Chile Energy Regulator is set to adopt blockchain in March 2018. The regulator plans to use blockchain technology to transparently record market prices, marginal costs, fuel prices and compliance documentation.

Cloud Follow 266 Followers

Oral Arguments before Supreme Court in Microsoft Cloud Computing Case Focus on Legal Issues

by Michael Stiefel Follow 5 Followers on  Mar 15, 2018

On February 27, 2018, the Supreme Court of the United States heard oral arguments on the Microsoft cloud computing case. A ruling against Microsoft could require companies based in the United States to hand over to law enforcement data stored on foreign servers. U.S. based organizations might then not be able to provide cloud computing services to foreign countries.

Cloud Follow 266 Followers

Managing and Operating Kafka Clusters in Kubernetes

by Srini Penchikala Follow 34 Followers on  Feb 06, 2018

Nenad Bogojevic, platform solutions architect at Amadeus, spoke at KubeCon + CloudNativeCon North America 2017 Conference on how to run and manage Kafka clusters in Kubernetes environment. He talked about provisioning Kafka clusters and configuring them using Kubernetes custom resources or ConfigMaps.

DevOps Follow 766 Followers

DevOps Workbench Launched by ZeroStack

by Helen Beal Follow 5 Followers on  Jan 12, 2018

Private cloud provider, ZeroStack, has announced a self-service capability from which developers can create their own workbenches. Forty developer tools from a mix of open source and commercial providers are available to users of the DevOps Workbench through Zerostack’s Intelligent Cloud Platform.

AI, ML & Data Engineering Follow 816 Followers

Modern Big Data Pipelines over Kubernetes

by Srini Penchikala Follow 34 Followers on  Jan 08, 2018

Container management technologies like Kubernetes make it possible to implement modern big data pipelines. Eliran Bivas, senior big data architect at Iguazio, spoke at the recent KubeCon + CloudNativeCon North America 2017 Conference about big data pipelines and how Kubernetes can help develop them.

AI, ML & Data Engineering Follow 816 Followers

TensorFlow Lite Supports On-Device Conversational Modeling

by Srini Penchikala Follow 34 Followers on  Nov 29, 2017

TensorFlow Lite, the light-weight solution of open source deep learning framework TensorFlow, supports on-device conversation modeling to plugin the conversational intelligence features into chat applications. The TensorFlow team recently announced the release of TensorFlow Lite, which can be used in mobile and embedded devices.

Culture & Methods Follow 622 Followers

Leslie Miley on Bias in Big Data/ML and AI - QCon San Francisco

by Shane Hastie Follow 18 Followers on  Nov 20, 2017 1

At QCon San Francisco Leslie Miley gave a keynote talk in which he explained how inherent bias in data sets have affected things from the 2016 Presidential race to criminal sentencing in the United States.

AI, ML & Data Engineering Follow 816 Followers

Confluent Releases KSQL, a Distributed Streaming SQL Engine for Apache Kafka

by Srini Penchikala Follow 34 Followers on  Oct 25, 2017

Confluent released KSQL: interactive, distributed streaming SQL engine for Apache Kafka. KSQL supports stream processing operations like aggregations, joins, windowing, and sessionization on topics in Apache Kafka. Confluent announced the open source streaming SQL engine at the recent Kafka Summit conference.

Cloud Follow 266 Followers

Microsoft Updates AI Services and Tools for Data Scientists and Developers

by Kent Weare Follow 9 Followers on  Sep 30, 2017

At the recent Ignite conference, Microsoft released several updates related to its Artificial Intelligence (AI) services and tools. These updates include the release of the Azure ML Experimentation service, Azure ML Model Management service, Azure ML Workbench and the general availability of Microsoft Cognitive Services.

AI, ML & Data Engineering Follow 816 Followers

Q&A with Andrew Brust of Datameer Regarding Big Data's Role in AI

by Rags Srinivas Follow 11 Followers on  Jul 31, 2017

Rags Srinivas talks to Datameer's Andrew Brust about the larger role of Big Data in AI and how it's operationalized with SmartAI.

AI, ML & Data Engineering Follow 816 Followers

Researchers Improve State of the Art in Image Recognition Using Data Set with 300 Million Images

by Roland Meertens Follow 7 Followers on  Jul 28, 2017

Researchers improved the state of the art results on several benchmarks with models trained on a generated data set with 300 million images instead of the 1 million normally used. To test what happens with more train data, Google created an internal dataset of 300 million images. They labelled the data automatically in a noisy way. The conclusion is that more training data indeed helps.

Login to InfoQ to interact with what matters most to you.


Recover your password...

Follow

Follow your favorite topics and editors

Quick overview of most important highlights in the industry and on the site.

Like

More signal, less noise

Build your own feed by choosing topics you want to read about and editors you want to hear from.

Notifications

Stay up-to-date

Set up your notifications and don't miss out on content that matters to you

BT