InfoQ Homepage AI, ML & Data Engineering Content on InfoQ
-
Intelligent Automation on Pace for Explosive Growth, But Organizational Challenges Prevalent
In a recent KPMG study, the professional services organization published a report on the growth of Intelligent Automation. The report suggests that overall spend will reach $232 billion by 2025, compared to $12.4 billion which is spent today. But, this expected growth comes with many challenges, including tool maturity, skilled labor and organizational change management.
-
Microsoft Pushes New Azure Offerings into the High-Performance Computing Market
Microsoft is entering the high-performance computing (HPC) market with their announcement of the general availability of Azure CycleCloud, a tool for creating, managing, operating, and optimizing HPC clusters of any scale in Azure. Furthermore, Microsoft announced it would support NVIDIA GPU Cloud (NGC).
-
Data Artisans Announces Serializable ACID Transactions on Streaming Data
Data Artisans has announced the general availability of Streaming Ledger, which extends Apache Flink with capabilities to perform serializable ACID transactions across tables, keys, and event streams. The patent-pending technology is a proprietary add-on for Flink and allows going beyond the current standard where operations could only consistently work on a single key at a time.
-
California Creates Consumer Privacy Act
California has enacted the California Consumer Privacy Act (CCPA) of 2018 which, starting on January 1, 2020, would grant consumers several rights with respect to information about them that businesses collect, store, sold, and share. This is the first legislation of its kind in the United States.
-
NATS Messaging System Gets Kafka-Like Log API via Liftbridge
Joining the hot event-driven technology space is Liftbridge, an open-source project that extends the NATS messaging system with a scalable, Kafka-like log API. InfoQ spoke to creator Tyler Treat to learn more about the project, and the changing nature of data integration.
-
The Machine Learning Behind Android Pie Smart Linkify API
Last week, Google announced Android 9, codenamed Pie. Android is launching a set of new features, powered by Artificial Intelligence. One of the most important new AI powered features is Android Smart Linkify. This article explores the architecture behind the dual in-device Neural Network powering content understanding in context to generate smart links on any text showing up on an Android phone.
-
Numerical Computing Dynamic Language Julia 1.0 Released
The latest version of Julia, a high-level, high-performance dynamic language for technical computing, supports language API stability and a new built-in package manager. The Julia computing team announced the release of Julia version 1.0 last week at JuliaCon 2018 in London, .
-
New York Creates Task Force to Examine Automated Decision Making
New York City has created an Automated Decision Systems Task Force to demand accountability and transparency in how algorithms are used in city government. The final report of the task force is due in December 2019. This task force is the first in the United States to study this issue.
-
Pymetrics Open-Sources Fairness-Aware Machine Learning Algorithms
Pymetrics, an AI start-up that specializes in providing recruitment services for organizations, has recently open-sourced their bias detection algorithms on Github. The tool, also known as Audit AI, is used to mitigate discriminatory patterns that exist within training data sets which influence or improve the probability of a population being selected by a machine learning algorithm.
-
Google Cloud Platform Release Edge TPU and Cloud IoT Edge
Google announced it would bring two new products to their cloud platform to aid customers in developing and deploying their devices. These products are the Edge TPU, a new hardware chip, and Cloud IoT Edge, an expansion of the Google Cloud AI capability for gateways as well as connected devices.
-
Google Cirq: a Python Open Source Library for Quantum Computing
Cirq aims to make it easier to write, manipulate, and optimize quantum algorithms for noisy intermediate scale quantum (NISQ) computers. Cirq also enables the execution of those programs on a local simulator and is designed to support future quantum hardware and quantum cloud processors.
-
Q&A with Saumitra Buragohain on Hortonworks Data Platform 3.0
InfoQ caught up with Saumitra Buragohain, senior director of Product Management at Hortonworks, regarding Hadoop in general and HDP 3.0 in particular.
-
MongoDB Database Tool, dbKoda, Offers Enhanced User Experience and Performance Lab in Version 1.0
Less than a year after its initial release, Southbank Software recently released a milestone version 1.0 of their flagship product, dbKoda, an open source database development tool for MongoDB. Based on user feedback, the user interface was redesigned to include a variety of new features. Guy Harrison, CTO at Southbank Software, spoke to InfoQ about this latest release.
-
A Team's Transformation from Software Development to ML: Golestan Radwan at QCon NY
As companies start to add Big Data and Machine Learning initiatives to their project portfolios, they face several challenges including the teams' transition from software engineering to data engineering and machine learning. Golestan "Sally" Radwan spoke at QCon New York 2018 Conference about her experience in leading a traditional software engineering team on a machine learning/AI journey.
-
GPUs on Google's Kubernetes Engine Are Now Generally Available
Google announced the general availability of GPUs in their Kubernetes Engine (GKE). Together with the recent GA of 1.10 version of GKE customers can land their machine learning (ML) workloads on to it and leverage the massive processing power of the GPUs.