InfoQ Homepage AI, ML & Data Engineering Content on InfoQ
-
Google Introduces Cloud Storage Connector for Hadoop Big Data Workloads
In a recent blog post, Google announced a new Cloud Storage connector for Hadoop. This new capability allows organizations to substitute their traditional HDFS with Google Cloud Storage. Columnar file formats such as Parquet and ORC may realize increased throughput, and customers will benefit from Cloud Storage directory isolation, lower latency, increased parallelization and intelligent defaults
-
Waymo Shares Autonomous Vehicle Dataset for Machine Learning
Waymo, the self-driving technology company, released a dataset containing sensor data collected by their autonomous vehicles during more than five hours of driving. The set contains high-resolution data from lidar and camera sensors collected in several urban and suburban environments in a wide variety of driving conditions and includes labels for vehicles, pedestrians, cyclists, and signage.
-
Introducing KiloGram, a New Technique for AI Detection of Malware
A team of researchers recently presented their paper on KiloGram, a new algorithm for managing large n-grams in files, to improve machine-learning detection of malware. The new algorithm is 60x faster than previous methods and can handle n-grams for n=1024 or higher. The large values of n have additional application for interpretable malware analysis and signature generation.
-
How Artificial Intelligence Impacts Designing Products
Artificial intelligence is changing the way that we interact with technology; eliminating unnecessary interfaces makes interaction with machines more humane, argued Agnieszka Walorska at ACE conference 2019. The expectations towards customer experience have changed, and one factor that is becoming more and more important to this change is machine learning.
-
New Technique Speeds up Deep-Learning Inference on TensorFlow by 2x
Researchers at North Carolina State University recently presented a paper at the International Conference on Supercomputing (ICS) on their new technique, "deep reuse" (DR), that can speed up inference time for deep-learning neural networks running on TensorFlow by up to 2x, with almost no loss of accuracy.
-
Predicting the Future, Amazon Forecast Reaches General Availability
In a recent blog post, Amazon announced the general availability (GA) of Amazon Forecast, a fully managed, time series data forecasting service. Amazon Forecast uses deep learning from multiple datasets and algorithms to make predictions in the areas of product demand, travel demand, financial planning, SAP and Oracle supply chain planning and cloud computing usage.
-
Google Open-Sources Real-Time Hand Tracking for Android and iOS
Google has open-sourced a new component for its MediaPipe framework aimed to bring real-time hand detection and tracking to mobile devices.
-
QCon San Francisco '19: Track Hosts from WeWork, Microsoft, Tesla Focus on Architecture, ML, Culture
Registrations for the 13th annual QCon San Francisco (Nov 11-15, 2019) are off to a great start. With less than 15 weeks until the conference, and savings of $645 before the early bird ends on August 24th, there is no better time to reserve your spot for this professional software development conference.
-
Facebook and University Researchers Developing Mind-Reading System
As part of a Facebook Reality Labs (FRL) brain-computer interface (BCI) research program called Project Steno, a team of scientists from the University of California, San Francisco (UCSF) described their work on converting brain waves into a text transcription of speech. The goal of Facebook's project is a device that allows users to "type" by imagining themselves speaking.
-
The Inaugural JakartaOne Virtual Conference Goes Lives with the Release of Jakarta EE 8
The inaugural JakartaOne Livestream virtual conference, scheduled with the release of Jakarta EE 8, will go live on September 10th, 2019 with the first of 19 one-hour sessions at 7:00am EDT. Focused on Jakarta EE- and MicroProfile-related topics, these sessions include keynotes, demos and panel discussions. Reza Rahman, principal program manager at Microsoft, spoke to InfoQ about this event.
-
University Research Teams Open-Source Natural Adversarial Image DataSet for Computer-Vision AI
Research teams from three universities recently released a dataset called ImageNet-A, containing natural adversarial images: real-world images that are misclassified by image-recognition AI. When used as a test-set on several state-of-the-art pre-trained models, the models achieve an accuracy rate of less than 3%.
-
Amazon Releases AWS Lake Formation to General Availability
Recently, Amazon announced the general availability (GA) of AWS Lake Formation, a fully managed service that makes it much easier for customers to build, secure, and manage data lakes.
-
Data Engineering in Badoo: Handling 20 Billion Events Per Day
Badoo is a dating social network that currently handles billions of events per day, explains Vladimir Kazanov, data platform engineering lead. At Skills Matter, he talked through some of the challenges of operating at this scale, and what tooling Badoo uses in order to process and report on this data.
-
Microsoft Open-Sources TensorWatch AI Debugging Tool
Microsoft Research open-sourced TensorWatch, their debugging tool for AI and deep-learning. TensorWatch supports PyTorch as well as TensorFlow eager tensors, and allows developers to interactively debug training jobs in real-time via Jupyter notebooks, or to build their own custom UIs in Python.
-
Baidu Open-Sources ERNIE 2.0, Beats BERT in Natural Language Processing Tasks
In a recent blog post, Baidu, the Chinese search engine and e-commerce giant, announced their latest open-source, natural language understanding framework called ERNIE 2.0. They also shared recent test results including achieving state-of-the art (SOTA) results and outperforming existing frameworks, including Google’s BERT and XLNet in 16 NLP tasks in both Chinese and English.