InfoQ Homepage Big Data Content on InfoQ
-
Facebook Publishes New Neural Machine Translation Algorithm
Facebook’s Artificial Intelligence Research team published research results using a new approach for neural machine translation (NMT). Their algorithm scores higher than any other system on three established machine translation tasks.
-
Developing Virtual Assistant Apps with Amazon Lex and Polly Deep Learning Technologies
Greg Bulmash from Amazon spoke at the OSCON 2017 Conference last week about developing your own virtual assistant applications using Amazon's Lex and Polly technologies.
-
Apache Metron Graduates to Top-Level Project
Hortonworks and Apache announce graduation of Metron, a realtime big data security platform to top-level project at the ASF.
-
Confluent Cloud, Apache Kafka as a Service in AWS
Apache Kafka is a distributed, fault-tolerant pub sub messaging soltuion, originally developed by LinkedIn and open sourced. Confluent was formed by former LinkedIn engineers in the Kafka development group and today announced Confluent Cloud, a fully hosted and managed Apache Kafka as a Service in AWS. We also take a look at Confluent's second annual Streaming Data report and its findings.
-
Data Preparation Pipelines: Strategy, Options and Tools
Data preparation is an important aspect of data processing and analytics use cases. Business analysts and data scientists spend about 80% of their time gathering and preparing the data rather than analyzing it or developing machine learning models. Kelly Stirman spoke last week at Enterprise Data World 2017 Conference about the data preparation best practices.
-
Google Announces Cloud Machine Learning API Updates
Google recently announced the Cloud Machine Learning API updates at the Google Cloud Next Conference. This includes a set of APIs in the areas of vision, video intelligence, speech, natural language, translation and job search.
-
Using Deep Learning Technologies IBM Reaches a New Milestone in Speech Recognition
The research team at IBM recently announced they've reached a new industry record at 5.5%, using the SWITCHBOARD linguistic corpus. This brings us closer to what's considered to be the human error rate, 5.1%. They used deep learning technologies and acoustic models to accomplish this milestone.
-
Netflix Demonstrates Big Data Analytics Infrastructure
At QCon San Francisco, engineers at Netflix discussed their big data strategy and analytics infrastructure. This included a summary of the scale of their data, their S3 data warehouse, and Genie, their big data federated orchestration system.
-
Apache Ranger Graduates to Top-Level Project
Apache Ranger, a security management framework for Apache Hadoop ecosystem, graduated to top level. Ranger is used as a centralized component to define and administer security policies that are enforced across supported Hadoop components such as Apache HBase, Hadoop (HDFS and YARN), Apache Hive, Apache Kafka, Apache Solr, among others.
-
Beam Graduates to Top-Level Apache Project
Beam exits incubation period and graduates to top-level Apache project, Google support and contribution to open source integration for various data processing backends and more.
-
Deep Learning at Gilt
Deep Learning is a rapidly evolving subfield of Machine Learning originating from Neural Networks. Recent algorithmic advances and utilization of GPU parallelization have resulted in Deep Learning based algorithms mastering the game of Go as well as several practical applications. The fashion industry is one of the target sectors for Deep Learning. Gilt is using Deep Learning for real world apps
-
Microsoft AirSim, a Simulator for Drones and Robots
Microsoft has developed and open sourced AirSim, a tool that can be used to simulate the flight of drones around the world. The simulator is built on the Unreal Engine and Microsoft will soon add support for robots and other types of vehicles.
-
Apache Flink 1.2 Released with Dynamic Rescaling, Security and Queryable State
Apache Flink 1.2 was announced and features dynamic rescaling, security, queryable state, and more. The release resolved 650 issues, maintains compatibility with all public APIs and ships with Apache Kafka 0.10 and Apache Mesos support. Flink’s dynamic rescaling allows one to change the parallelism of a streaming job or of an operator within the job.
-
MindMeld’s Guide to Building Conversational Apps
MindMeld, a conversational AI company, has published The Conversational AI Playbook, a guide outlining the challenges and the steps to be made to create conversational applications.
-
Apache HBase 1.3 Ships with Multiple Performance Improvements
Apache HBase 1.3.0 was released mid-January 2017 and ships with support for date-based tiered compaction and improvements in multiple areas, like write-ahead log (WAL), and a new RPC scheduler, among others. The release includes almost 1,700 resolved issues in total.