InfoQ Homepage AI, ML & Data Engineering Content on InfoQ
-
Ocado Uses TensorFlow and Google Cloud Platform for Novel Customer Service Approach
Ocado Technology uses TensorFlow to categorize customer emails for automated support queue categorization and prioritization for the goals of quick response time and avoiding impersonal support bots often used with large customer volumes and finite support resources.
-
CommAI, a Training and Testing AI System by Facebook
Facebook recently announced CommAI-env, a platform for training and evaluating an AI system. Inspired by A roadmap towards Machine Intelligence the system aims for teaching intelligent agents general learning capabilities that would serve as the groundwork for further, more specialized training by human or machine level interaction. The article provides a high level overview of current state and..
-
Stream Processing and Lambda Architecture Challenges
Lambda architecture has been a popular solution that combines batch and stream processing. Kartik Paramasivam at LinkedIn wrote about how his team addressed stream processing and Lambda architecture challenges using Apache Samza for data processing. The challenges described are the late arrival of events and the processing of duplicated messages.
-
Jay Kreps on Distributed Stream Processing with Apache Kafka and Kafka Streams
Apache Kafka and Kafka Streams frameworks help with developing stream-centric architectures and distributed stream processing applications. Jay Kreps, CEO of Confluent, gave the keynote presentation on stream processing and microservices at Reactive Summit 2016 Conference last week.
-
Reactive Summit 2016 Conference: Reactive Microservices and Staging Data Pipelines
Reactive microservices, data center scale operating system (DCOS), and staging reactive data pipelines were the highlighted topics at Reactive Summit 2016 Conference held this week. InfoQ team attended the conference and this post is a summary of the first day's events at the conference.
-
Confluent Announces Kafka for the Enterprise with Multi-Datacenter Replication
Confluent Enterprise latest version supports multi-datacenter replication, automatic data balancing, and cloud migration capability. Confluent, provider of the Apache Kafka based streaming platform, announced last week the new features for Confluent Enterprise, to help build streaming data pipelines and develop stream processing applications.
-
Twitter Open Sources Stream Processing Engine Heron
InfoQ's Rags Srinivas caught up with Karthik Ramasamy, co-creator and engineering manager at Twitter, regarding the Open Sourcing of the Stream-Processing engine Heron, a successor for Apache Storm.
-
How YouTube's Recommendation Algorithm Works
In a recent paper published by Google, YouTube engineers analyzed in greater detail the inner workings of YouTube’s recommendation algorithm. The paper was presented on the 10th ACM Conference on Recommender Systems last week in Boston. In this news item we analyze how YouTube uses deep learning to operate one of the largest and most complex recommendation systems in industry.
-
Microsoft Pushes the Bot Framework, Google Buys API.ai
Microsoft has made available Bot Framework Preview to developers and Google has purchased API.ai, a bot engine with many integrations.
-
DeepMind Unveils WaveNet - A Deep Neural Network for Speech and Audio Synthesis
DeepMind's WaveNet synthesizes speech and musical audio using parametric text-to-speech (TTS). DeepMind claims to have outperformed some of the leading TTS systems when rated subjectively by a group of test participants in a blind study.
-
Serverless, Microservices, Architecture, Streaming, & Culture Highlighted for QCon SF 2016
QCon San Francisco tracks are heavily focused on architecture, including topics like: Architectures You’ve Always Wondered About, Distributed Systems War Stories, Architecting for Failure, and Next Generation Microservices. You can find tracks focused on Culture, Optimizing You, & Softskills. Additionally, there are tracks that offer deep-dives in areas like DevOps, Security, and Web Tier Apps.
-
Amazon Kinesis Analytics is Like SaaS for Big Data Analysis
Real-time analysis of event streams has a new focus in Big Data platforms, both on-premise and in the cloud. AWS have released Amazon Kinesis Analytics, a rival to Azure StreamAnalytics. Both platforms use a simple SQL language for complex querying, and move Big Data analysis into a SaaS-like space.
-
IBM Creates Artificial Neurons from Phase Change Memory for Cognitive Computing
A team of scientists at IBM Research in Zurich, have created an artificial version of neurons using phase-change materials to store and process data. These phase change based artificial neurons can be used to detect patterns and discover correlations in Big Data (real-time streams of event based data) and unsupervised machine learning at high speeds using very little energy.
-
TensorFlow Learns Cucumber Selection and Classification
Cucumber farmer with embedded systems engineering background teaches TensorFlow neural network to mimic his cucumber-farming family’s classification and selection skills for automation.
-
Getting the Data Needed for Data Science
Data science is about the data that you need; deciding which data to collect, create, or keep is fundamental argues Lukas Vermeer, an experienced Data Science professional and Product Owner for Experimentation at Booking.com. True innovation starts with asking big questions, then it becomes apparent which data is needed to find the answers you seek.