InfoQ Homepage AI, ML & Data Engineering Content on InfoQ
-
/articles/data-processing-redis-spark-streaming/en/smallimage/real-time-data-processing-logo-small-1557414118420.jpg)
Real-Time Data Processing Using Redis Streams and Apache Spark Structured Streaming
Structured Streaming, introduced with Apache Spark 2.0, delivers a SQL-like interface for streaming data. Redis Streams enables Redis to consume, hold and distribute streaming data between multiple producers and consumers. In this article, author Roshan Kumar walks us through how to process streaming data in real time using Redis and Apache Spark Streaming technologies.
-
/articles/ros-2-gazebo-tutorial/en/smallimage/ros-2-gazebo-tutorial-s-1556869112363.jpeg)
Open Source Robotics: Getting Started with Gazebo and ROS 2
An introduction to Gazebo, a powerful robot simulator that calculates physics, generates sensor data and provides convenient interfaces, and ROS 2, the latest version of the Robot Operating System, which offers familiar tools and capabilities, while expanding to new use cases. Both are open source and used by academia and industry alike.
-
/articles/data-science-organization-framework/en/smallimage/data-science-organization-framework-s-1556565301516.jpeg)
The Data Science Mindset: Six Principles to Build Healthy Data-Driven Organizations
In this article, business and technical leaders will learn methods to assess whether their organization is data-driven and benchmark its data science maturity. They will learn how to use the Healthy Data Science Organization Framework to nurture a data science mindset within the organization.
-
/articles/impact-ethics-conversational-ai/en/smallimage/impact-ethics-conversational-ai-S-1553848635642.jpeg)
The Impact and Ethics of Conversational Artificial Intelligence
Improvements in natural language understanding and our changing relationship means we can use chatbots in ways we couldn’t before - both to augment human conversation and support, or indeed, to replace it. Those working in the software industry must understand and take responsibility for how we use Conversational AI and our users' data.
-
/articles/test-automation-ai-ml/en/smallimage/test-automation-ai-ml-s-1549400167942.jpeg)
Test Automation in the World of AI & ML
An in-depth look at the criteria & requirements for Functional Test Automation in the agile world, and the capabilities you should build in your custom framework, or should exist the tools you choose. Anand Bagmar explores aspects like readability, reuse, debugging / rca, CI, Test Data, Parallel Execution, integration with other tools & libraries, free Vs open-source and support.
-
/articles/patient-care-stream-processing/en/smallimage/patient-care-stream-processing-s-1547626914062.jpeg)
Increasing the Quality of Patient Care through Stream Processing
Today’s healthcare technology landscape is disaggregated and siloed. Physicians analyse patient data streams from different systems without much correlation. Even though health-tech domain is mature and rich with data, the value of it is not directed towards increasing the quality of patient care. This article presents a stream processing solution in which streams are co-related.
-
/articles/distributed-stream-processor-container/en/smallimage/distributed-stream-processor-container-s-1547155264550.jpeg)
Scaling a Distributed Stream Processor in a Containerized Environment
The article presents our experience of scaling a distributed stream processor in Kubernetes. The stream processor should provide support for maintaining the optimal level of parallelism. However, adding more resources incurs additional cost and also it does not guarantee performance improvements. Instead, the stream processor should identify the level of resource requirement and scale accordingly.
-
/articles/challenges-of-data-preparation-for-predictive-maintenance/en/smallimage/spark-logo-s-1546543470140.jpeg)
Conquering the Challenges of Data Preparation for Predictive Maintenance
Predictive maintenance (PdM) applications aim to apply machine learning (ML) on IIoT datasets in order to reduce occupational hazards, machine downtime, and other costs. In this article, the author addresses some of the data preparation challenges faced by the industrial practitioners of ML and the solutions for data ingest and feature engineering related to PdM.
-
/articles/book-review-optimizing-java/en/smallimage/optimizing-java-s-1546047255686.jpeg)
Book Review: Optimizing Java
InfoQ reviewed the book Optimizing Java, a comprehensive in-depth look at performance tuning in the Java programming language written by Java industry experts, Ben Evans, James Gough and Chris Newland. InfoQ spoke to the authors for more insights on their experiences, learnings and obstacles in authoring this book.
-
/articles/qcon-san-francisco-2018/en/smallimage/qcon-new-york-2018-1545602449216.jpg)
Key Takeaway Points and Lessons Learned from QCon San Francisco 2018
This year around 1,600 attendees descended on the Hyatt Regency in San Francisco for the twelfth annual QCon. Software engineers, architects, and project managers from a wide range of industries including some prominent Bay-area companies - attended 99 technical sessions across 6 concurrent tracks, 13 ask me anything sessions with speakers, 18 in-depth workshops, and 8 facilitated open spaces.
-
/articles/infoq-2018-retrospective/en/smallimage/logo-InfoQ-1545203268727.jpg)
InfoQ’s 2018, and What We Expect to See in 2019
We take a look back at what we say on infoQ in 2018, and think about what the next year might bring.
-
/articles/infoq-editor-recommended-reading-part-two/en/smallimage/infoq-editor-recommended-reading-part-two-s-1545062692174.jpeg)
The 2018 InfoQ Editors’ Recommended Reading List: Part Two
As part of our core values of sharing knowledge, the InfoQ editors were keen to capture and share our book and article recommendations for 2018, so that others can benefit from this too. In this second part we are sharing the final batch of recommendations