InfoQ Homepage AI, ML & Data Engineering Content on InfoQ
-
/articles/distributed-stream-processor-container/en/smallimage/distributed-stream-processor-container-s-1547155264550.jpeg)
Scaling a Distributed Stream Processor in a Containerized Environment
The article presents our experience of scaling a distributed stream processor in Kubernetes. The stream processor should provide support for maintaining the optimal level of parallelism. However, adding more resources incurs additional cost and also it does not guarantee performance improvements. Instead, the stream processor should identify the level of resource requirement and scale accordingly.
-
/articles/challenges-of-data-preparation-for-predictive-maintenance/en/smallimage/spark-logo-s-1546543470140.jpeg)
Conquering the Challenges of Data Preparation for Predictive Maintenance
Predictive maintenance (PdM) applications aim to apply machine learning (ML) on IIoT datasets in order to reduce occupational hazards, machine downtime, and other costs. In this article, the author addresses some of the data preparation challenges faced by the industrial practitioners of ML and the solutions for data ingest and feature engineering related to PdM.
-
/articles/book-review-optimizing-java/en/smallimage/optimizing-java-s-1546047255686.jpeg)
Book Review: Optimizing Java
InfoQ reviewed the book Optimizing Java, a comprehensive in-depth look at performance tuning in the Java programming language written by Java industry experts, Ben Evans, James Gough and Chris Newland. InfoQ spoke to the authors for more insights on their experiences, learnings and obstacles in authoring this book.
-
/articles/qcon-san-francisco-2018/en/smallimage/qcon-new-york-2018-1545602449216.jpg)
Key Takeaway Points and Lessons Learned from QCon San Francisco 2018
This year around 1,600 attendees descended on the Hyatt Regency in San Francisco for the twelfth annual QCon. Software engineers, architects, and project managers from a wide range of industries including some prominent Bay-area companies - attended 99 technical sessions across 6 concurrent tracks, 13 ask me anything sessions with speakers, 18 in-depth workshops, and 8 facilitated open spaces.
-
/articles/infoq-2018-retrospective/en/smallimage/logo-InfoQ-1545203268727.jpg)
InfoQ’s 2018, and What We Expect to See in 2019
We take a look back at what we say on infoQ in 2018, and think about what the next year might bring.
-
/articles/infoq-editor-recommended-reading-part-two/en/smallimage/infoq-editor-recommended-reading-part-two-s-1545062692174.jpeg)
The 2018 InfoQ Editors’ Recommended Reading List: Part Two
As part of our core values of sharing knowledge, the InfoQ editors were keen to capture and share our book and article recommendations for 2018, so that others can benefit from this too. In this second part we are sharing the final batch of recommendations
-
/articles/machine-learning-learn-devops/en/smallimage/machine-learning-learn-devops-s-1544716403154.jpeg)
What Machine Learning Can Learn from DevOps
The fact that machine learning development focuses on hyperparameter tuning and data pipelines does not mean that we need to reinvent the wheel or look for a completely new way. According to Thiago de Faria, DevOps lays a strong foundation: culture change to support experimentation, continuous evaluation, sharing, abstraction layers, observability, and working in products and services.
-
/articles/analytics-zoo/en/smallimage/analytics-zoo-s-1544204138443.jpeg)
Analytics Zoo: Unified Analytics + AI Platform for Distributed Tensorflow, and BigDL on Apache Spark
In this article we described how Analytics Zoo can help real-world users to build end-to-end deep learning pipelines for big data, including unified pipelines for distributed TensorFlow and Keras on Apache Spark, easy-to-use abstractions such as transfer learning and Spark ML pipeline support, built-in deep learning models and reference use cases, etc.
-
/articles/relational-nosql-fauna/en/smallimage/relational-nosql-fauna-s-1543858323385.jpeg)
Back to the Future with Relational NoSQL
This article outlines some of the consistency issues NoSQL databases have with distributed transactions, showing how FaunaDB has solved the problems using the Calvin protocol and a virtual clock.
-
/articles/sentiment-analysis-whats-with-the-tone/en/smallimage/sentiment-analysis-whats-with-the-tone-s-1543275808291.jpeg)
Sentiment Analysis: What's with the Tone?
Sentiment analysis is widely applied in voice of the customer (VOC) applications. In this article, the authors discuss NLP-based Sentiment Analysis based on machine learning (ML) and lexicon-based approaches using KNIME data analysis tools.
-
/articles/spark-application-monitoring-influxdb-grafana/en/smallimage/spark-application-monitoring-influxdb-grafana-s-1542381806762.jpeg)
Spark Application Performance Monitoring Using Uber JVM Profiler, InfluxDB and Grafana
In this article, author Amit Baghel discusses how to monitor the performance of Apache Spark based applications using technologies like Uber JVM Profiler, InfluxDB database and Grafana data visualization tool.
-
/articles/nielson-blockchain-for-data-governance/en/smallimage/nielson-blockchain-for-data-governance-s-1541287000988.jpeg)
Seth James Nielson on Blockchain Technology for Data Governance
Seth James Nielson recently hosted a tutorial workshop at Data Architecture Summit 2018 Conference about Blockchain technology and its impact on data architecture and data governance.