InfoQ Homepage AI, ML & Data Engineering Content on InfoQ
-
/articles/machine-learning-learn-devops/en/smallimage/machine-learning-learn-devops-s-1544716403154.jpeg)
What Machine Learning Can Learn from DevOps
The fact that machine learning development focuses on hyperparameter tuning and data pipelines does not mean that we need to reinvent the wheel or look for a completely new way. According to Thiago de Faria, DevOps lays a strong foundation: culture change to support experimentation, continuous evaluation, sharing, abstraction layers, observability, and working in products and services.
-
/articles/analytics-zoo/en/smallimage/analytics-zoo-s-1544204138443.jpeg)
Analytics Zoo: Unified Analytics + AI Platform for Distributed Tensorflow, and BigDL on Apache Spark
In this article we described how Analytics Zoo can help real-world users to build end-to-end deep learning pipelines for big data, including unified pipelines for distributed TensorFlow and Keras on Apache Spark, easy-to-use abstractions such as transfer learning and Spark ML pipeline support, built-in deep learning models and reference use cases, etc.
-
/articles/relational-nosql-fauna/en/smallimage/relational-nosql-fauna-s-1543858323385.jpeg)
Back to the Future with Relational NoSQL
This article outlines some of the consistency issues NoSQL databases have with distributed transactions, showing how FaunaDB has solved the problems using the Calvin protocol and a virtual clock.
-
/articles/sentiment-analysis-whats-with-the-tone/en/smallimage/sentiment-analysis-whats-with-the-tone-s-1543275808291.jpeg)
Sentiment Analysis: What's with the Tone?
Sentiment analysis is widely applied in voice of the customer (VOC) applications. In this article, the authors discuss NLP-based Sentiment Analysis based on machine learning (ML) and lexicon-based approaches using KNIME data analysis tools.
-
/articles/spark-application-monitoring-influxdb-grafana/en/smallimage/spark-application-monitoring-influxdb-grafana-s-1542381806762.jpeg)
Spark Application Performance Monitoring Using Uber JVM Profiler, InfluxDB and Grafana
In this article, author Amit Baghel discusses how to monitor the performance of Apache Spark based applications using technologies like Uber JVM Profiler, InfluxDB database and Grafana data visualization tool.
-
/articles/nielson-blockchain-for-data-governance/en/smallimage/nielson-blockchain-for-data-governance-s-1541287000988.jpeg)
Seth James Nielson on Blockchain Technology for Data Governance
Seth James Nielson recently hosted a tutorial workshop at Data Architecture Summit 2018 Conference about Blockchain technology and its impact on data architecture and data governance.
-
/articles/apache-kafka-best-practices-to-optimize-your-deployment/en/smallimage/apache-kafka-best-practices-to-optimize-your-deployment-s-1539792752614.jpeg)
Apache Kafka: Ten Best Practices to Optimize Your Deployment
Author Ben Bromhead discusses the latest Kafka best practices for developers to manage the data streaming platform more effectively. Best practices include log configuration, proper hardware usage, Zookeeper configuration, replication factor, and partition count.
-
/articles/natural-language-processing-with-java-book-review/en/smallimage/natural-language-processing-with-java-book-review-1539035529033.jpg)
Natural Language Processing with Java - Second Edition: Book Review and Interview
Natural Language Processing with Java - Second Edition book covers the Natural Language Processing (NLP) topic and various tools developers can use in their applications. Technologies discussed in the book include Apache OpenNLP and Stanford NLP. InfoQ spoke with co-author Richard Reese about the book and how NLP can be used in enterprise applications.
-
/articles/infoq-editor-recommended-reading/en/smallimage/infoq-editor-recommended-reading-s-1537828178129.jpeg)
The 2018 InfoQ Editors’ Recommended Reading List: Part One
As part of our core values of sharing knowledge, the InfoQ editor team has listed and commented on their most recent recommended reading.
-
/articles/democratizing-stream-processing-kafka-ksql-part2/en/smallimage/Democratizing-Stream-Processing-Apache-Kafka-KSQL-Part-2-logo-small-1536080637584.jpg)
Democratizing Stream Processing with Apache Kafka® and KSQL - Part 2
In this article, author Robin Moffatt shows how to use Apache Kafka and KSQL to build data integration and processing applications with the help of an e-commerce sample application. Three use cases discussed: customer operations, operational dashboard, and ad-hoc analytics.
-
/articles/how-to-choose-stream-processor/en/smallimage/how-to-choose-stream-processor-logo-1534706730559.jpeg)
How to Choose a Stream Processor for Your App
Choosing a stream processor for your app can be challenging with many options to choose from. The best choice depends on individual use cases. In this article, the authors discuss a stream processor reference architecture, key features required by most streaming applications and optional features that can be selected based on specific use cases.
-
/articles/machine-learning-unconscious-bias/en/smallimage/analyzing-and-preventing-unconscious-bias-in-machine-learning-s-1534197829508.jpeg)
Analyzing and Preventing Unconscious Bias in Machine Learning
This article is based on Rachel Thomas’s keynote presentation, “Analyzing & Preventing Unconscious Bias in Machine Learning” at QCon.ai 2018. Thomas talks about the pitfalls and risk the bias in machine learning brings to the decision-making process. She discusses three use cases of machine learning bias.