InfoQ Homepage Python Content on InfoQ
-
AWS and Microsoft Working Together on PyWhy, the New Home of Causal ML Library DoWhy
AWS in a joint effort with Microsoft have established PyWhy as a fresh GitHub organization to integrate AWS algorithms into DoWhy, a casual ML library from Microsoft, which has moved to PyWhy.
-
Serving Deep Networks in Production: Balancing Productivity vs Efficiency Tradeoff
A recently published work provides an alternative modality for serving deep neural networks. It enables utilizing eager-mode model code directly at production workloads by using embedded CPython interpreters. The goal is to reduce the engineering effort to bring the models from the research stage to the end-user and to create a proof-of-concept platform for migrating future numerical libraries.
-
Bloomberg Open-Sources Python Memory Profiler Memray
Developed at Bloomberg and now open source, Memray is a memory profiler that can track memory allocations in Python code, including native extensions and in the Python interpreter itself.
-
Securing the Open-Source Software Supply Chain
Recent findings by security researchers at SonarSource showed multiple security vulnerabilities in popular package managers, including Pip, Yarn, Composer, and others. Package managers, though, are not the only weak link in the open source security chain. InfoQ has spoken with Sonatype CTO Brian Fox.
-
New CodeGuru Reviewer Features Detector Library and Security Detectors for Log-Injection Flaws
Amazon CodeGuru Reviewer is a developer tool that leverages machine learning to detect security defects in code (Java and Python) and offers suggestions for code quality improvement. Recently, AWS introduced two new features for the tool, with a new Detector Library and security detectors for Log-Injection Flaws.
-
Google Cloud Python Logging Library Release Improves Serverless Support
Google has announced version 3.0.0 of their Google Cloud Python logging library. The release brings a number of new features including enhanced support for Cloud Run and Cloud Functions, support for string JSON payloads, and automated metadata attachments.
-
PipelineDP Brings Google’s Differential-Privacy Library to Python
Google and OpenMined have released PipelineDP, a new open-source library that allows researchers and developers to apply differentially private aggregations to large datasets using batch-processing systems.
-
Apple Open Sources GCGC: a Tool to Analyze Java GC Logs
Apple has open-sourced GCGC, a tool for Java Garbage Collector (GC) logs visualization based on Python 3 and pandas. GCGC uses a Jupyter notebook to analyze and visualize GC log files.
-
Google Cloud Spanner Dialect for SQLAlchemy is Generally Available
Google Cloud recently announced the general availability of the Spanner dialect enabling SQLAlchemy applications to run on the distributed SQL database management and storage service.
-
Pants Build System Adds Support for Java, Scala, and Go
In its upcoming release, now available to early adopters, build system Pants adds Java, Scala, and Go to previously supported Python. InfoQ has spoken with Benjy Weinberger, one of the creator of Pants alongside John Sirois, and currently CEO of Toolchain, Pants' main sponsor.
-
Apache Spark Brings Pandas API with Version 3.2
The Apache Spark team has integrated the Pandas API in the product's latest 3.2 release. With this change, dataframe processing can be scaled to multiple clusters or multiple processors in a single machine using the PySpark execution engine.
-
TensorFlow Similarity Supports Fast Query Search Index on Pre-trained Models
Francois Chollet and his team recently released a Python library for TensorFlow, called TensorFlow Similarity. Similarity learning is the process of finding similar items, from similar clothes in images to person identification using face pictures. Deep-learning models have used a method called contrastive learning to increase accuracy and efficiency in learning similarity between images.
-
Scikit-learn 1.0 Supports Spline Transformers, Quantile Regression and Improved Plotting API
Scikit-learn, the popular Python-based machine learning (ML) library, has released version 1.0. Although the library has been stable for some time, and the release contains no breaking changes, the project maintainers opted for a major version revision to signal to users that the software is mature and production-ready.
-
OpenAI Releases Triton, Python-Based Programming Language for AI Workload Optimization
OpenAI released their newest language, Triton, an open-source programming language that enables researchers to write highly efficient GPU code for AI workloads. Triton is Python-compatible and allows new users to achieve expert-quality results in only 25 lines of code. The code is written in Python using Triton’s libraries, which are then JIT-compiled to run on the GPU.
-
AWS Announces Python 3.9 Runtime Support for Lambda Functions
Recently AWS announced the support for Python 3.9 as both a managed runtime and a container base image for its Function as a Services (FaaS) offering Lambda. As a result, developers can now author AWS Lambda functions in Python 3.9 and use its new features, such as support for TLS 1.3, new string and dictionary operations, and improved time zone support.