Julien Le Dem, the PMC chair of the Apache Arrow project, presented on Data Eng Conf NY on the future of column-oriented data processing. Apache Arrow is an open-source standard for columnar in-memory execution. InfoQ interviewed Le Dem to find out the differences between Arrow and Parquet.
Visual Studio has a new website for extensions. Known as Visual Studio Marketplace, this site aggregates extensions for the Visual Studio, Visual Studio Code, and Visual Studio Team Services.
Alexandre Magno, author of the book ”How Creative Workers Learn", gave a masterclass at the Scrum Gathering Portugal 2016 showing the power of the practices that emerge from the inside of an organization instead of being imported from the outside.
Software security is a complex problem, and is becoming even more complex using Microservices where each service has to deal with security, David Borsos explained at the recent Microservices Conference in London, during his presentation evaluating four end-user authentication options within a microservice based systems.
When you want to scale the number of A/B tests to do many experiments at the same time, you need to adopt your processes and platform, and it might also impact your culture. Doing product research with controlled experiments helps to confront your ideas about how customers will use your product in reality, and check if those ideas actually impact user behaviour.
Alexandre Freire’s QConSF session focused on Modern Agile’s framework and suggested ways to implement them within an organization. He emphasized that the underlying culture must support these practices, or the practices will be forced and not lead to creating awesome teams.
Amazon’s Alexa Voice Service API, the NLP (natural language processing) API that powers Amazon Echo, has a new update that allows for developers to use Alexa to turn any device into a “smart” device through the use of the API’s voice recognition features.
At their annual re:Invent conference in Las Vegas, AWS unleashed a flurry of announcements about upcoming cloud services. Amazon outlined over two dozen new capabilities coming to the public cloud, including directly querying data in S3 object storage, building code as part of deployment pipelines, provisioning cheap virtual private servers, and moving data in bulk, ETL-style.
Amazon has launched Lightsail, a Virtual Private Server (VPS) service to compete with companies like Digital Ocean, Linode and the multitude of Low End Box providers. The service bundles a basic Linux virtual machine with SSD storage and a bandwidth allowance. Pricing starts at $5/month with tiers by RAM allocation. Each larger configuration comes with more storage and bandwidth.
At the AWS re:Invent 2016 conference, held in Las Vegas, USA, a distributed tracing service named AWS X-Ray was released in preview within all 12 public AWS Regions. In a similar fashion to Google’s Dapper, Twitter’s Zipkin and the OpenTracing API, AWS X-Ray helps developers analyse and debug distributed applications, such as those built using a microservices architectural style.
At the recent AWS Re:Invent event, Amazon announced a new preview service, called AWS Batch. AWS Batch allows organizations to optimize their scheduling and workload execution across a cloud-based landscape. Amazon has built this service in response to many AWS customers building their own batch platforms using EC2 instances, containers and CloudWatch.
In our continued effort to showcase lessons learned by microservices practitioners, we look at an article Piotr Gankiewicz has recently written with his own tips and tricks. These include references to CQRS, asynchronous architectures, service discovery and how choosing the right database for each service is important.
At the recent re:Invent 2016 event, Amazon announced a new service called AWS Shield, which provides customers with protection from Distributed Denial of Service (DDoS) attacks. This announcement comes just over a month after Amazon was impacted by a DDoS attack on a DNS provider that Amazon used, Dynamic Network Services (Dyn).
The Cloud, infrastructure as code, federated architectures with APIs, and anti-fragile systems: these are technologies for developing software systems that are rapidly coming into focus, claimed Mary Poppendieck. Systems are moving towards the cloud, and APIs are replacing central shared databases and enable the internet of things. We need to develop anti-fragile systems which embrace failure.
The RxJava team announced their 2.0 release after an 18 month development cycle. The project's "What's Different in 2.0" is a good guide for those developers familiar with RxJava 1.x. This release brings an important milestone. RxJava is a sub-project of ReactiveX, which is "a combination of the best ideas from the Observer pattern, the Iterator pattern, and functional programming".