BT
rss
DevOps Follow 822 Followers

Monitoring Distributed Task Queues at MeilleursAgents

by Hrishikesh Barua Follow 14 Followers on  Feb 18, 2018

MeilleursAgents, a website that lets property sellers list and get an estimated price of their property, shared details of how their Celery-based distributed task queue is monitored. A combination of Python, StatsD, Bucky, Graphite and Grafana form the pipeline to monitor task lifecycle and execution rates.

DevOps Follow 822 Followers

Chaperone - A Kafka Auditing Tool from the Uber Engineering Team

by Hrishikesh Barua Follow 14 Followers on  Jan 26, 2017 2

The Uber Engineering team released their Kafka auditing tool called Chaperone as an open-source project. Chaperone allows for auditing and detection of data loss, latency, and duplication of messages in the multi-datacenter and high-volume Kafka setup at Uber.

Cloud Follow 280 Followers

Amazon Simple Queue Service (SQS) Gains FIFO Queues

by Steffen Opel Follow 3 Followers on  Dec 31, 2016

Amazon's Simple Queue Service (SQS) recently gained FIFO (first-in, first-out) queues, which are designed to "guarantee that messages are processed exactly once, in the order that they are sent, and without duplicates". AWS rolled out this new queue type in the US East (Ohio) and US West (Oregon) regions and "plans to make it available in many others in early 2017".

Login to InfoQ to interact with what matters most to you.


Recover your password...

Follow

Follow your favorite topics and editors

Quick overview of most important highlights in the industry and on the site.

Like

More signal, less noise

Build your own feed by choosing topics you want to read about and editors you want to hear from.

Notifications

Stay up-to-date

Set up your notifications and don't miss out on content that matters to you

BT