BT

Facilitating the Spread of Knowledge and Innovation in Professional Software Development

Write for InfoQ

Topics

Choose your language

InfoQ Homepage News Doordash Introduces ML to Understand the Marketplaces Status

Doordash Introduces ML to Understand the Marketplaces Status

This item in japanese

Bookmarks

DoorDash introduces an ML model to predict the operational status of a store in order to increase the user experience and save thousands of order cancellations. Understanding the merchant’s operational status and the ability to receive and fulfill orders is crucial for the DoorDash platform. Each marketplace on DoorDash works independently, and the information on working hours is important to inform the customer that their order can’t be delivered and to avoid other orders being submitted to a closed marketplace.

When a Dasher finds a marketplace closed, through the ‘Dasher Report Store Close’ (DSRC) on the Dasher App, the Dasher can report a closed marketplace. The process starts with a submission of a photo of the closed marketplace, and then they are refunded for the loss of time and can continue with another delivery. When a DSRC report is received, DoorDash contacts the merchant to understand its status in order to update it on the platform. This is a long, unscalable, and inefficient process. For these reasons, DoorDash has developed an ML model that can understand the status of the merchant based on some variables, including the time of the last delivery and the analysis of the photo uploaded by the Dasher.

The first attempt to create a model for inferring the operational status of a store was to calculate the conditional probability of the marketplace being closed when the DSRC report is filled:

  Probability(Store is Closed | DRSC report)

The store status variable was constructed based on the status of the past DSRC reports: for example, if a dasher has completed a pick-up within 15 minutes, the store is probably open despite the DSRC. In addition, the new ML model uses the image uploaded by the dasher. The image classifier, trained internally using the DoorDash image processing platform, analyzes the uploaded images to understand if the store is closed (analyzing if the lights are off, for example). The classifier compresses the image information in a single number that can be used as a feature in the new ML model; this allows the DoorDash platform to process and use hundreds of thousands of images quickly.

A LightGBM model combines the historical data and the image data to find the final probability that the store is closed. The decision on the store status is taken based on three thresholds defined on this probability: low probability of a store being closed leads to unassigning the order and finding a new Dasher to deliver the order, intermediate probabilities would lead DoorDash to cancel the order, high probabilities would lead the platform to both cancel the order and pause the store.

                                               DRSC ML model inputs and output action-set

After the deployment of the ML model in production and the AB testing, DoorDash can confirm the user experience is better and thousands of deliveries are saved from being canceled every week. The next steps are to make the decision thresholds dynamic by incorporating other features like time of the day, future volume stores, and future volume cancellations. Another improvement tends to develop a loss function to understand the cost of each decision about the store. Thanks to the loss function and the probability model, DoorDash will compute the expected loss and find actions that minimize it.

About the Author

Rate this Article

Adoption
Style

Hello stranger!

You need to Register an InfoQ account or or login to post comments. But there's so much more behind being registered.

Get the most out of the InfoQ experience.

Allowed html: a,b,br,blockquote,i,li,pre,u,ul,p

Community comments

  • They should stop that experiment before they all get fired

    by Tariga T.,

    Your message is awaiting moderation. Thank you for participating in the discussion.

    As a restaurant owner and software engineer, I noticed since December that DoorDash was regularly turning off our restaurant for delivery (and not just ours, lots of restaurants around us as well) and they continue to do so but, less so. We never had a problem with cancelled orders, BTW, nor the closure is synchronized with the restaurant's activity.

    So what happened/happens as a result? We see an uptick on UberEats, even the regular DD drivers have switched to Uber. My best guess, based on our numbers is that DoorDash has lost about 10-15% of sales in the process. That's a far bigger number than our cancelled orders. Since the experiment started at the very end of last quarter, it's way too early to see the results, but I'd expect a significant drop in their revenue for Q123.

Allowed html: a,b,br,blockquote,i,li,pre,u,ul,p

Allowed html: a,b,br,blockquote,i,li,pre,u,ul,p

BT