Skip to content

Redrive Ecom Indexing Pipeline

Background

The ecom indexing pipeline is an SQS queue of messages that trigger a worker to download doc data from S3 and push it into Marqo.

If the indexing experiences problems (other than invalid data), and the messages can’t be successfully retried, they are sent to the dead letter queue (DLQ). From there, rather than losing the data or asking the customer to try again, we may choose to redrive, adding the DLQ messages to the back of the SQS docs queue.

Process

  1. Find the DLQ for your index in SQS. Its name should be prod-{index_name}-dlq

  2. Select the source queue as a custom destination (TODO: can we make the source queue option work, e.g. with more metadata on the messages?)

    image.png

  3. Double check that the DLQ name is the same as your selected “existing queue” plus the -dlq suffix.

  4. Click “DLQ redrive”

    image.png

  5. Verify that it worked (the error on failure is easy to miss)

    image.png

  6. Verify that the redriven messages appear on the source queue (e.g. uptick in visible messages and/or deletions).