Delays and errors for users with One-time/Recurring campaigns

Incident Report for Blueshift

Resolved

A critical security update was applied to our caching instances. Campaigns were paused during the actual process of the update. These were unpaused after the update was complete, however, there were some intermittent failovers of nodes in one of the larger cache clusters causing intermittent connection losses from the campaign services depending on it. As a result, few campaigns were delayed and some portion of users errored out.

Posted Mar 20, 2023 - 22:30 PDT