Challenge Overview
Recently, there was a challenge API outage that meant that challenges weren't getting created for new issues for an extended period (>12 hours). We retry a few times to create the challenge, but when the retry limit is exhausted, we still have the issue in the creating phase, which means that it can't be cleared out or tried again. The only solution is to restart the processor to clear out the in-memory cache of issues being created.
Ideally, once a ticket fails to create a challenge, we should remove any temporary status, allowing the user to retry it by closing / reopening a ticket.