System status
Degraded performance 2026-05-25, 12:18 UTC Ongoing · 14 min so far
Social Autopilot — TikTok publish latency elevated
In progress — postmortem follows within 7 days of resolution
TikTok Business API returned slower-than-baseline upload acknowledgements. Posts are still being delivered; latency tracking is in flight. Backfill in progress.
Timeline
- 12:18 UTCSynthetic probe flags TikTok publish acknowledgements at 8 min vs the 90 s baseline. Component marked degraded.
- 12:21 UTCOn-call confirms posts are still being delivered — this is a latency issue, not a delivery failure. No customer writes lost.
- 12:28 UTCCorrelated with elevated response times from the TikTok Business API region; an upstream-vendor issue, not a Magistry regression.
- 12:32 UTCPublish queue backfilling. Monitoring; will resolve once vendor acknowledgement times return to baseline.
Root cause
Slower-than-baseline upload acknowledgements from the TikTok Business API in one region. Magistry's publisher waits for an explicit acknowledgement before marking a post delivered, so vendor latency surfaces as elevated publish latency on our side.
Impact
Social Autopilot posts to TikTok were delayed (≈8 min vs ~90 s). Posts were still delivered and logged; no other channel or component was affected, and no customer writes were lost.
Current mitigation
Posts continued to deliver throughout. The publish queue backfilled as vendor acknowledgement times recovered. No data was lost; affected posts retain their decision_log rows.
What we changed
- Add a vendor-latency circuit so publish acknowledgements that exceed a threshold are tracked async rather than blocking the publisher.
- Surface upstream-vendor status directly on the component row so operators can distinguish vendor latency from a Magistry regression at a glance.
// system status
Every incident gets a postmortem.
Root cause, mitigation, what changed in the runbook — published within seven days, not buried. The same discipline we apply to the agents, applied to ourselves.
99.98% uptime · 90 days · Postmortems within 7 days · Updated every 60s