Resolved
Dec 8, 2024 at 5:43am UTC
Post Mortem: Automatos Primary Worker Offline
What happened
- The primary worker node became unresponsive at about Dec 05 at 10:40am UTC.
- Our team was notified at 11:08am UTC and responded immediately.
- After a brief issue diagnosis, the primary worker was manually rebooted and came back online and fully functional at 11:17 UTC.
Why this happened
- Our 3rd logging party service used for verbose debugging, BetterStack, went down briefly, resulting in network errors. We log net...