workplansvc: 5xx rate (%) 0.92% — 12.6× the fleet's usual 0.07%
info
Service outlier
automation
open
impact 12
Owner: Suresh Boddapati (backup: Madhava Mukkamala)
opened 83d ago · last observed 1d ago · observed 4405× · #311 · ad113f2c764386464aa5
What happened template
workplansvc's 5xx rate (%) is 0.92% against the 15 other services' median of 0.07% (7.8 robust MADs above, six-hour window). This compares the service with its peers, not with its own history — the seasonal detector does that.
A service unlike the rest of the fleet on one measure (robust z against its peers).
The facts
| measures | {'measure': '5xx rate (%)', 'value': 0.9249183895538629, 'value_fmt': '0.92%', 'median': 0.07346459006758742, 'median_fmt': '0.07%', 'mad': 0.1089186012342051, 'z': 7.817340562934832, 'direction': 'above', 'peers': 15} |
| measure | 5xx rate (%) |
| value | 0.92 |
| value_fmt | 0.92% |
| median | 0.07 |
| median_fmt | 0.07% |
| z | 7.82 |
| direction | above |
| peers | 15 |
| rule | {"min_score": 3.5, "min_relative_pct": 35, "warn_on": []} |
| discriminator | |
| window | 2026-11-17 00:00:02 UTC → 2026-11-17 06:00:02 UTC |
What is failing in workplansvc — the bad events, decomposed
“Bad events” are HTTP 5xx answers from workplansvc. In this finding's window (2026-11-17 00:00:02 UTC → 2026-11-17 06:00:02 UTC) there were 17; every line links to the grouped errors behind it.
POST /api/workplan/configs |
6 bad of 57 calls · 35% of the service's 5xx |
DELETE /api/workplan/templates/:id |
4 bad of 8 calls · 24% of the service's 5xx |
POST /api/workplan/templates |
4 bad of 77 calls · 24% of the service's 5xx |
POST /api/workplan/types |
3 bad of 78 calls · 18% of the service's 5xx |
The error shapes behind them
| 132× | Failed to create workplan config — site 3aab23db-d69f-4946-b743-2613d2dccfef not found since 2026-10-20 01:14:02 UTC |
| 8× | work plan template name cannot be empty since 2026-09-15 01:46:21 UTC |
| 8× | Request completed — 500 · work plan template name cannot be empty since 2026-09-25 09:27:33 UTC |
| 8× | Request completed — 500 · could not create work plan type:work plan type name cannot be empty since 2026-09-25 09:21:59 UTC |
| 8× | could not create work plan type:work plan type name cannot be empty since 2026-09-15 01:41:21 UTC |
History
Check it yourself
Every link carries the finding's own time window, so it shows tomorrow what it shows now.
Actions
Sign in (IAP) to acknowledge, snooze or resolve.
Where the numbers come from
| source | rollup |
| collected_at | 1794894820 |
| age_seconds | 382 |
| stale | False |
| shown | None |
| total | None |
| truncated | False |
| coverage_from | None |
| retain_days | None |
| note | None |
| detector | outliers |