onboardingsvc is burning its error budget at 7.3× (1 h) / 7.4× (6 h) against a 99.00% objective
warning
Error budget burning
test27
resolved
impact 26
Owner: Prasad Limaye (backup: Sambasiva Bandarupalli)
opened 26d ago · last observed 3d ago · observed 210× · #5406 · 67f9d25d0dde5fd45164
What happened template
onboardingsvc is spending its error budget 7.3× faster than the objective allows over the last hour (7.4× over six hours). The objective is 99.0%, derived — a baseline, not a promise. 69 bad events against 929 calls in the window.
Bad events are consuming the error budget faster than the objective allows.
The facts
| objective | 99.00 |
| objective_source | derived |
| achieved | 92.57 |
| calls | 929.00 |
| bad | 69.00 |
| c5xx | 69.00 |
| budget | 9.29 |
| spent | 7.43 |
| remaining_pct | 0.00 |
| burn_1h | 7.28 |
| burn_6h | 7.43 |
| verdict | burning |
| p95_ms | 444.25 |
| discriminator | |
| window | 2026-11-15 00:59:37 UTC → 2026-11-15 06:59:37 UTC |
What is failing in onboardingsvc — the bad events, decomposed
“Bad events” are HTTP 5xx answers from onboardingsvc. In this finding's window (2026-11-15 00:59:37 UTC → 2026-11-15 06:59:37 UTC) there were 69; every line links to the grouped errors behind it.
POST /api/sites |
69 bad of 325 calls · 100% of the service's 5xx |
The error shapes behind them
| 66× | request failed — 500 since 2026-09-21 14:42:41 UTC |
| 66× | Request completed — 500 · Could not add site: site 'Name' cannot be empty since 2026-10-06 06:06:10 UTC |
| 4× | Request completed — 500 · Could not add room: error creating new room: room 'Name' cannot be empty since 2026-10-06 06:05:29 UTC |
| 4× | could not create room — room 'Name' cannot be empty since 2026-10-06 06:05:29 UTC |
| 4× | could not create room — error creating new room: room 'Name' cannot be empty since 2026-10-06 06:05:29 UTC |
All onboardingsvc errors, grouped → · service page · its logs
The story — No onboardingsvc deploy or hand change is recorded in the hour before this opened. Everything below is onboardingsvc only.
- 2026-10-23 13:03:15 UTCthis finding onboardingsvc is burning its error budget at 7.3× (1 h) / 7.4× (6 h) against a 99.00% objective
- 2026-10-23 14:04:30 UTCfinding · info onboardingsvc request rate 192.4 req/min vs a normal 0.0 req/min ± 5.0 req/min for Tue 07:00 UTC (4 of the last 4 checks)
- 2026-10-27 05:28:31 UTCfinding · warning onboardingsvc GET /api/organizations/tildainc: permission denied — 39 of 43 calls (91 %; 403×39) in the last 15 min — 69× its usual 0.6
- 2026-10-28 18:44:03 UTCfinding · warning onboardingsvc GET /api/organizations/myCro: permission denied — 85 of 85 calls (100 %; 403×85) in the last 15 min — it usually has none
- 2026-11-15 06:00:00 UTCerrors onboardingsvc 5xx peaked at 66 in one five-minute bucket (median 0 in this window)
- 2026-11-15 07:00:00 UTClatency onboardingsvc p95 peaked at 3.95 s
- 2026-11-15 07:07:54 UTCfinding · warning onboardingsvc POST /api/sites: 4xx — 31 of 31 calls (100 %; other 4xx×31) in the last 15 min — 118× its usual 0.3
History
- 2026-11-14 12:32:37 UTCresolved x-ray · reason=not observed grace_s=900 finding={'id': 5406, 'fingerprint': '67f9d25d0dde5fd45164', 'kind': 'budget.burning', 'severity': 'warning', 'cluster': 'test27', 'subject': 'onboardingsvc', 'title': 'onboardingsvc is burning its error budget at 0.0× (1 h) / 6.3× (6 h) against a 99.50% objective', 'facts': {'objective': 99.5, 'objective_source': 'derived', 'achieved': 96.84210526315789, 'calls': 95.0, 'bad': 3.0, 'c5xx': 3.0, 'budget': 0.475, 'spent': 6.315789473684211, 'remaining_pct': 0.0, 'burn_1h': 0.0, 'burn_6h': 6.315789473684211, 'verdict': 'burning', 'p95_ms': 237.5, 'window': [1794636726, 1794658326], 'recent_deploys': [], 'discriminator': ''}, 'evidence': [{'label': 'Error budgets', 'href': '/budgets?cluster=test27&from=1794636726&to=1794658326'}, {'label': 'onboardingsvc service page', 'href': '/service/onboardingsvc?cluster=test27&from=1794636726&to=1794658326'}], 'provenance': {'source': 'rollup', 'collected_at': 1794658324, 'age_seconds': 5, 'stale': False, 'shown': None, 'total': None, 'truncated': False, 'coverage_from': None, 'retain_days': None, 'note': None}, 'impact': 25.2, 'status': 'resolved', 'first_seen': 1792760595, 'last_seen': 1794658326, 'resolved_at': 1794659557, 'acked_by': None, 'acked_at': None, 'snoozed_until': None, 'occurrences': 151, 'narrative': 'onboardingsvc is spending its error budget 0.0× faster than the objective allows over the last hour (6.3× over six hours). The objective is 99.5%, derived — a baseline, not a promise. 3 bad events against 95 calls in the window.', 'narrative_kind': 'template', 'discriminator': '', 'level': 'low', 'told_level': None, 'episode_at': 1794640898, 'chat_thread': None, 'kind_label': 'Error budget burning', 'group': 'Reliability', 'age_s': 1898965, 'stale_s': 1234}
- 2026-11-14 13:41:16 UTCreopened x-ray · severity=warning was=warning title=onboardingsvc is burning its error budget at 7.6× (1 h) / 2.1× (6 h) against a 99.50% objective level=low was_level=low finding={'id': 5406, 'fingerprint': '67f9d25d0dde5fd45164', 'kind': 'budget.burning', 'severity': 'warning', 'cluster': 'test27', 'subject': 'onboardingsvc', 'title': 'onboardingsvc is burning its error budget at 7.6× (1 h) / 2.1× (6 h) against a 99.50% objective', 'facts': {'objective': 99.5, 'objective_source': 'derived', 'achieved': 98.96193771626297, 'calls': 289.0, 'bad': 3.0, 'c5xx': 3.0, 'budget': 1.445, 'spent': 2.0761245674740483, 'remaining_pct': 0.0, 'burn_1h': 7.59493670886076, 'burn_6h': 2.0761245674740483, 'verdict': 'burning', 'p95_ms': 340.3571428571431, 'window': [1794642076, 1794663676], 'recent_deploys': [], 'discriminator': ''}, 'evidence': [{'label': 'Error budgets', 'href': '/budgets?cluster=test27&from=1794642076&to=1794663676'}, {'label': 'onboardingsvc service page', 'href': '/service/onboardingsvc?cluster=test27&from=1794642076&to=1794663676'}], 'provenance': {'source': 'rollup', 'collected_at': 1794663618, 'age_seconds': 62, 'stale': False, 'shown': None, 'total': None, 'truncated': False, 'coverage_from': None, 'retain_days': None, 'note': None}, 'impact': 20.4, 'status': 'open', 'first_seen': 1792760595, 'last_seen': 1794663676, 'resolved_at': None, 'acked_by': None, 'acked_at': None, 'snoozed_until': None, 'occurrences': 152, 'narrative': 'onboardingsvc is spending its error budget 0.0× faster than the objective allows over the last hour (6.3× over six hours). The objective is 99.5%, derived — a baseline, not a promise. 3 bad events against 95 calls in the window.', 'narrative_kind': 'template', 'discriminator': '', 'level': 'low', 'told_level': None, 'episode_at': 1794663676, 'chat_thread': None, 'kind_label': 'Error budget burning', 'group': 'Reliability', 'age_s': 1903085, 'stale_s': 4}
- 2026-11-14 15:06:23 UTCresolved x-ray · reason=not observed grace_s=900 finding={'id': 5406, 'fingerprint': '67f9d25d0dde5fd45164', 'kind': 'budget.burning', 'severity': 'warning', 'cluster': 'test27', 'subject': 'onboardingsvc', 'title': 'onboardingsvc is burning its error budget at 8.7× (1 h) / 2.1× (6 h) against a 99.50% objective', 'facts': {'objective': 99.5, 'objective_source': 'derived', 'achieved': 98.97260273972603, 'calls': 292.0, 'bad': 3.0, 'c5xx': 3.0, 'budget': 1.46, 'spent': 2.0547945205479454, 'remaining_pct': 0.0, 'burn_1h': 8.695652173913043, 'burn_6h': 2.054794520547945, 'verdict': 'burning', 'p95_ms': 337.14285714285666, 'window': [1794643478, 1794665078], 'recent_deploys': [], 'discriminator': ''}, 'evidence': [{'label': 'Error budgets', 'href': '/budgets?cluster=test27&from=1794643478&to=1794665078'}, {'label': 'onboardingsvc service page', 'href': '/service/onboardingsvc?cluster=test27&from=1794643478&to=1794665078'}], 'provenance': {'source': 'rollup', 'collected_at': 1794665077, 'age_seconds': 6, 'stale': False, 'shown': None, 'total': None, 'truncated': False, 'coverage_from': None, 'retain_days': None, 'note': None}, 'impact': 25.4, 'status': 'resolved', 'first_seen': 1792760595, 'last_seen': 1794665078, 'resolved_at': 1794668783, 'acked_by': None, 'acked_at': None, 'snoozed_until': None, 'occurrences': 155, 'narrative': 'onboardingsvc is spending its error budget 8.7× faster than the objective allows over the last hour (2.1× over six hours). The objective is 99.5%, derived — a baseline, not a promise. 3 bad events against 292 calls in the window.', 'narrative_kind': 'template', 'discriminator': '', 'level': 'low', 'told_level': None, 'episode_at': 1794663676, 'chat_thread': None, 'kind_label': 'Error budget burning', 'group': 'Reliability', 'age_s': 1908191, 'stale_s': 3708}
- 2026-11-14 18:07:47 UTCreopened x-ray · severity=warning was=warning title=onboardingsvc is burning its error budget at 14.3× (1 h) / 3.5× (6 h) against a 99.50% objective level=low was_level=low finding={'id': 5406, 'fingerprint': '67f9d25d0dde5fd45164', 'kind': 'budget.burning', 'severity': 'warning', 'cluster': 'test27', 'subject': 'onboardingsvc', 'title': 'onboardingsvc is burning its error budget at 14.3× (1 h) / 3.5× (6 h) against a 99.50% objective', 'facts': {'objective': 99.5, 'objective_source': 'derived', 'achieved': 98.25072886297376, 'calls': 343.0, 'bad': 6.0, 'c5xx': 6.0, 'budget': 1.715, 'spent': 3.498542274052478, 'remaining_pct': 0.0, 'burn_1h': 14.285714285714285, 'burn_6h': 3.498542274052478, 'verdict': 'burning', 'p95_ms': 256.9999999999993, 'window': [1794658067, 1794679667], 'recent_deploys': [], 'discriminator': ''}, 'evidence': [{'label': 'Error budgets', 'href': '/budgets?cluster=test27&from=1794658067&to=1794679667'}, {'label': 'onboardingsvc service page', 'href': '/service/onboardingsvc?cluster=test27&from=1794658067&to=1794679667'}], 'provenance': {'source': 'rollup', 'collected_at': 1794679666, 'age_seconds': 5, 'stale': False, 'shown': None, 'total': None, 'truncated': False, 'coverage_from': None, 'retain_days': None, 'note': None}, 'impact': 20.5, 'status': 'open', 'first_seen': 1792760595, 'last_seen': 1794679667, 'resolved_at': None, 'acked_by': None, 'acked_at': None, 'snoozed_until': None, 'occurrences': 156, 'narrative': 'onboardingsvc is spending its error budget 8.7× faster than the objective allows over the last hour (2.1× over six hours). The objective is 99.5%, derived — a baseline, not a promise. 3 bad events against 292 calls in the window.', 'narrative_kind': 'template', 'discriminator': '', 'level': 'low', 'told_level': None, 'episode_at': 1794679667, 'chat_thread': None, 'kind_label': 'Error budget burning', 'group': 'Reliability', 'age_s': 1919075, 'stale_s': 3}
- 2026-11-14 18:37:55 UTCresolved x-ray · reason=not observed grace_s=900 finding={'id': 5406, 'fingerprint': '67f9d25d0dde5fd45164', 'kind': 'budget.burning', 'severity': 'warning', 'cluster': 'test27', 'subject': 'onboardingsvc', 'title': 'onboardingsvc is burning its error budget at 6.9× (1 h) / 3.2× (6 h) against a 99.50% objective', 'facts': {'objective': 99.5, 'objective_source': 'derived', 'achieved': 98.38274932614556, 'calls': 371.0, 'bad': 6.0, 'c5xx': 6.0, 'budget': 1.855, 'spent': 3.234501347708895, 'remaining_pct': 0.0, 'burn_1h': 6.896551724137931, 'burn_6h': 3.234501347708895, 'verdict': 'burning', 'p95_ms': 212.27272727272697, 'window': [1794658493, 1794680093], 'recent_deploys': [], 'discriminator': ''}, 'evidence': [{'label': 'Error budgets', 'href': '/budgets?cluster=test27&from=1794658493&to=1794680093'}, {'label': 'onboardingsvc service page', 'href': '/service/onboardingsvc?cluster=test27&from=1794658493&to=1794680093'}], 'provenance': {'source': 'rollup', 'collected_at': 1794680091, 'age_seconds': 6, 'stale': False, 'shown': None, 'total': None, 'truncated': False, 'coverage_from': None, 'retain_days': None, 'note': None}, 'impact': 25.5, 'status': 'resolved', 'first_seen': 1792760595, 'last_seen': 1794680093, 'resolved_at': 1794681475, 'acked_by': None, 'acked_at': None, 'snoozed_until': None, 'occurrences': 157, 'narrative': 'onboardingsvc is spending its error budget 6.9× faster than the objective allows over the last hour (3.2× over six hours). The objective is 99.5%, derived — a baseline, not a promise. 6 bad events against 371 calls in the window.', 'narrative_kind': 'template', 'discriminator': '', 'level': 'low', 'told_level': None, 'episode_at': 1794679667, 'chat_thread': None, 'kind_label': 'Error budget burning', 'group': 'Reliability', 'age_s': 1920883, 'stale_s': 1385}
- 2026-11-14 19:08:30 UTCreopened x-ray · severity=warning was=warning title=onboardingsvc is burning its error budget at 0.0× (1 h) / 6.5× (6 h) against a 99.50% objective level=low was_level=low finding={'id': 5406, 'fingerprint': '67f9d25d0dde5fd45164', 'kind': 'budget.burning', 'severity': 'warning', 'cluster': 'test27', 'subject': 'onboardingsvc', 'title': 'onboardingsvc is burning its error budget at 0.0× (1 h) / 6.5× (6 h) against a 99.50% objective', 'facts': {'objective': 99.5, 'objective_source': 'derived', 'achieved': 96.73913043478261, 'calls': 184.0, 'bad': 6.0, 'c5xx': 6.0, 'budget': 0.92, 'spent': 6.521739130434782, 'remaining_pct': 0.0, 'burn_1h': None, 'burn_6h': 6.521739130434782, 'verdict': 'burning', 'p95_ms': 188.42105263157885, 'window': [1794661710, 1794683310], 'recent_deploys': [], 'discriminator': ''}, 'evidence': [{'label': 'Error budgets', 'href': '/budgets?cluster=test27&from=1794661710&to=1794683310'}, {'label': 'onboardingsvc service page', 'href': '/service/onboardingsvc?cluster=test27&from=1794661710&to=1794683310'}], 'provenance': {'source': 'rollup', 'collected_at': 1794683309, 'age_seconds': 5, 'stale': False, 'shown': None, 'total': None, 'truncated': False, 'coverage_from': None, 'retain_days': None, 'note': None}, 'impact': 20.3, 'status': 'open', 'first_seen': 1792760595, 'last_seen': 1794683310, 'resolved_at': None, 'acked_by': None, 'acked_at': None, 'snoozed_until': None, 'occurrences': 158, 'narrative': 'onboardingsvc is spending its error budget 6.9× faster than the objective allows over the last hour (3.2× over six hours). The objective is 99.5%, derived — a baseline, not a promise. 6 bad events against 371 calls in the window.', 'narrative_kind': 'template', 'discriminator': '', 'level': 'low', 'told_level': None, 'episode_at': 1794683310, 'chat_thread': None, 'kind_label': 'Error budget burning', 'group': 'Reliability', 'age_s': 1922718, 'stale_s': 3}
- 2026-11-14 20:34:49 UTCresolved x-ray · reason=not observed grace_s=900 finding={'id': 5406, 'fingerprint': '67f9d25d0dde5fd45164', 'kind': 'budget.burning', 'severity': 'warning', 'cluster': 'test27', 'subject': 'onboardingsvc', 'title': 'onboardingsvc is burning its error budget at 0.0× (1 h) / 6.5× (6 h) against a 99.50% objective', 'facts': {'objective': 99.5, 'objective_source': 'derived', 'achieved': 96.73913043478261, 'calls': 184.0, 'bad': 6.0, 'c5xx': 6.0, 'budget': 0.92, 'spent': 6.521739130434782, 'remaining_pct': 0.0, 'burn_1h': None, 'burn_6h': 6.521739130434782, 'verdict': 'burning', 'p95_ms': 188.42105263157885, 'window': [1794661710, 1794683310], 'recent_deploys': [], 'discriminator': ''}, 'evidence': [{'label': 'Error budgets', 'href': '/budgets?cluster=test27&from=1794661710&to=1794683310'}, {'label': 'onboardingsvc service page', 'href': '/service/onboardingsvc?cluster=test27&from=1794661710&to=1794683310'}], 'provenance': {'source': 'rollup', 'collected_at': 1794683309, 'age_seconds': 5, 'stale': False, 'shown': None, 'total': None, 'truncated': False, 'coverage_from': None, 'retain_days': None, 'note': None}, 'impact': 25.3, 'status': 'resolved', 'first_seen': 1792760595, 'last_seen': 1794683310, 'resolved_at': 1794688489, 'acked_by': None, 'acked_at': None, 'snoozed_until': None, 'occurrences': 158, 'narrative': 'onboardingsvc is spending its error budget — faster than the objective allows over the last hour (6.5× over six hours). The objective is 99.5%, derived — a baseline, not a promise. 6 bad events against 184 calls in the window.', 'narrative_kind': 'template', 'discriminator': '', 'level': 'low', 'told_level': None, 'episode_at': 1794683310, 'chat_thread': None, 'kind_label': 'Error budget burning', 'group': 'Reliability', 'age_s': 1927897, 'stale_s': 5182}
- 2026-11-14 21:37:51 UTCreopened x-ray · severity=warning was=warning title=onboardingsvc is burning its error budget at 0.0× (1 h) / 7.2× (6 h) against a 99.50% objective level=low was_level=low finding={'id': 5406, 'fingerprint': '67f9d25d0dde5fd45164', 'kind': 'budget.burning', 'severity': 'warning', 'cluster': 'test27', 'subject': 'onboardingsvc', 'title': 'onboardingsvc is burning its error budget at 0.0× (1 h) / 7.2× (6 h) against a 99.50% objective', 'facts': {'objective': 99.5, 'objective_source': 'derived', 'achieved': 96.40718562874252, 'calls': 167.0, 'bad': 6.0, 'c5xx': 6.0, 'budget': 0.835, 'spent': 7.185628742514971, 'remaining_pct': 0.0, 'burn_1h': None, 'burn_6h': 7.18562874251497, 'verdict': 'burning', 'p95_ms': 198.40909090909093, 'window': [1794670671, 1794692271], 'recent_deploys': [], 'discriminator': ''}, 'evidence': [{'label': 'Error budgets', 'href': '/budgets?cluster=test27&from=1794670671&to=1794692271'}, {'label': 'onboardingsvc service page', 'href': '/service/onboardingsvc?cluster=test27&from=1794670671&to=1794692271'}], 'provenance': {'source': 'rollup', 'collected_at': 1794692166, 'age_seconds': 108, 'stale': False, 'shown': None, 'total': None, 'truncated': False, 'coverage_from': None, 'retain_days': None, 'note': None}, 'impact': 20.3, 'status': 'open', 'first_seen': 1792760595, 'last_seen': 1794692271, 'resolved_at': None, 'acked_by': None, 'acked_at': None, 'snoozed_until': None, 'occurrences': 159, 'narrative': 'onboardingsvc is spending its error budget — faster than the objective allows over the last hour (6.5× over six hours). The objective is 99.5%, derived — a baseline, not a promise. 6 bad events against 184 calls in the window.', 'narrative_kind': 'template', 'discriminator': '', 'level': 'low', 'told_level': None, 'episode_at': 1794692271, 'chat_thread': None, 'kind_label': 'Error budget burning', 'group': 'Reliability', 'age_s': 1931679, 'stale_s': 3}
- 2026-11-14 23:38:41 UTCresolved x-ray · reason=not observed grace_s=900 finding={'id': 5406, 'fingerprint': '67f9d25d0dde5fd45164', 'kind': 'budget.burning', 'severity': 'warning', 'cluster': 'test27', 'subject': 'onboardingsvc', 'title': 'onboardingsvc is burning its error budget at 0.0× (1 h) / 6.2× (6 h) against a 99.50% objective', 'facts': {'objective': 99.5, 'objective_source': 'derived', 'achieved': 96.90721649484536, 'calls': 194.0, 'bad': 6.0, 'c5xx': 6.0, 'budget': 0.97, 'spent': 6.185567010309279, 'remaining_pct': 0.0, 'burn_1h': None, 'burn_6h': 6.185567010309279, 'verdict': 'burning', 'p95_ms': 212.85714285714212, 'window': [1794676581, 1794698181], 'recent_deploys': [], 'discriminator': ''}, 'evidence': [{'label': 'Error budgets', 'href': '/budgets?cluster=test27&from=1794676581&to=1794698181'}, {'label': 'onboardingsvc service page', 'href': '/service/onboardingsvc?cluster=test27&from=1794676581&to=1794698181'}], 'provenance': {'source': 'rollup', 'collected_at': 1794698122, 'age_seconds': 63, 'stale': False, 'shown': None, 'total': None, 'truncated': False, 'coverage_from': None, 'retain_days': None, 'note': None}, 'impact': 25.3, 'status': 'resolved', 'first_seen': 1792760595, 'last_seen': 1794698181, 'resolved_at': 1794699521, 'acked_by': None, 'acked_at': None, 'snoozed_until': None, 'occurrences': 171, 'narrative': 'onboardingsvc is spending its error budget — faster than the objective allows over the last hour (6.2× over six hours). The objective is 99.5%, derived — a baseline, not a promise. 6 bad events against 194 calls in the window.', 'narrative_kind': 'template', 'discriminator': '', 'level': 'low', 'told_level': None, 'episode_at': 1794692271, 'chat_thread': None, 'kind_label': 'Error budget burning', 'group': 'Reliability', 'age_s': 1938930, 'stale_s': 1344}
- 2026-11-15 01:42:45 UTCreopened x-ray · severity=warning was=warning title=onboardingsvc is burning its error budget at 0.0× (1 h) / 9.1× (6 h) against a 99.50% objective level=low was_level=low finding={'id': 5406, 'fingerprint': '67f9d25d0dde5fd45164', 'kind': 'budget.burning', 'severity': 'warning', 'cluster': 'test27', 'subject': 'onboardingsvc', 'title': 'onboardingsvc is burning its error budget at 0.0× (1 h) / 9.1× (6 h) against a 99.50% objective', 'facts': {'objective': 99.5, 'objective_source': 'derived', 'achieved': 95.45454545454545, 'calls': 132.0, 'bad': 6.0, 'c5xx': 6.0, 'budget': 0.66, 'spent': 9.09090909090909, 'remaining_pct': 0.0, 'burn_1h': None, 'burn_6h': 9.090909090909092, 'verdict': 'burning', 'p95_ms': 252.4999999999997, 'window': [1794685365, 1794706965], 'recent_deploys': [], 'discriminator': ''}, 'evidence': [{'label': 'Error budgets', 'href': '/budgets?cluster=test27&from=1794685365&to=1794706965'}, {'label': 'onboardingsvc service page', 'href': '/service/onboardingsvc?cluster=test27&from=1794685365&to=1794706965'}], 'provenance': {'source': 'rollup', 'collected_at': 1794706963, 'age_seconds': 6, 'stale': False, 'shown': None, 'total': None, 'truncated': False, 'coverage_from': None, 'retain_days': None, 'note': None}, 'impact': 20.2, 'status': 'open', 'first_seen': 1792760595, 'last_seen': 1794706965, 'resolved_at': None, 'acked_by': None, 'acked_at': None, 'snoozed_until': None, 'occurrences': 172, 'narrative': 'onboardingsvc is spending its error budget — faster than the objective allows over the last hour (6.2× over six hours). The objective is 99.5%, derived — a baseline, not a promise. 6 bad events against 194 calls in the window.', 'narrative_kind': 'template', 'discriminator': '', 'level': 'low', 'told_level': None, 'episode_at': 1794706965, 'chat_thread': None, 'kind_label': 'Error budget burning', 'group': 'Reliability', 'age_s': 1946374, 'stale_s': 4}
- 2026-11-15 07:17:13 UTCresolved x-ray · reason=not observed grace_s=900 finding={'id': 5406, 'fingerprint': '67f9d25d0dde5fd45164', 'kind': 'budget.burning', 'severity': 'warning', 'cluster': 'test27', 'subject': 'onboardingsvc', 'title': 'onboardingsvc is burning its error budget at 7.3× (1 h) / 7.4× (6 h) against a 99.00% objective', 'facts': {'objective': 99.0, 'objective_source': 'derived', 'achieved': 92.57265877287406, 'calls': 929.0, 'bad': 69.0, 'c5xx': 69.0, 'budget': 9.29, 'spent': 7.427341227125942, 'remaining_pct': 0.0, 'burn_1h': 7.28476821192053, 'burn_6h': 7.427341227125941, 'verdict': 'burning', 'p95_ms': 444.2499999999999, 'window': [1794704377, 1794725977], 'recent_deploys': [], 'discriminator': ''}, 'evidence': [{'label': 'Error budgets', 'href': '/budgets?cluster=test27&from=1794704377&to=1794725977'}, {'label': 'onboardingsvc service page', 'href': '/service/onboardingsvc?cluster=test27&from=1794704377&to=1794725977'}], 'provenance': {'source': 'rollup', 'collected_at': 1794725976, 'age_seconds': 6, 'stale': False, 'shown': None, 'total': None, 'truncated': False, 'coverage_from': None, 'retain_days': None, 'note': None}, 'impact': 26.3, 'status': 'resolved', 'first_seen': 1792760595, 'last_seen': 1794725977, 'resolved_at': 1794727033, 'acked_by': None, 'acked_at': None, 'snoozed_until': None, 'occurrences': 210, 'narrative': 'onboardingsvc is spending its error budget 7.3× faster than the objective allows over the last hour (7.4× over six hours). The objective is 99.0%, derived — a baseline, not a promise. 69 bad events against 929 calls in the window.', 'narrative_kind': 'template', 'discriminator': '', 'level': 'low', 'told_level': None, 'episode_at': 1794706965, 'chat_thread': None, 'kind_label': 'Error budget burning', 'group': 'Reliability', 'age_s': 1966441, 'stale_s': 1059}
Check it yourself
Every link carries the finding's own time window, so it shows tomorrow what it shows now.
Actions
Sign in (IAP) to acknowledge, snooze or resolve.
Where the numbers come from
| source | rollup |
| collected_at | 1794725976 |
| age_seconds | 6 |
| stale | False |
| shown | None |
| total | None |
| truncated | False |
| coverage_from | None |
| retain_days | None |
| note | None |
| detector | budgets |