execsvc Neo4j load 117 q/min vs a normal 0 q/min ± 20 q/min for Mon 06:00 UTC (4 of the last 4 checks)
info
Neo4j load anomaly
test26
resolved
impact 9
Owner: Madhava Mukkamala (backup: Shashank Agrawal)
opened 69d ago · last observed 2d ago · observed 79× · #1417 · 2fcb47c4def12172732d
What happened template
execsvc's Neo4j load is 117 q/min on test26, above a normal of 0 q/min ± 20 q/min for this hour of the week (4 of the last 4 five-minute buckets, z = 5.8, 5 weeks of history). Whether users noticed depends on which endpoints carried it — the service page shows the split.
Queries per minute far outside the hour-of-week normal.
The facts
| measure | neo_qpm |
| unit | q/min |
| value | 116.60 |
| expected_median | 0.00 |
| expected_mad | 20.00 |
| z | 5.83 |
| rel | inf |
| buckets_hit | 4 |
| n | 54 |
| weeks | 5 |
| slot | Mon 06:00 UTC |
| bucket | 2026-11-16 06:20:00 UTC (2d ago) |
| discriminator | neo_qpm |
| window | 2026-11-16 06:05:00 UTC → 2026-11-16 06:25:00 UTC |
What is failing in execsvc — the bad events, decomposed
“Bad events” are HTTP 5xx answers from execsvc. In this finding's window (2026-11-16 06:05:00 UTC → 2026-11-16 06:25:00 UTC) there were 0; every line links to the grouped errors behind it.
The error shapes behind them
| 21× | error anchor visit index has not been set. Does this study have an anchor visit? continuing without setting day/date ran… since 2026-11-06 00:02:19 UTC |
| 12× | error anchor visit index has not been set. Does this study have an anchor visit? continuing without setting day/date ran… since 2026-11-12 15:37:28 UTC |
| 3× | could not process study site bundle import — source and target study are the same (d4ccf900-31a7-47fc-83bf-37afc98f7217)… since 2026-11-16 05:52:58 UTC |
History
- 2026-11-16 06:13:57 UTCreopened x-ray · severity=info was=info title=execsvc Neo4j load 217 q/min vs a normal 0 q/min ± 20 q/min for Mon 06:00 UTC (3 of the last 4 checks) level=low was_level=low finding={'id': 1417, 'fingerprint': '2fcb47c4def12172732d', 'kind': 'anomaly.neo4j', 'severity': 'info', 'cluster': 'test26', 'subject': 'execsvc', 'title': 'execsvc Neo4j load 217 q/min vs a normal 0 q/min ± 20 q/min for Mon 06:00 UTC (3 of the last 4 checks)', 'facts': {'measure': 'neo_qpm', 'unit': 'q/min', 'value': 217.0, 'expected_median': 0.0, 'expected_mad': 20.0, 'z': 10.85, 'rel': inf, 'buckets_hit': 3, 'n': 54, 'weeks': 5, 'slot': 'Mon 06:00 UTC', 'bucket': 1794808800, 'window': [1794807900, 1794809100], 'recent_deploys': [], 'discriminator': 'neo_qpm'}, 'evidence': [{'label': 'Service', 'href': '/service/execsvc?cluster=test26&from=1794786300&to=1794809100'}, {'label': 'Fleet vs normal', 'href': '/fleet?cluster=test26&from=1794786300&to=1794809100'}], 'provenance': {'source': 'rollup', 'collected_at': 1794809637, 'age_seconds': 16, 'stale': False, 'shown': None, 'total': None, 'truncated': False, 'coverage_from': None, 'retain_days': None, 'note': None}, 'impact': 3.8, 'status': 'open', 'first_seen': 1789028563, 'last_seen': 1794809637, 'resolved_at': None, 'acked_by': None, 'acked_at': None, 'snoozed_until': None, 'occurrences': 77, 'narrative': "execsvc's Neo4j load is 121 q/min on test26, above a normal of 0 q/min ± 20 q/min for this hour of the week (3 of the last 4 five-minute buckets, z = 6.0, 4 weeks of history). Whether users noticed depends on which endpoints carried it — the service page shows the split.", 'narrative_kind': 'template', 'discriminator': 'neo_qpm', 'level': 'low', 'told_level': None, 'episode_at': 1794809637, 'chat_thread': None, 'kind_label': 'Neo4j load anomaly', 'group': 'Anomalies', 'age_s': 5781091, 'stale_s': 17}
- 2026-11-16 06:49:27 UTCresolved x-ray · reason=not observed grace_s=900 finding={'id': 1417, 'fingerprint': '2fcb47c4def12172732d', 'kind': 'anomaly.neo4j', 'severity': 'info', 'cluster': 'test26', 'subject': 'execsvc', 'title': 'execsvc Neo4j load 117 q/min vs a normal 0 q/min ± 20 q/min for Mon 06:00 UTC (4 of the last 4 checks)', 'facts': {'measure': 'neo_qpm', 'unit': 'q/min', 'value': 116.6, 'expected_median': 0.0, 'expected_mad': 20.0, 'z': 5.83, 'rel': inf, 'buckets_hit': 4, 'n': 54, 'weeks': 5, 'slot': 'Mon 06:00 UTC', 'bucket': 1794810000, 'window': [1794809100, 1794810300], 'recent_deploys': [], 'discriminator': 'neo_qpm'}, 'evidence': [{'label': 'Service', 'href': '/service/execsvc?cluster=test26&from=1794787500&to=1794810300'}, {'label': 'Fleet vs normal', 'href': '/fleet?cluster=test26&from=1794787500&to=1794810300'}], 'provenance': {'source': 'rollup', 'collected_at': 1794810816, 'age_seconds': 16, 'stale': False, 'shown': None, 'total': None, 'truncated': False, 'coverage_from': None, 'retain_days': None, 'note': None}, 'impact': 8.8, 'status': 'resolved', 'first_seen': 1789028563, 'last_seen': 1794810817, 'resolved_at': 1794811767, 'acked_by': None, 'acked_at': None, 'snoozed_until': None, 'occurrences': 79, 'narrative': "execsvc's Neo4j load is 117 q/min on test26, above a normal of 0 q/min ± 20 q/min for this hour of the week (4 of the last 4 five-minute buckets, z = 5.8, 5 weeks of history). Whether users noticed depends on which endpoints carried it — the service page shows the split.", 'narrative_kind': 'template', 'discriminator': 'neo_qpm', 'level': 'low', 'told_level': None, 'episode_at': 1794809637, 'chat_thread': None, 'kind_label': 'Neo4j load anomaly', 'group': 'Anomalies', 'age_s': 5783221, 'stale_s': 967}
Check it yourself
Every link carries the finding's own time window, so it shows tomorrow what it shows now.
Actions
Sign in (IAP) to acknowledge, snooze or resolve.
Where the numbers come from
| source | rollup |
| collected_at | 1794810816 |
| age_seconds | 16 |
| stale | False |
| shown | None |
| total | None |
| truncated | False |
| coverage_from | None |
| retain_days | None |
| note | None |
| detector | seasonal |