Xray
daily rollups 1h 6h 24h 48h 3d 5d 7d 14d 30d ‹
Last 7 days▾
Ends now. Anything up to this cluster's 30-day retention.
Start and end times
Cancel
Interpreted in UTC (change it at the right of this bar). Earliest available: 2026-10-19 20:50:32.
› →|
updated 1d ago
Sample data. This database was generated by scripts/seed_dev_db.py — every service, deploy, person and figure on this page is synthetic. Names are sample.*@seed.invalid and image tags are prefixed SEED-. Nothing here happened.
← findings

Neo4j shared Neo4j, database master: 29 Cypher queries failed in the last 15 min

warning Neo4j queries failing master open impact 57 opened 22d ago · last observed 2d ago · observed 183× · #7603 · 5115e9f72222f6e639d2

What happened template

Neo4j queries failing: Neo4j shared Neo4j, database master: 29 Cypher queries failed in the last 15 min. Facts: env shared, database master, failed 29, window_min 15, project tilda-trial-dev.

A Neo4j database failing Cypher executions (its own db_query_execution_failure_total): syntax or constraint errors, deadlocks, timeouts, auth -- each one a request that did not get its data.

First look — investigated before anyone looked

Cause not clear from logs and recent changes; 35 Cypher queries failed in 15 min on shared Neo4j, database master (project tilda-trial-dev). 182 occurrences since onset 2026-11-06 08:47 UTC, last seen 2026-11-16 16:55 UTC.
This is a recurrence. The first episode opened 2026-10-27 and expired 2026-11-03, also without a clear cause.
Checked 12 autosync deploys 110-112 min before onset, all config revision 882d8d8dc34a with no image tag. Nothing links them to Neo4j.
The closest stored error is regsvc pubsub/pubsub.go:390 'Organization ... not found' (231 lines). That shape has existed since 2026-10-26 and is not new.
Next step: open the Neo4j error logs for the window to get the failing Cypher text, error code and calling service.

low confidence

claude-opus-5-5 · 2d ago · $0.04 — every link above is evidence it read; nothing else was claimed.

The facts

envshared
databasemaster
failed29
window_min15
projecttilda-trial-dev
discriminatormaster
window2026-11-16 16:53:48 UTC → 2026-11-16 17:08:48 UTC

The story — No deploy or hand change is recorded in the hour before this opened.

History

  • 2026-11-16 16:55:04 UTCescalated x-ray · severity=critical was=warning title=Neo4j shared Neo4j, database master: 35 Cypher queries failed in the last 15 min level=high was_level=medium finding={'id': 7603, 'fingerprint': '5115e9f72222f6e639d2', 'kind': 'neo4j.errors', 'severity': 'critical', 'cluster': 'master', 'subject': 'neo4j shared/master', 'title': 'Neo4j shared Neo4j, database master: 35 Cypher queries failed in the last 15 min', 'facts': {'env': 'shared', 'database': 'master', 'failed': 35, 'window_min': 15, 'window': [1794847204, 1794848104], 'project': 'tilda-trial-dev', 'discriminator': 'master'}, 'evidence': [{'label': 'Neo4j tab (failures / min by database)', 'href': '/neo4j?cluster=master&from=1794826504&to=1794848104'}, {'label': 'Neo4j error logs', 'href': '/logs?cluster=master&from=1794847204&to=1794848104&service=neo4j&severity=ERROR'}], 'provenance': {'source': 'live', 'note': 'Managed Prometheus: neo4j db_query_execution_failure_total'}, 'impact': 76.0, 'status': 'open', 'first_seen': 1793115258, 'last_seen': 1794848104, 'resolved_at': None, 'acked_by': None, 'acked_at': None, 'snoozed_until': None, 'occurrences': 182, 'narrative': 'Neo4j queries failing: Neo4j shared Neo4j, database master: 11 Cypher queries failed in the last 15 min. Facts: env shared, database master, failed 11, window_min 15, project tilda-trial-dev.', 'narrative_kind': 'template', 'discriminator': 'master', 'level': 'high', 'told_level': None, 'episode_at': 1793954871, 'chat_thread': None, 'kind_label': 'Neo4j queries failing', 'group': 'Neo4j', 'age_s': 1732855, 'stale_s': 9}

Check it yourself

Every link carries the finding's own time window, so it shows tomorrow what it shows now.

Actions

Sign in (IAP) to acknowledge, snooze or resolve.

Where the numbers come from

sourcelive
noteManaged Prometheus: neo4j db_query_execution_failure_total
detectorneo4j_errors