Xray
daily rollups 1h 6h 24h 48h 3d 5d 7d 14d 30d ‹
Last 7 days▾
Ends now. Anything up to this cluster's 30-day retention.
Start and end times
Cancel
Interpreted in UTC (change it at the right of this bar). Earliest available: 2026-10-19 22:14:28.
› →|
updated 1d ago
Sample data. This database was generated by scripts/seed_dev_db.py — every service, deploy, person and figure on this page is synthetic. Names are sample.*@seed.invalid and image tags are prefixed SEED-. Nothing here happened.
← findings

workplansvc shape 252AE86D: p95 184 ms → 313 ms across automated's deploy at 2026-11-16 18:21:05 UTC (p = 1.3e-11, 201/259 runs)

warning Query shape regressed at a deploy master open impact 27 Owner: Suresh Boddapati (backup: Madhava Mukkamala) opened 2d ago · last observed 1d ago · observed 17× · #17483 · df6ca3618997c8cba3a9

What happened template

workplansvc shape 252AE86D ran slower after automated deployed workplansvc at 2026-11-16 18:21 UTC: p95 184 ms → 313 ms (1.7×) over 201 vs 259 executions, and the two latency distributions differ with p = 1.26e-11. That is the deploy being tested, not blamed: the statement itself may be unchanged and the data larger.

A shape's latency distribution changed significantly across a deploy.

The facts

serviceworkplansvc
appworkplansvc
plan_hash252AE86D
deploy_ts1,794,853,265
whoautomated
image—
revisionf945c27fcd6b8f50f8bca83b403e11f13d564259
p95_before183.52
p95_after313.44
ratio1.71
n_before201
n_after259
p0.00
chi250.20
dof2
sampleMATCH (wp:WorkPlanInstance)-[:WORKPLAN_INSTANCE_TO_MILESTONE]->(:WorkPlanMilestone)-[:REL_WORKPLAN_INSTANCE_MILESTONE_TO_ITEM]->(item:WorkplanInstanceMilestoneItem) WHERE wp.state <> ? AND coalesce(item.skippedAt, ?) = ? AND coalesce(item.notApplicableAt, ?) = ? AND (coalesce(item.workOrderCreateUnr
discriminator252AE86D|1794853265
window2026-11-16 17:21:05 UTC → 2026-11-16 19:21:05 UTC

The story — No workplansvc deploy or hand change is recorded in the hour before this opened. Everything below is workplansvc only.

  • 2026-11-16 19:33:28 UTCthis finding workplansvc shape 252AE86D: p95 184 ms → 313 ms across automated's deploy at 2026-11-16 18:21:05 UTC (p = 1.3e-11, 201/259 runs)

History

  • 2026-11-16 19:33:28 UTCopened x-ray · severity=warning title=workplansvc shape 252AE86D: p95 184 ms → 313 ms across automated's deploy at 2026-11-16 18:21:05 UTC (p = 1.3e-11, 201/259 runs) finding={'id': 17483, 'fingerprint': 'df6ca3618997c8cba3a9', 'kind': 'shape.regressed', 'severity': 'warning', 'cluster': 'master', 'subject': 'workplansvc', 'title': "workplansvc shape 252AE86D: p95 184 ms → 313 ms across automated's deploy at 2026-11-16 18:21:05 UTC (p = 1.3e-11, 201/259 runs)", 'facts': {'service': 'workplansvc', 'app': 'workplansvc', 'plan_hash': '252AE86D', 'deploy_ts': 1794853265, 'who': 'automated', 'image': None, 'revision': 'f945c27fcd6b8f50f8bca83b403e11f13d564259', 'p95_before': 183.52459016393442, 'p95_after': 313.43749999999966, 'ratio': 1.7078774006252773, 'n_before': 201, 'n_after': 259, 'p': 1.2557076611456895e-11, 'chi2': 50.20147347168955, 'dof': 2, 'sample': 'MATCH (wp:WorkPlanInstance)-[:WORKPLAN_INSTANCE_TO_MILESTONE]->(:WorkPlanMilestone)-[:REL_WORKPLAN_INSTANCE_MILESTONE_TO_ITEM]->(item:WorkplanInstanceMilestoneItem) WHERE wp.state <> ? AND coalesce(item.skippedAt, ?) = ? AND coalesce(item.notApplicableAt, ?) = ? AND (coalesce(item.workOrderCreateUnr', 'window': [1794849665, 1794856865], 'discriminator': '252AE86D|1794853265'}, 'evidence': [{'label': 'Query shape', 'href': '/neo/shape/252AE86D?cluster=master&from=1794849665&to=1794856865'}, {'label': 'Changes', 'href': '/changes?cluster=master&from=1794851465&to=1794855065'}], 'provenance': {'source': 'rollup', 'collected_at': 1794857397, 'age_seconds': 230, 'stale': False, 'shown': None, 'total': None, 'truncated': False, 'coverage_from': None, 'retain_days': None, 'note': None}, 'impact': 22.4, 'status': 'open', 'first_seen': 1794857608, 'last_seen': 1794857608, 'resolved_at': None, 'acked_by': None, 'acked_at': None, 'snoozed_until': None, 'occurrences': 1, 'narrative': None, 'narrative_kind': None, 'discriminator': '252AE86D|1794853265', 'level': 'low', 'told_level': None, 'episode_at': 1794857608, 'chat_thread': None, 'kind_label': 'Query shape regressed at a deploy', 'group': 'Neo4j', 'age_s': 19, 'stale_s': 19}

Check it yourself

Every link carries the finding's own time window, so it shows tomorrow what it shows now.

Actions

Sign in (IAP) to acknowledge, snooze or resolve.

Where the numbers come from

sourcerollup
collected_at1794874689
age_seconds60
staleFalse
shownNone
totalNone
truncatedFalse
coverage_fromNone
retain_daysNone
noteNone
detectorshape_changepoint