Xray
1h 6h 24h 48h 3d 5d 7d 14d 30d ‹
Last 1 hour▾
Ends now. Anything up to this cluster's 30-day retention.
Start and end times
Cancel
Interpreted in UTC (change it at the right of this bar). Earliest available: 2026-10-19 11:00:50.
› →|
updated 1d ago
Sample data. This database was generated by scripts/seed_dev_db.py — every service, deploy, person and figure on this page is synthetic. Names are sample.*@seed.invalid and image tags are prefixed SEED-. Nothing here happened.

Neo4j schema master

Every Go service creates the constraints and indexes for the labels it owns when it boots, by reading the live schema (main #16243). A constraint the data violates does not fail the boot: a standby _idx index stands in and the object reads DEGRADED until the rows are fixed — often by a data migration that needs a person. This page shows what each service found on its latest boot, what is blocking each degraded object, and how the clusters compare. UNEXPECTED objects (in the database, not in the model) are informational — usually an older key waiting on its two-release retirement — and never make a service unhealthy.

Last refreshed never · read every 6 h — only the minutes around each service start
Services healthy
11 / 12
1 carry a degraded, drifted or failed object
Objects not in place
1
1 degraded · 0 drift · 0 failed
Migrations waiting on a person
0
0 failed · 0 blocked · 0 pending
Objects in place
650
0 created on the latest boots · 13 undeclared (informational)

Newest boot 27 h ago. Convergence runs only at boot, so a report is what the service found when it last started — data fixed since then shows on its next boot.

Services 12

One row per owning service, unhealthy first. The bar is every object the service owns, by what convergence found.

presentcreatedretireddegradeddriftfailedunexpected
servicestateobjectsnot in place data migrationsreportedearlier boots
execsvc unhealthy
187 objects
1 degraded
8 / 8 applied · counted
8 applied on earlier boots (counted, not listed)
33 h ago
boot · pod r9qwj
docsvc healthy
81 objects
1 undeclared
6 / 6 applied · counted
6 applied on earlier boots (counted, not listed)
29 h ago
boot · pod vkdnp
enrollsvc healthy
30 objects
— none declared 40 h ago
boot · pod j42md
finsvc healthy
29 objects
— none declared 40 h ago
boot · pod m6lxh
notifsvc healthy
23 objects
— none declared 40 h ago
boot · pod v942z
onboardingsvc healthy
79 objects
2 undeclared
3 / 3 applied · counted
3 applied on earlier boots (counted, not listed)
36 h ago
boot · pod 2q9qh
patientsvc healthy
47 objects
— none declared 40 h ago
boot · pod wf79q
regsvc healthy
22 objects
— none declared 40 h ago
boot · pod tm77n
schedsvc healthy
15 objects
— none declared 40 h ago
boot · pod dk7vc
studiosvc healthy
100 objects
10 undeclared
10 / 10 applied · counted
10 applied on earlier boots (counted, not listed)
27 h ago
boot · pod f4w4n
tusker healthy
18 objects
—
1 / 1 applied · counted
1 applied on earlier boots (counted, not listed)
40 h ago
boot · pod rdt7g
workplansvc healthy
33 objects
—
2 / 2 applied · counted
2 applied on earlier boots (counted, not listed)
40 h ago
boot · pod d7hwv

Objects not in place 1

Each one, with how much of its data violates the key, the migration that would heal it, and whether other clusters have the same problem — degraded on production as well usually means the declared key is wrong, not the data.

StudyNotification_email_notificationType_studyId_deltimestamp

DEGRADEDexecsvc
:StudyNotification emailnotificationTypestudyIddeltimestamp
3 duplicate keys over 10 nodes — 32.26% of the label
standby index "StudyNotification_email_notificationType_studyId_deltimestamp_idx" still stands in for the constraint: 0 rows with a null key property (of 31), 3 duplicate keys over 10 nodes
Next: no migration needing attention targets it; 8 applied one(s) are not listed by the boot log — check whether one of those was meant to fix it. Also on: test26 · 16.67%

Every cluster 7

Objects not in place per service and cluster (green = healthy). A problem on one dev cluster is stale data; the same one on production is the model. Click a cell for that cluster.

servicemasterautomationnexusproductiondeltatest27test26
advpsvc · ✓ · · · ✓ ✓
authz · · · · · · 3
budgetsvc · · · · · ✓ ·
docsvc ✓ ✓ ✓ ✓ ✓ ✓ ✓
enrollsvc ✓ ✓ ✓ ✓ ✓ ✓ ✓
execsvc 1 ✓ ✓ ✓ ✓ 1 1
finsvc ✓ ✓ ✓ ✓ ✓ ✓ ✓
notifsvc ✓ ✓ ✓ ✓ ✓ ✓ ✓
onboardingsvc ✓ ✓ ✓ ✓ ✓ ✓ ✓
patientsvc ✓ ✓ ✓ ✓ ✓ ✓ ✓
regsvc ✓ ✓ ✓ ✓ ✓ ✓ ✓
schedsvc ✓ ✓ ✓ ✓ ✓ ✓ ✓
studiosvc ✓ ✓ ✓ ✓ ✓ 2 ✓
tusker ✓ ✓ ✓ ✓ ✓ ✓ ✓
workplansvc ✓ ✓ ✓ ✓ ✓ 3 ✓

Undeclared objects 13

In the database, absent from the data model. Never dropped automatically: each is a pending retirement (declare it in schema_retired.go with its ReplacedBy) or something created outside the model. Not unhealthy.

docsvc — 1
objectlabelproperties
Document_status_archivedDocument statusarchived
onboardingsvc — 2
objectlabelproperties
MemberLabelScopeIdScopeTypeIndexMemberLabel scopeIdscopeType
MemberLabelGroupScopeIdScopeTypeIndexMemberLabelGroup scopeIdscopeType
studiosvc — 10
objectlabelproperties
DocOverlayV2_orgid_scopeid_state_title_version_deltimestampDocOverlayV2 orgidscopeidstatetitleversiondeltimestamp
Trigger_state_version_deltimestamp_scope_operation_orgidTrigger stateversiondeltimestampscopeoperationorgid
Statement_orgid_scopeid_smoversion_state_title_variablename_version_deltimestampStatement orgidscopeidsmoversionstatetitlevariablenameversiondeltimestamp
TodoV2_state_title_version_deltimestampTodoV2 statetitleversiondeltimestamp
DocUpload_orgid_scopeid_state_title_version_deltimestampDocUpload orgidscopeidstatetitleversiondeltimestamp
ESign_archivedtimestamp_scopeid_state_title_version_deltimestampESign archivedtimestampscopeidstatetitleversiondeltimestamp
DocReview_orgid_scopeid_state_title_version_deltimestampDocReview orgidscopeidstatetitleversiondeltimestamp
TaskConfig_orgid_scopeid_state_title_version_deltimestampTaskConfig orgidscopeidstatetitleversiondeltimestamp
Timer_state_title_version_deltimestampTimer statetitleversiondeltimestamp
ResponseSet_name_orgid_scopeid_shared_smoversion_state_variablename_version_deltimestampResponseSet nameorgidscopeidsharedsmoversionstatevariablenameversiondeltimestamp