tmfsync: a new error shape, 16× in the last hour, never seen in 90 days (Read query failed — Cannot resolve address neo4j-neo4j-delta.neo4j-sys)
warning
Error never seen before
delta
resolved
impact 59
Owner: Sambasiva Bandarupalli (backup: Ahmed Aburaed)
opened 3d ago · last observed 3d ago · observed 4× · #17300 · f6fd94030223e6cf225a
What happened template
tmfsync logged “Read query failed — Cannot resolve address neo4j-neo4j-delta.neo4j-system.svc.cluster.local:?” 16 times in the last hour and never before in 90 days on delta (first seen 2026-11-15 06:27 UTC, raised at tilda_neo4j/client.py:716). Example trace: 6bca2b108c8a8760751fb7336b954f04.
An error shape appearing for the first time in 90 days, five or more times in an hour.
The facts
| service | tmfsync |
| caller | tilda_neo4j/client.py:716 |
| shape | Read query failed — Cannot resolve address neo4j-neo4j-delta.neo4j-system.svc.cluster.local:? |
| count | 16 |
| error_class | — |
| first_seen | 2026-11-15 06:27:45 UTC (3d ago) |
| sample | Read query failed — Cannot resolve address neo4j-neo4j-delta.neo4j-system.svc.cluster.local:7687 |
| trace | 6bca2b108c8a8760751fb7336b954f04 |
| shape_hash | d45c779f0bcc1ae9 |
| count_is_floor | no |
| discriminator | d45c779f0bcc1ae9 |
| window | 2026-11-15 06:17:13 UTC → 2026-11-15 07:17:13 UTC |
What is failing in tmfsync — the bad events, decomposed
“Bad events” are HTTP 5xx answers from tmfsync. In this finding's window (2026-11-15 06:17:13 UTC → 2026-11-15 07:17:13 UTC) there were 35; every line links to the grouped errors behind it.
GET /health/ready |
35 bad of 1201 calls · 100% of the service's 5xx |
The error shapes behind them
| 35× | Request completed — 503 since 2026-11-15 06:27:32 UTC |
| 32× | Neo4j health check failed — Cannot resolve address neo4j-neo4j-delta.neo4j-system.svc.cluster.local:7687 since 2026-11-15 06:27:35 UTC |
| 16× | Read query failed — Cannot resolve address neo4j-neo4j-delta.neo4j-system.svc.cluster.local:7687 since 2026-11-15 06:27:45 UTC |
| 15× | Unable to retrieve routing information since 2026-11-15 06:29:07 UTC |
| 11× | NEO4J EXECUTE_READ [FAILED] 0.00s — Cannot resolve address neo4j-neo4j-delta.neo4j-system.svc.cluster.local:7687 since 2026-11-15 06:27:45 UTC |
The story — No tmfsync deploy or hand change is recorded in the hour before this opened. Everything below is tmfsync only.
- 2026-11-15 06:00:00 UTCerrors tmfsync 5xx peaked at 35 in one five-minute bucket (median 0 in this window)
- 2026-11-15 06:28:58 UTCfinding · critical tmfsync: a new error shape, 35× in the last hour, never seen in 90 days (Request completed — ?)
- 2026-11-15 06:28:58 UTCfinding · warning tmfsync: a new error shape, 32× in the last hour, never seen in 90 days (Neo4j health check failed — Cannot resolve address neo4j-neo4j-delta.n)
- 2026-11-15 06:28:58 UTCfinding · warning tmfsync: a new error shape, 11× in the last hour, never seen in 90 days (NEO4J EXECUTE_READ [FAILED] ?00s — Cannot resolve address neo4j-neo4j-)
- 2026-11-15 06:28:58 UTCfinding · warning tmfsync: a new error shape, 6× in the last hour, never seen in 90 days (Reconciliation sweep failed — Cannot resolve address neo4j-neo4j-delta)
- 2026-11-15 06:28:58 UTCfinding · warning tmfsync: a new error shape, 5× in the last hour, never seen in 90 days (NEO4J EXECUTE_READ [FAILED] ?01s — Cannot resolve address neo4j-neo4j-)
- 2026-11-15 06:28:58 UTCthis finding tmfsync: a new error shape, 16× in the last hour, never seen in 90 days (Read query failed — Cannot resolve address neo4j-neo4j-delta.neo4j-sys)
History
- 2026-11-15 06:28:58 UTCopened x-ray · severity=warning title=tmfsync: a new error shape, 16× in the last hour, never seen in 90 days (Read query failed — Cannot resolve address neo4j-neo4j-delta.neo4j-sys) finding={'id': 17300, 'fingerprint': 'f6fd94030223e6cf225a', 'kind': 'error.novel', 'severity': 'warning', 'cluster': 'delta', 'subject': 'tmfsync', 'title': 'tmfsync: a new error shape, 16× in the last hour, never seen in 90 days (Read query failed — Cannot resolve address neo4j-neo4j-delta.neo4j-sys)', 'facts': {'service': 'tmfsync', 'caller': 'tilda_neo4j/client.py:716', 'shape': 'Read query failed — Cannot resolve address neo4j-neo4j-delta.neo4j-system.svc.cluster.local:?', 'count': 16, 'error_class': None, 'first_seen': 1794724065, 'sample': 'Read query failed — Cannot resolve address neo4j-neo4j-delta.neo4j-system.svc.cluster.local:7687', 'trace': 'bdc77ba1d0953372962976277987af0c', 'shape_hash': 'd45c779f0bcc1ae9', 'window': [1794720538, 1794724138], 'count_is_floor': False, 'discriminator': 'd45c779f0bcc1ae9'}, 'evidence': [{'label': 'Errors, grouped', 'href': '/errors?cluster=delta&from=1794720538&to=1794724138&service=tmfsync'}, {'label': 'Logs', 'href': '/logs?cluster=delta&from=1794720538&to=1794724138&service=tmfsync&severity=ERROR'}, {'label': 'Example trace', 'href': '/trace/bdc77ba1d0953372962976277987af0c?cluster=delta'}], 'provenance': {'source': 'live', 'collected_at': None, 'age_seconds': None, 'stale': False, 'shown': None, 'total': None, 'truncated': False, 'coverage_from': None, 'retain_days': None, 'note': 'Cloud Logging, last hour, grouped by (service, caller, shape)'}, 'impact': 58.5, 'status': 'open', 'first_seen': 1794724138, 'last_seen': 1794724138, 'resolved_at': None, 'acked_by': None, 'acked_at': None, 'snoozed_until': None, 'occurrences': 1, 'narrative': None, 'narrative_kind': None, 'discriminator': 'd45c779f0bcc1ae9', 'level': 'medium', 'told_level': None, 'episode_at': 1794724138, 'chat_thread': None, 'kind_label': 'Error never seen before', 'group': 'Errors', 'age_s': 32, 'stale_s': 32}
- 2026-11-17 10:21:45 UTCresolved x-ray · reason=not observed grace_s=900 finding={'id': 17300, 'fingerprint': 'f6fd94030223e6cf225a', 'kind': 'error.novel', 'severity': 'warning', 'cluster': 'delta', 'subject': 'tmfsync', 'title': 'tmfsync: a new error shape, 16× in the last hour, never seen in 90 days (Read query failed — Cannot resolve address neo4j-neo4j-delta.neo4j-sys)', 'facts': {'service': 'tmfsync', 'caller': 'tilda_neo4j/client.py:716', 'shape': 'Read query failed — Cannot resolve address neo4j-neo4j-delta.neo4j-system.svc.cluster.local:?', 'count': 16, 'error_class': None, 'first_seen': 1794724065, 'sample': 'Read query failed — Cannot resolve address neo4j-neo4j-delta.neo4j-system.svc.cluster.local:7687', 'trace': '6bca2b108c8a8760751fb7336b954f04', 'shape_hash': 'd45c779f0bcc1ae9', 'window': [1794723433, 1794727033], 'count_is_floor': False, 'discriminator': 'd45c779f0bcc1ae9'}, 'evidence': [{'label': 'Errors, grouped', 'href': '/errors?cluster=delta&from=1794723433&to=1794727033&service=tmfsync'}, {'label': 'Logs', 'href': '/logs?cluster=delta&from=1794723433&to=1794727033&service=tmfsync&severity=ERROR'}, {'label': 'Example trace', 'href': '/trace/6bca2b108c8a8760751fb7336b954f04?cluster=delta'}], 'provenance': {'source': 'live', 'collected_at': None, 'age_seconds': None, 'stale': False, 'shown': None, 'total': None, 'truncated': False, 'coverage_from': None, 'retain_days': None, 'note': 'Cloud Logging, last hour, grouped by (service, caller, shape)'}, 'impact': 59.3, 'status': 'resolved', 'first_seen': 1794724138, 'last_seen': 1794727033, 'resolved_at': 1794910905, 'acked_by': None, 'acked_at': None, 'snoozed_until': None, 'occurrences': 4, 'narrative': 'tmfsync logged “Read query failed — Cannot resolve address neo4j-neo4j-delta.neo4j-system.svc.cluster.local:?” 16 times in the last hour and never before in 90 days on delta (first seen 2026-11-15 06:27 UTC, raised at tilda_neo4j/client.py:716). Example trace: 6bca2b108c8a8760751fb7336b954f04.', 'narrative_kind': 'template', 'discriminator': 'd45c779f0bcc1ae9', 'level': 'medium', 'told_level': None, 'episode_at': 1794724138, 'chat_thread': None, 'kind_label': 'Error never seen before', 'group': 'Errors', 'age_s': 186814, 'stale_s': 183919}
Check it yourself
Every link carries the finding's own time window, so it shows tomorrow what it shows now.
Actions
Sign in (IAP) to acknowledge, snooze or resolve.
Where the numbers come from
| source | live |
| collected_at | None |
| age_seconds | None |
| stale | False |
| shown | None |
| total | None |
| truncated | False |
| coverage_from | None |
| retain_days | None |
| note | Cloud Logging, last hour, grouped by (service, caller, shape) |
| detector | errors_novel |