tmfsync request rate 20.0 req/min vs a normal 0.0 req/min ± 5.0 req/min for Tue 10:00 UTC (4 of the last 4 checks)
info
Traffic anomaly
delta
resolved
impact 33
Owner: Sambasiva Bandarupalli (backup: Ahmed Aburaed)
opened 14d ago · last observed 1d ago · observed 944× · #16153 · 200f52d1fe50144b8f70
What happened template
tmfsync's request rate is 20.0 req/min on delta, above a normal of 0.0 req/min ± 5.0 req/min for this hour of the week (4 of the last 4 five-minute buckets, z = 4.0, 4 weeks of history). Whether users noticed depends on which endpoints carried it — the service page shows the split.
Requests per minute far outside what this hour of the week normally sees.
The facts
| measure | api_rpm |
| unit | req/min |
| value | 20.00 |
| expected_median | 0.00 |
| expected_mad | 5.00 |
| z | 4.00 |
| rel | inf |
| buckets_hit | 4 |
| n | 48 |
| weeks | 4 |
| slot | Tue 10:00 UTC |
| bucket | 2026-11-17 10:00:00 UTC (1d ago) |
| discriminator | api_rpm |
| window | 2026-11-17 09:45:00 UTC → 2026-11-17 10:05:00 UTC |
What is failing in tmfsync — the bad events, decomposed
“Bad events” are HTTP 5xx answers from tmfsync. In this finding's window (2026-11-17 09:45:00 UTC → 2026-11-17 10:05:00 UTC) there were 0; every line links to the grouped errors behind it.
The error shapes behind them
| 35× | Request completed — 503 since 2026-11-15 06:27:32 UTC |
| 32× | Neo4j health check failed — Cannot resolve address neo4j-neo4j-delta.neo4j-system.svc.cluster.local:7687 since 2026-11-15 06:27:35 UTC |
| 16× | Read query failed — Cannot resolve address neo4j-neo4j-delta.neo4j-system.svc.cluster.local:7687 since 2026-11-15 06:27:45 UTC |
| 15× | Unable to retrieve routing information since 2026-11-15 06:29:07 UTC |
| 11× | NEO4J EXECUTE_READ [FAILED] 0.00s — Cannot resolve address neo4j-neo4j-delta.neo4j-system.svc.cluster.local:7687 since 2026-11-15 06:27:45 UTC |
History
- 2026-11-17 10:40:41 UTCresolved x-ray · reason=not observed grace_s=900 finding={'id': 16153, 'fingerprint': '200f52d1fe50144b8f70', 'kind': 'anomaly.traffic', 'severity': 'info', 'cluster': 'delta', 'subject': 'tmfsync', 'title': 'tmfsync request rate 20.0 req/min vs a normal 0.0 req/min ± 5.0 req/min for Tue 10:00 UTC (4 of the last 4 checks)', 'facts': {'measure': 'api_rpm', 'unit': 'req/min', 'value': 20.0, 'expected_median': 0.0, 'expected_mad': 5.0, 'z': 4.0, 'rel': inf, 'buckets_hit': 4, 'n': 48, 'weeks': 4, 'slot': 'Tue 10:00 UTC', 'bucket': 1794909600, 'window': [1794908700, 1794909900], 'recent_deploys': [], 'discriminator': 'api_rpm'}, 'evidence': [{'label': 'Service', 'href': '/service/tmfsync?cluster=delta&from=1794887100&to=1794909900'}, {'label': 'Fleet vs normal', 'href': '/fleet?cluster=delta&from=1794887100&to=1794909900'}], 'provenance': {'source': 'rollup', 'collected_at': 1794910482, 'age_seconds': 444, 'stale': False, 'shown': None, 'total': None, 'truncated': False, 'coverage_from': None, 'retain_days': None, 'note': None}, 'impact': 32.9, 'status': 'resolved', 'first_seen': 1793789320, 'last_seen': 1794910905, 'resolved_at': 1794912041, 'acked_by': None, 'acked_at': None, 'snoozed_until': None, 'occurrences': 944, 'narrative': "tmfsync's request rate is 20.0 req/min on delta, above a normal of 0.0 req/min ± 5.0 req/min for this hour of the week (4 of the last 4 five-minute buckets, z = 4.0, 4 weeks of history). Whether users noticed depends on which endpoints carried it — the service page shows the split.", 'narrative_kind': 'template', 'discriminator': 'api_rpm', 'level': 'low', 'told_level': None, 'episode_at': 1794640487, 'chat_thread': None, 'kind_label': 'Traffic anomaly', 'group': 'Anomalies', 'age_s': 1122741, 'stale_s': 1156}
Check it yourself
Every link carries the finding's own time window, so it shows tomorrow what it shows now.
Actions
Sign in (IAP) to acknowledge, snooze or resolve.
Where the numbers come from
| source | rollup |
| collected_at | 1794910482 |
| age_seconds | 444 |
| stale | False |
| shown | None |
| total | None |
| truncated | False |
| coverage_from | None |
| retain_days | None |
| note | None |
| detector | seasonal |