← findings
pods on an unready node: 13 affected in 30 min
warning
Node problem
production
open
impact 35
opened 51d ago · last observed 2d ago · observed 784× · #2877 · ef8d489b946783dd6210
What happened template
Node problem: pods on an unready node: 13 affected in 30 min. Facts: reason NodeNotReady, count_30m 13, last_message Node is not ready.
A node reporting a condition (not ready, read-only filesystem, disk pressure, kubelet/containerd restarting).
The facts
| reason | NodeNotReady |
| count_30m | 13 |
| objects | collector-2vvxq, collector-96h89, collector-clbvc, collector-czfbp, collector-dg9lt, collector-hqc7g, collector-k4v7n, collector-k7xhv, collector-ldw4p, collector-msqsz |
| last_message | Node is not ready |
| discriminator | NodeNotReady |
The story — No deploy or hand change is recorded in the hour before this opened.
- 2026-09-29 15:01:38 UTCthis finding pods on an unready node: 13 affected in 30 min
- 2026-09-29 17:03:20 UTCfinding · warning cert-manager-cainjector: 8× “? err=?api\? logger=? kind=? type=? secret=? certificate=?” in 30 min — Production logs — platform errors
- 2026-09-29 18:12:37 UTCfinding · warning neo4j: 16× “(empty)” in 30 min — Production logs — Neo4j errors
- 2026-09-29 23:04:32 UTCfinding · warning ScaledJob/rag-agent-worker (tilda) cannot read its scaling metric — 2× in 2 h
- 2026-10-03 04:31:35 UTCfinding · warning HorizontalPodAutoscaler/ontologysvc-hpa (tilda) cannot read its scaling metric — 4× in 2 h
- 2026-10-13 15:54:07 UTCfinding · critical onboardingsvc GET /api/myprofile/visibility/study/:id/blindedScopes: 15 of 15 calls failed (100 %) in the last 15 min
- 2026-10-18 18:16:26 UTCfinding · critical docproc GET /api/v1/docproc/ai-runs/:id: permission denied — 28 of 53 calls (53 %; 403×28) in the last 15 min — it usually has none
- 2026-10-19 06:46:26 UTCfinding · critical notifsvc GET /api/v1/notif/uievents: permission denied — 28 of 39 calls (72 %; 401×28) in the last 15 min — 11× its usual 2.6
- 2026-10-23 13:03:15 UTCfinding · info virtual-assistant: Neo4j queries per request 83.8 — 14.0× the fleet's usual 6.0
- 2026-11-16 00:15:00 UTClatency cluster p95 peaked at 4.55 s
- 2026-11-16 05:10:11 UTCdeploy [email protected] deployed data-monitor
- 2026-11-16 05:10:12 UTCdeploy [email protected] deployed chat-agent
- 2026-11-16 05:10:12 UTCdeploy [email protected] deployed dashrsvc
- 2026-11-16 05:10:12 UTCdeploy [email protected] deployed workplansvc-infra-production
- 2026-11-16 05:10:13 UTCdeploy [email protected] deployed execsvc
- 2026-11-16 05:10:13 UTCdeploy [email protected] deployed dashql
- 2026-11-16 05:10:13 UTCdeploy [email protected] deployed enrollsvc
- 2026-11-16 05:10:14 UTCdeploy [email protected] deployed exportsvc
- 2026-11-16 05:10:14 UTCdeploy [email protected] deployed docsvc
- 2026-11-16 05:10:14 UTCdeploy [email protected] deployed finsvc
- 2026-11-16 05:10:15 UTCdeploy [email protected] deployed notifsvc
- 2026-11-16 05:10:16 UTCdeploy [email protected] deployed onboardingsvc
- 2026-11-16 05:10:17 UTCdeploy [email protected] deployed patientsvc
- 2026-11-16 05:10:19 UTCdeploy [email protected] deployed docproc
- 2026-11-16 05:10:23 UTCdeploy [email protected] deployed ontologysvc
- 2026-11-16 05:10:23 UTCdeploy [email protected] deployed schedsvc
- 2026-11-16 05:10:24 UTCdeploy [email protected] deployed studiosvc
- 2026-11-16 05:10:24 UTCdeploy [email protected] deployed regsvc
- 2026-11-16 05:10:24 UTCdeploy [email protected] deployed tusker
- 2026-11-16 05:10:24 UTCdeploy [email protected] deployed tmfsync
- 2026-11-16 05:10:25 UTCdeploy [email protected] deployed studioaisvc
- 2026-11-16 05:10:25 UTCdeploy [email protected] deployed rag-agent
- 2026-11-16 05:10:25 UTCdeploy [email protected] deployed workplan-agent
- 2026-11-16 05:10:25 UTCdeploy [email protected] deployed virtual-assistant
- 2026-11-16 05:10:25 UTCdeploy [email protected] deployed workplansvc
- 2026-11-16 05:10:51 UTCdeploy [email protected] deployed asm
- 2026-11-17 00:20:00 UTCerrors cluster 5xx peaked at 15 in one five-minute bucket (median 0 in this window)
History
- 2026-11-15 05:48:18 UTCreopened x-ray · severity=warning was=warning title=pods on an unready node: 1 affected in 30 min level=medium was_level=medium finding={'id': 2877, 'fingerprint': 'ef8d489b946783dd6210', 'kind': 'node.unhealthy', 'severity': 'warning', 'cluster': 'production', 'subject': 'node/NodeNotReady', 'title': 'pods on an unready node: 1 affected in 30 min', 'facts': {'reason': 'NodeNotReady', 'count_30m': 1, 'objects': ['collector-7w9w6'], 'last_message': 'Node is not ready', 'discriminator': 'NodeNotReady'}, 'evidence': [{'label': 'Kubernetes events', 'href': '/logs?cluster=production&from=1794718098&to=1794721698&source=events'}, {'label': 'Pods', 'href': '/pods?cluster=production'}], 'provenance': {'source': 'x-ray', 'note': 'Kubernetes events (logs/events in BigQuery), last 45 min'}, 'impact': 29.7, 'status': 'open', 'first_seen': 1790694098, 'last_seen': 1794721698, 'resolved_at': None, 'acked_by': None, 'acked_at': None, 'snoozed_until': None, 'occurrences': 683, 'narrative': 'Node problem: pods on an unready node: 1 affected in 30 min. Facts: reason NodeNotReady, count_30m 1, last_message Node is not ready.', 'narrative_kind': 'template', 'discriminator': 'NodeNotReady', 'level': 'medium', 'told_level': 'medium', 'episode_at': 1794721698, 'chat_thread': None, 'kind_label': 'Node problem', 'group': 'Platform', 'age_s': 4027617, 'stale_s': 17}
- 2026-11-15 06:28:58 UTCresolved x-ray · reason=not observed grace_s=900 finding={'id': 2877, 'fingerprint': 'ef8d489b946783dd6210', 'kind': 'node.unhealthy', 'severity': 'warning', 'cluster': 'production', 'subject': 'node/NodeNotReady', 'title': 'pods on an unready node: 1 affected in 30 min', 'facts': {'reason': 'NodeNotReady', 'count_30m': 1, 'objects': ['collector-7w9w6'], 'last_message': 'Node is not ready', 'discriminator': 'NodeNotReady'}, 'evidence': [{'label': 'Kubernetes events', 'href': '/logs?cluster=production&from=1794719270&to=1794722870&source=events'}, {'label': 'Pods', 'href': '/pods?cluster=production'}], 'provenance': {'source': 'x-ray', 'note': 'Kubernetes events (logs/events in BigQuery), last 45 min'}, 'impact': 34.7, 'status': 'resolved', 'first_seen': 1790694098, 'last_seen': 1794722870, 'resolved_at': 1794724138, 'acked_by': None, 'acked_at': None, 'snoozed_until': None, 'occurrences': 686, 'narrative': 'Node problem: pods on an unready node: 1 affected in 30 min. Facts: reason NodeNotReady, count_30m 1, last_message Node is not ready.', 'narrative_kind': 'template', 'discriminator': 'NodeNotReady', 'level': 'medium', 'told_level': 'medium', 'episode_at': 1794721698, 'chat_thread': None, 'kind_label': 'Node problem', 'group': 'Platform', 'age_s': 4030060, 'stale_s': 1288}
- 2026-11-15 06:52:53 UTCreopened x-ray · severity=warning was=warning title=pods on an unready node: 1 affected in 30 min level=medium was_level=medium finding={'id': 2877, 'fingerprint': 'ef8d489b946783dd6210', 'kind': 'node.unhealthy', 'severity': 'warning', 'cluster': 'production', 'subject': 'node/NodeNotReady', 'title': 'pods on an unready node: 1 affected in 30 min', 'facts': {'reason': 'NodeNotReady', 'count_30m': 1, 'objects': ['collector-q8rjd'], 'last_message': 'Node is not ready', 'discriminator': 'NodeNotReady'}, 'evidence': [{'label': 'Kubernetes events', 'href': '/logs?cluster=production&from=1794721973&to=1794725573&source=events'}, {'label': 'Pods', 'href': '/pods?cluster=production'}], 'provenance': {'source': 'x-ray', 'note': 'Kubernetes events (logs/events in BigQuery), last 45 min'}, 'impact': 29.7, 'status': 'open', 'first_seen': 1790694098, 'last_seen': 1794725573, 'resolved_at': None, 'acked_by': None, 'acked_at': None, 'snoozed_until': None, 'occurrences': 687, 'narrative': 'Node problem: pods on an unready node: 1 affected in 30 min. Facts: reason NodeNotReady, count_30m 1, last_message Node is not ready.', 'narrative_kind': 'template', 'discriminator': 'NodeNotReady', 'level': 'medium', 'told_level': 'medium', 'episode_at': 1794725573, 'chat_thread': None, 'kind_label': 'Node problem', 'group': 'Platform', 'age_s': 4031491, 'stale_s': 16}
- 2026-11-15 07:38:58 UTCresolved x-ray · reason=not observed grace_s=900 finding={'id': 2877, 'fingerprint': 'ef8d489b946783dd6210', 'kind': 'node.unhealthy', 'severity': 'warning', 'cluster': 'production', 'subject': 'node/NodeNotReady', 'title': 'pods on an unready node: 1 affected in 30 min', 'facts': {'reason': 'NodeNotReady', 'count_30m': 1, 'objects': ['collector-q8rjd'], 'last_message': 'Node is not ready', 'discriminator': 'NodeNotReady'}, 'evidence': [{'label': 'Kubernetes events', 'href': '/logs?cluster=production&from=1794723433&to=1794727033&source=events'}, {'label': 'Pods', 'href': '/pods?cluster=production'}], 'provenance': {'source': 'x-ray', 'note': 'Kubernetes events (logs/events in BigQuery), last 45 min'}, 'impact': 34.7, 'status': 'resolved', 'first_seen': 1790694098, 'last_seen': 1794727033, 'resolved_at': 1794728338, 'acked_by': None, 'acked_at': None, 'snoozed_until': None, 'occurrences': 690, 'narrative': 'Node problem: pods on an unready node: 1 affected in 30 min. Facts: reason NodeNotReady, count_30m 1, last_message Node is not ready.', 'narrative_kind': 'template', 'discriminator': 'NodeNotReady', 'level': 'medium', 'told_level': 'medium', 'episode_at': 1794725573, 'chat_thread': None, 'kind_label': 'Node problem', 'group': 'Platform', 'age_s': 4034286, 'stale_s': 1351}
- 2026-11-15 07:55:18 UTCreopened x-ray · severity=warning was=warning title=pods on an unready node: 1 affected in 30 min level=medium was_level=medium finding={'id': 2877, 'fingerprint': 'ef8d489b946783dd6210', 'kind': 'node.unhealthy', 'severity': 'warning', 'cluster': 'production', 'subject': 'node/NodeNotReady', 'title': 'pods on an unready node: 1 affected in 30 min', 'facts': {'reason': 'NodeNotReady', 'count_30m': 1, 'objects': ['collector-l56j6'], 'last_message': 'Node is not ready', 'discriminator': 'NodeNotReady'}, 'evidence': [{'label': 'Kubernetes events', 'href': '/logs?cluster=production&from=1794725718&to=1794729318&source=events'}, {'label': 'Pods', 'href': '/pods?cluster=production'}], 'provenance': {'source': 'x-ray', 'note': 'Kubernetes events (logs/events in BigQuery), last 45 min'}, 'impact': 29.7, 'status': 'open', 'first_seen': 1790694098, 'last_seen': 1794729318, 'resolved_at': None, 'acked_by': None, 'acked_at': None, 'snoozed_until': None, 'occurrences': 691, 'narrative': 'Node problem: pods on an unready node: 1 affected in 30 min. Facts: reason NodeNotReady, count_30m 1, last_message Node is not ready.', 'narrative_kind': 'template', 'discriminator': 'NodeNotReady', 'level': 'medium', 'told_level': 'medium', 'episode_at': 1794729318, 'chat_thread': None, 'kind_label': 'Node problem', 'group': 'Platform', 'age_s': 4035240, 'stale_s': 20}
- 2026-11-15 08:32:27 UTCresolved x-ray · reason=not observed grace_s=900 finding={'id': 2877, 'fingerprint': 'ef8d489b946783dd6210', 'kind': 'node.unhealthy', 'severity': 'warning', 'cluster': 'production', 'subject': 'node/NodeNotReady', 'title': 'pods on an unready node: 1 affected in 30 min', 'facts': {'reason': 'NodeNotReady', 'count_30m': 1, 'objects': ['collector-l56j6'], 'last_message': 'Node is not ready', 'discriminator': 'NodeNotReady'}, 'evidence': [{'label': 'Kubernetes events', 'href': '/logs?cluster=production&from=1794726806&to=1794730406&source=events'}, {'label': 'Pods', 'href': '/pods?cluster=production'}], 'provenance': {'source': 'x-ray', 'note': 'Kubernetes events (logs/events in BigQuery), last 45 min'}, 'impact': 34.7, 'status': 'resolved', 'first_seen': 1790694098, 'last_seen': 1794730406, 'resolved_at': 1794731547, 'acked_by': None, 'acked_at': None, 'snoozed_until': None, 'occurrences': 693, 'narrative': 'Node problem: pods on an unready node: 1 affected in 30 min. Facts: reason NodeNotReady, count_30m 1, last_message Node is not ready.', 'narrative_kind': 'template', 'discriminator': 'NodeNotReady', 'level': 'medium', 'told_level': 'medium', 'episode_at': 1794729318, 'chat_thread': None, 'kind_label': 'Node problem', 'group': 'Platform', 'age_s': 4037467, 'stale_s': 1159}
- 2026-11-15 08:47:23 UTCreopened x-ray · severity=warning was=warning title=pods on an unready node: 1 affected in 30 min level=medium was_level=medium finding={'id': 2877, 'fingerprint': 'ef8d489b946783dd6210', 'kind': 'node.unhealthy', 'severity': 'warning', 'cluster': 'production', 'subject': 'node/NodeNotReady', 'title': 'pods on an unready node: 1 affected in 30 min', 'facts': {'reason': 'NodeNotReady', 'count_30m': 1, 'objects': ['collector-7x8mn'], 'last_message': 'Node is not ready', 'discriminator': 'NodeNotReady'}, 'evidence': [{'label': 'Kubernetes events', 'href': '/logs?cluster=production&from=1794728843&to=1794732443&source=events'}, {'label': 'Pods', 'href': '/pods?cluster=production'}], 'provenance': {'source': 'x-ray', 'note': 'Kubernetes events (logs/events in BigQuery), last 45 min'}, 'impact': 29.7, 'status': 'open', 'first_seen': 1790694098, 'last_seen': 1794732443, 'resolved_at': None, 'acked_by': None, 'acked_at': None, 'snoozed_until': None, 'occurrences': 694, 'narrative': 'Node problem: pods on an unready node: 1 affected in 30 min. Facts: reason NodeNotReady, count_30m 1, last_message Node is not ready.', 'narrative_kind': 'template', 'discriminator': 'NodeNotReady', 'level': 'medium', 'told_level': 'medium', 'episode_at': 1794732443, 'chat_thread': None, 'kind_label': 'Node problem', 'group': 'Platform', 'age_s': 4038361, 'stale_s': 16}
- 2026-11-15 09:24:04 UTCresolved x-ray · reason=not observed grace_s=900 finding={'id': 2877, 'fingerprint': 'ef8d489b946783dd6210', 'kind': 'node.unhealthy', 'severity': 'warning', 'cluster': 'production', 'subject': 'node/NodeNotReady', 'title': 'pods on an unready node: 1 affected in 30 min', 'facts': {'reason': 'NodeNotReady', 'count_30m': 1, 'objects': ['collector-7x8mn'], 'last_message': 'Node is not ready', 'discriminator': 'NodeNotReady'}, 'evidence': [{'label': 'Kubernetes events', 'href': '/logs?cluster=production&from=1794730139&to=1794733739&source=events'}, {'label': 'Pods', 'href': '/pods?cluster=production'}], 'provenance': {'source': 'x-ray', 'note': 'Kubernetes events (logs/events in BigQuery), last 45 min'}, 'impact': 34.7, 'status': 'resolved', 'first_seen': 1790694098, 'last_seen': 1794733739, 'resolved_at': 1794734644, 'acked_by': None, 'acked_at': None, 'snoozed_until': None, 'occurrences': 697, 'narrative': 'Node problem: pods on an unready node: 1 affected in 30 min. Facts: reason NodeNotReady, count_30m 1, last_message Node is not ready.', 'narrative_kind': 'template', 'discriminator': 'NodeNotReady', 'level': 'medium', 'told_level': 'medium', 'episode_at': 1794732443, 'chat_thread': None, 'kind_label': 'Node problem', 'group': 'Platform', 'age_s': 4040564, 'stale_s': 923}
- 2026-11-15 10:58:17 UTCreopened x-ray · severity=warning was=warning title=pods on an unready node: 1 affected in 30 min level=medium was_level=medium finding={'id': 2877, 'fingerprint': 'ef8d489b946783dd6210', 'kind': 'node.unhealthy', 'severity': 'warning', 'cluster': 'production', 'subject': 'node/NodeNotReady', 'title': 'pods on an unready node: 1 affected in 30 min', 'facts': {'reason': 'NodeNotReady', 'count_30m': 1, 'objects': ['collector-cnsds'], 'last_message': 'Node is not ready', 'discriminator': 'NodeNotReady'}, 'evidence': [{'label': 'Kubernetes events', 'href': '/logs?cluster=production&from=1794736697&to=1794740297&source=events'}, {'label': 'Pods', 'href': '/pods?cluster=production'}], 'provenance': {'source': 'x-ray', 'note': 'Kubernetes events (logs/events in BigQuery), last 45 min'}, 'impact': 29.7, 'status': 'open', 'first_seen': 1790694098, 'last_seen': 1794740297, 'resolved_at': None, 'acked_by': None, 'acked_at': None, 'snoozed_until': None, 'occurrences': 698, 'narrative': 'Node problem: pods on an unready node: 1 affected in 30 min. Facts: reason NodeNotReady, count_30m 1, last_message Node is not ready.', 'narrative_kind': 'template', 'discriminator': 'NodeNotReady', 'level': 'medium', 'told_level': 'medium', 'episode_at': 1794740297, 'chat_thread': None, 'kind_label': 'Node problem', 'group': 'Platform', 'age_s': 4046219, 'stale_s': 20}
- 2026-11-15 11:35:43 UTCresolved x-ray · reason=not observed grace_s=900 finding={'id': 2877, 'fingerprint': 'ef8d489b946783dd6210', 'kind': 'node.unhealthy', 'severity': 'warning', 'cluster': 'production', 'subject': 'node/NodeNotReady', 'title': 'pods on an unready node: 1 affected in 30 min', 'facts': {'reason': 'NodeNotReady', 'count_30m': 1, 'objects': ['collector-cnsds'], 'last_message': 'Node is not ready', 'discriminator': 'NodeNotReady'}, 'evidence': [{'label': 'Kubernetes events', 'href': '/logs?cluster=production&from=1794737855&to=1794741455&source=events'}, {'label': 'Pods', 'href': '/pods?cluster=production'}], 'provenance': {'source': 'x-ray', 'note': 'Kubernetes events (logs/events in BigQuery), last 45 min'}, 'impact': 34.7, 'status': 'resolved', 'first_seen': 1790694098, 'last_seen': 1794741455, 'resolved_at': 1794742543, 'acked_by': None, 'acked_at': None, 'snoozed_until': None, 'occurrences': 701, 'narrative': 'Node problem: pods on an unready node: 1 affected in 30 min. Facts: reason NodeNotReady, count_30m 1, last_message Node is not ready.', 'narrative_kind': 'template', 'discriminator': 'NodeNotReady', 'level': 'medium', 'told_level': 'medium', 'episode_at': 1794740297, 'chat_thread': None, 'kind_label': 'Node problem', 'group': 'Platform', 'age_s': 4048462, 'stale_s': 1105}
- 2026-11-15 19:47:21 UTCreopened x-ray · severity=warning was=warning title=pods on an unready node: 1 affected in 30 min level=medium was_level=medium finding={'id': 2877, 'fingerprint': 'ef8d489b946783dd6210', 'kind': 'node.unhealthy', 'severity': 'warning', 'cluster': 'production', 'subject': 'node/NodeNotReady', 'title': 'pods on an unready node: 1 affected in 30 min', 'facts': {'reason': 'NodeNotReady', 'count_30m': 1, 'objects': ['collector-ntgs2'], 'last_message': 'Node is not ready', 'discriminator': 'NodeNotReady'}, 'evidence': [{'label': 'Kubernetes events', 'href': '/logs?cluster=production&from=1794768441&to=1794772041&source=events'}, {'label': 'Pods', 'href': '/pods?cluster=production'}], 'provenance': {'source': 'x-ray', 'note': 'Kubernetes events (logs/events in BigQuery), last 45 min'}, 'impact': 29.7, 'status': 'open', 'first_seen': 1790694098, 'last_seen': 1794772041, 'resolved_at': None, 'acked_by': None, 'acked_at': None, 'snoozed_until': None, 'occurrences': 702, 'narrative': 'Node problem: pods on an unready node: 1 affected in 30 min. Facts: reason NodeNotReady, count_30m 1, last_message Node is not ready.', 'narrative_kind': 'template', 'discriminator': 'NodeNotReady', 'level': 'medium', 'told_level': 'medium', 'episode_at': 1794772041, 'chat_thread': None, 'kind_label': 'Node problem', 'group': 'Platform', 'age_s': 4077976, 'stale_s': 33}
- 2026-11-15 21:08:16 UTCresolved x-ray · reason=not observed grace_s=900 finding={'id': 2877, 'fingerprint': 'ef8d489b946783dd6210', 'kind': 'node.unhealthy', 'severity': 'warning', 'cluster': 'production', 'subject': 'node/NodeNotReady', 'title': 'pods on an unready node: 4 affected in 30 min', 'facts': {'reason': 'NodeNotReady', 'count_30m': 4, 'objects': ['collector-2ct27', 'collector-dp77v', 'collector-l9qcs', 'collector-mtghj'], 'last_message': 'Node is not ready', 'discriminator': 'NodeNotReady'}, 'evidence': [{'label': 'Kubernetes events', 'href': '/logs?cluster=production&from=1794772393&to=1794775993&source=events'}, {'label': 'Pods', 'href': '/pods?cluster=production'}], 'provenance': {'source': 'x-ray', 'note': 'Kubernetes events (logs/events in BigQuery), last 45 min'}, 'impact': 34.7, 'status': 'resolved', 'first_seen': 1790694098, 'last_seen': 1794775993, 'resolved_at': 1794776896, 'acked_by': None, 'acked_at': None, 'snoozed_until': None, 'occurrences': 710, 'narrative': 'Node problem: pods on an unready node: 4 affected in 30 min. Facts: reason NodeNotReady, count_30m 4, last_message Node is not ready.', 'narrative_kind': 'template', 'discriminator': 'NodeNotReady', 'level': 'medium', 'told_level': 'medium', 'episode_at': 1794772041, 'chat_thread': None, 'kind_label': 'Node problem', 'group': 'Platform', 'age_s': 4082817, 'stale_s': 922}
- 2026-11-16 00:50:21 UTCreopened x-ray · severity=warning was=warning title=pods on an unready node: 1 affected in 30 min level=medium was_level=medium finding={'id': 2877, 'fingerprint': 'ef8d489b946783dd6210', 'kind': 'node.unhealthy', 'severity': 'warning', 'cluster': 'production', 'subject': 'node/NodeNotReady', 'title': 'pods on an unready node: 1 affected in 30 min', 'facts': {'reason': 'NodeNotReady', 'count_30m': 1, 'objects': ['collector-hpq7m'], 'last_message': 'Node is not ready', 'discriminator': 'NodeNotReady'}, 'evidence': [{'label': 'Kubernetes events', 'href': '/logs?cluster=production&from=1794786621&to=1794790221&source=events'}, {'label': 'Pods', 'href': '/pods?cluster=production'}], 'provenance': {'source': 'x-ray', 'note': 'Kubernetes events (logs/events in BigQuery), last 45 min'}, 'impact': 29.7, 'status': 'open', 'first_seen': 1790694098, 'last_seen': 1794790221, 'resolved_at': None, 'acked_by': None, 'acked_at': None, 'snoozed_until': None, 'occurrences': 711, 'narrative': 'Node problem: pods on an unready node: 4 affected in 30 min. Facts: reason NodeNotReady, count_30m 4, last_message Node is not ready.', 'narrative_kind': 'template', 'discriminator': 'NodeNotReady', 'level': 'medium', 'told_level': 'medium', 'episode_at': 1794790221, 'chat_thread': None, 'kind_label': 'Node problem', 'group': 'Platform', 'age_s': 4096141, 'stale_s': 18}
- 2026-11-16 01:36:14 UTCresolved x-ray · reason=not observed grace_s=900 finding={'id': 2877, 'fingerprint': 'ef8d489b946783dd6210', 'kind': 'node.unhealthy', 'severity': 'warning', 'cluster': 'production', 'subject': 'node/NodeNotReady', 'title': 'pods on an unready node: 1 affected in 30 min', 'facts': {'reason': 'NodeNotReady', 'count_30m': 1, 'objects': ['collector-hpq7m'], 'last_message': 'Node is not ready', 'discriminator': 'NodeNotReady'}, 'evidence': [{'label': 'Kubernetes events', 'href': '/logs?cluster=production&from=1794788190&to=1794791790&source=events'}, {'label': 'Pods', 'href': '/pods?cluster=production'}], 'provenance': {'source': 'x-ray', 'note': 'Kubernetes events (logs/events in BigQuery), last 45 min'}, 'impact': 34.7, 'status': 'resolved', 'first_seen': 1790694098, 'last_seen': 1794791790, 'resolved_at': 1794792974, 'acked_by': None, 'acked_at': None, 'snoozed_until': None, 'occurrences': 715, 'narrative': 'Node problem: pods on an unready node: 1 affected in 30 min. Facts: reason NodeNotReady, count_30m 1, last_message Node is not ready.', 'narrative_kind': 'template', 'discriminator': 'NodeNotReady', 'level': 'medium', 'told_level': 'medium', 'episode_at': 1794790221, 'chat_thread': None, 'kind_label': 'Node problem', 'group': 'Platform', 'age_s': 4098920, 'stale_s': 1228}
- 2026-11-16 03:51:07 UTCreopened x-ray · severity=warning was=warning title=pods on an unready node: 1 affected in 30 min level=medium was_level=medium finding={'id': 2877, 'fingerprint': 'ef8d489b946783dd6210', 'kind': 'node.unhealthy', 'severity': 'warning', 'cluster': 'production', 'subject': 'node/NodeNotReady', 'title': 'pods on an unready node: 1 affected in 30 min', 'facts': {'reason': 'NodeNotReady', 'count_30m': 1, 'objects': ['collector-6dlds'], 'last_message': 'Node is not ready', 'discriminator': 'NodeNotReady'}, 'evidence': [{'label': 'Kubernetes events', 'href': '/logs?cluster=production&from=1794797467&to=1794801067&source=events'}, {'label': 'Pods', 'href': '/pods?cluster=production'}], 'provenance': {'source': 'x-ray', 'note': 'Kubernetes events (logs/events in BigQuery), last 45 min'}, 'impact': 29.7, 'status': 'open', 'first_seen': 1790694098, 'last_seen': 1794801067, 'resolved_at': None, 'acked_by': None, 'acked_at': None, 'snoozed_until': None, 'occurrences': 716, 'narrative': 'Node problem: pods on an unready node: 1 affected in 30 min. Facts: reason NodeNotReady, count_30m 1, last_message Node is not ready.', 'narrative_kind': 'template', 'discriminator': 'NodeNotReady', 'level': 'medium', 'told_level': 'medium', 'episode_at': 1794801067, 'chat_thread': None, 'kind_label': 'Node problem', 'group': 'Platform', 'age_s': 4106988, 'stale_s': 19}
- 2026-11-16 04:29:12 UTCresolved x-ray · reason=not observed grace_s=900 finding={'id': 2877, 'fingerprint': 'ef8d489b946783dd6210', 'kind': 'node.unhealthy', 'severity': 'warning', 'cluster': 'production', 'subject': 'node/NodeNotReady', 'title': 'pods on an unready node: 1 affected in 30 min', 'facts': {'reason': 'NodeNotReady', 'count_30m': 1, 'objects': ['collector-6dlds'], 'last_message': 'Node is not ready', 'discriminator': 'NodeNotReady'}, 'evidence': [{'label': 'Kubernetes events', 'href': '/logs?cluster=production&from=1794798852&to=1794802452&source=events'}, {'label': 'Pods', 'href': '/pods?cluster=production'}], 'provenance': {'source': 'x-ray', 'note': 'Kubernetes events (logs/events in BigQuery), last 45 min'}, 'impact': 34.7, 'status': 'resolved', 'first_seen': 1790694098, 'last_seen': 1794802452, 'resolved_at': 1794803352, 'acked_by': None, 'acked_at': None, 'snoozed_until': None, 'occurrences': 719, 'narrative': 'Node problem: pods on an unready node: 1 affected in 30 min. Facts: reason NodeNotReady, count_30m 1, last_message Node is not ready.', 'narrative_kind': 'template', 'discriminator': 'NodeNotReady', 'level': 'medium', 'told_level': 'medium', 'episode_at': 1794801067, 'chat_thread': None, 'kind_label': 'Node problem', 'group': 'Platform', 'age_s': 4109275, 'stale_s': 921}
- 2026-11-16 05:18:52 UTCreopened x-ray · severity=warning was=warning title=pods on an unready node: 1 affected in 30 min level=medium was_level=medium finding={'id': 2877, 'fingerprint': 'ef8d489b946783dd6210', 'kind': 'node.unhealthy', 'severity': 'warning', 'cluster': 'production', 'subject': 'node/NodeNotReady', 'title': 'pods on an unready node: 1 affected in 30 min', 'facts': {'reason': 'NodeNotReady', 'count_30m': 1, 'objects': ['collector-9gl6n'], 'last_message': 'Node is not ready', 'discriminator': 'NodeNotReady'}, 'evidence': [{'label': 'Kubernetes events', 'href': '/logs?cluster=production&from=1794802732&to=1794806332&source=events'}, {'label': 'Pods', 'href': '/pods?cluster=production'}], 'provenance': {'source': 'x-ray', 'note': 'Kubernetes events (logs/events in BigQuery), last 45 min'}, 'impact': 29.7, 'status': 'open', 'first_seen': 1790694098, 'last_seen': 1794806332, 'resolved_at': None, 'acked_by': None, 'acked_at': None, 'snoozed_until': None, 'occurrences': 720, 'narrative': 'Node problem: pods on an unready node: 1 affected in 30 min. Facts: reason NodeNotReady, count_30m 1, last_message Node is not ready.', 'narrative_kind': 'template', 'discriminator': 'NodeNotReady', 'level': 'medium', 'told_level': 'medium', 'episode_at': 1794806332, 'chat_thread': None, 'kind_label': 'Node problem', 'group': 'Platform', 'age_s': 4112271, 'stale_s': 37}
- 2026-11-16 06:13:57 UTCresolved x-ray · reason=not observed grace_s=900 finding={'id': 2877, 'fingerprint': 'ef8d489b946783dd6210', 'kind': 'node.unhealthy', 'severity': 'warning', 'cluster': 'production', 'subject': 'node/NodeNotReady', 'title': 'pods on an unready node: 1 affected in 30 min', 'facts': {'reason': 'NodeNotReady', 'count_30m': 1, 'objects': ['collector-n948k'], 'last_message': 'Node is not ready', 'discriminator': 'NodeNotReady'}, 'evidence': [{'label': 'Kubernetes events', 'href': '/logs?cluster=production&from=1794804434&to=1794808034&source=events'}, {'label': 'Pods', 'href': '/pods?cluster=production'}], 'provenance': {'source': 'x-ray', 'note': 'Kubernetes events (logs/events in BigQuery), last 45 min'}, 'impact': 34.7, 'status': 'resolved', 'first_seen': 1790694098, 'last_seen': 1794808034, 'resolved_at': 1794809637, 'acked_by': None, 'acked_at': None, 'snoozed_until': None, 'occurrences': 722, 'narrative': 'Node problem: pods on an unready node: 1 affected in 30 min. Facts: reason NodeNotReady, count_30m 1, last_message Node is not ready.', 'narrative_kind': 'template', 'discriminator': 'NodeNotReady', 'level': 'medium', 'told_level': 'medium', 'episode_at': 1794806332, 'chat_thread': None, 'kind_label': 'Node problem', 'group': 'Platform', 'age_s': 4115561, 'stale_s': 1625}
- 2026-11-16 08:53:28 UTCreopened x-ray · severity=warning was=warning title=pods on an unready node: 3 affected in 30 min level=medium was_level=medium finding={'id': 2877, 'fingerprint': 'ef8d489b946783dd6210', 'kind': 'node.unhealthy', 'severity': 'warning', 'cluster': 'production', 'subject': 'node/NodeNotReady', 'title': 'pods on an unready node: 3 affected in 30 min', 'facts': {'reason': 'NodeNotReady', 'count_30m': 3, 'objects': ['collector-94qwn', 'collector-nwx98', 'collector-sc5tb'], 'last_message': 'Node is not ready', 'discriminator': 'NodeNotReady'}, 'evidence': [{'label': 'Kubernetes events', 'href': '/logs?cluster=production&from=1794815608&to=1794819208&source=events'}, {'label': 'Pods', 'href': '/pods?cluster=production'}], 'provenance': {'source': 'x-ray', 'note': 'Kubernetes events (logs/events in BigQuery), last 45 min'}, 'impact': 29.7, 'status': 'open', 'first_seen': 1790694098, 'last_seen': 1794819208, 'resolved_at': None, 'acked_by': None, 'acked_at': None, 'snoozed_until': None, 'occurrences': 723, 'narrative': 'Node problem: pods on an unready node: 1 affected in 30 min. Facts: reason NodeNotReady, count_30m 1, last_message Node is not ready.', 'narrative_kind': 'template', 'discriminator': 'NodeNotReady', 'level': 'medium', 'told_level': 'medium', 'episode_at': 1794819208, 'chat_thread': None, 'kind_label': 'Node problem', 'group': 'Platform', 'age_s': 4125159, 'stale_s': 49}
- 2026-11-16 13:58:18 UTCresolved x-ray · reason=not observed grace_s=900 finding={'id': 2877, 'fingerprint': 'ef8d489b946783dd6210', 'kind': 'node.unhealthy', 'severity': 'warning', 'cluster': 'production', 'subject': 'node/NodeNotReady', 'title': 'pods on an unready node: 1 affected in 30 min', 'facts': {'reason': 'NodeNotReady', 'count_30m': 1, 'objects': ['collector-4dt8p'], 'last_message': 'Node is not ready', 'discriminator': 'NodeNotReady'}, 'evidence': [{'label': 'Kubernetes events', 'href': '/logs?cluster=production&from=1794832797&to=1794836397&source=events'}, {'label': 'Pods', 'href': '/pods?cluster=production'}], 'provenance': {'source': 'x-ray', 'note': 'Kubernetes events (logs/events in BigQuery), last 45 min'}, 'impact': 34.7, 'status': 'resolved', 'first_seen': 1790694098, 'last_seen': 1794836397, 'resolved_at': 1794837498, 'acked_by': None, 'acked_at': None, 'snoozed_until': None, 'occurrences': 735, 'narrative': 'Node problem: pods on an unready node: 1 affected in 30 min. Facts: reason NodeNotReady, count_30m 1, last_message Node is not ready.', 'narrative_kind': 'template', 'discriminator': 'NodeNotReady', 'level': 'medium', 'told_level': 'medium', 'episode_at': 1794819208, 'chat_thread': None, 'kind_label': 'Node problem', 'group': 'Platform', 'age_s': 4143428, 'stale_s': 1129}
- 2026-11-16 16:32:01 UTCreopened x-ray · severity=warning was=warning title=pods on an unready node: 6 affected in 30 min level=medium was_level=medium finding={'id': 2877, 'fingerprint': 'ef8d489b946783dd6210', 'kind': 'node.unhealthy', 'severity': 'warning', 'cluster': 'production', 'subject': 'node/NodeNotReady', 'title': 'pods on an unready node: 6 affected in 30 min', 'facts': {'reason': 'NodeNotReady', 'count_30m': 6, 'objects': ['collector-7gq2l', 'collector-cdnpg', 'collector-k4rcf', 'collector-kmwd7', 'collector-pcjzh', 'collector-wrvhb'], 'last_message': 'Node is not ready', 'discriminator': 'NodeNotReady'}, 'evidence': [{'label': 'Kubernetes events', 'href': '/logs?cluster=production&from=1794843121&to=1794846721&source=events'}, {'label': 'Pods', 'href': '/pods?cluster=production'}], 'provenance': {'source': 'x-ray', 'note': 'Kubernetes events (logs/events in BigQuery), last 45 min'}, 'impact': 29.7, 'status': 'open', 'first_seen': 1790694098, 'last_seen': 1794846721, 'resolved_at': None, 'acked_by': None, 'acked_at': None, 'snoozed_until': None, 'occurrences': 736, 'narrative': 'Node problem: pods on an unready node: 1 affected in 30 min. Facts: reason NodeNotReady, count_30m 1, last_message Node is not ready.', 'narrative_kind': 'template', 'discriminator': 'NodeNotReady', 'level': 'medium', 'told_level': 'medium', 'episode_at': 1794846721, 'chat_thread': None, 'kind_label': 'Node problem', 'group': 'Platform', 'age_s': 4152646, 'stale_s': 23}
- 2026-11-16 17:27:13 UTCresolved x-ray · reason=not observed grace_s=900 finding={'id': 2877, 'fingerprint': 'ef8d489b946783dd6210', 'kind': 'node.unhealthy', 'severity': 'warning', 'cluster': 'production', 'subject': 'node/NodeNotReady', 'title': 'pods on an unready node: 1 affected in 30 min', 'facts': {'reason': 'NodeNotReady', 'count_30m': 1, 'objects': ['collector-zjgqs'], 'last_message': 'Node is not ready', 'discriminator': 'NodeNotReady'}, 'evidence': [{'label': 'Kubernetes events', 'href': '/logs?cluster=production&from=1794845328&to=1794848928&source=events'}, {'label': 'Pods', 'href': '/pods?cluster=production'}], 'provenance': {'source': 'x-ray', 'note': 'Kubernetes events (logs/events in BigQuery), last 45 min'}, 'impact': 34.7, 'status': 'resolved', 'first_seen': 1790694098, 'last_seen': 1794848928, 'resolved_at': 1794850033, 'acked_by': None, 'acked_at': None, 'snoozed_until': None, 'occurrences': 739, 'narrative': 'Node problem: pods on an unready node: 1 affected in 30 min. Facts: reason NodeNotReady, count_30m 1, last_message Node is not ready.', 'narrative_kind': 'template', 'discriminator': 'NodeNotReady', 'level': 'medium', 'told_level': 'medium', 'episode_at': 1794846721, 'chat_thread': None, 'kind_label': 'Node problem', 'group': 'Platform', 'age_s': 4155956, 'stale_s': 1126}
- 2026-11-16 19:23:44 UTCreopened x-ray · severity=warning was=warning title=pods on an unready node: 1 affected in 30 min level=medium was_level=medium finding={'id': 2877, 'fingerprint': 'ef8d489b946783dd6210', 'kind': 'node.unhealthy', 'severity': 'warning', 'cluster': 'production', 'subject': 'node/NodeNotReady', 'title': 'pods on an unready node: 1 affected in 30 min', 'facts': {'reason': 'NodeNotReady', 'count_30m': 1, 'objects': ['collector-dhtkq'], 'last_message': 'Node is not ready', 'discriminator': 'NodeNotReady'}, 'evidence': [{'label': 'Kubernetes events', 'href': '/logs?cluster=production&from=1794853424&to=1794857024&source=events'}, {'label': 'Pods', 'href': '/pods?cluster=production'}], 'provenance': {'source': 'x-ray', 'note': 'Kubernetes events (logs/events in BigQuery), last 45 min'}, 'impact': 29.7, 'status': 'open', 'first_seen': 1790694098, 'last_seen': 1794857024, 'resolved_at': None, 'acked_by': None, 'acked_at': None, 'snoozed_until': None, 'occurrences': 740, 'narrative': 'Node problem: pods on an unready node: 1 affected in 30 min. Facts: reason NodeNotReady, count_30m 1, last_message Node is not ready.', 'narrative_kind': 'template', 'discriminator': 'NodeNotReady', 'level': 'medium', 'told_level': 'medium', 'episode_at': 1794857024, 'chat_thread': None, 'kind_label': 'Node problem', 'group': 'Platform', 'age_s': 4162955, 'stale_s': 29}
- 2026-11-16 20:29:07 UTCresolved x-ray · reason=not observed grace_s=900 finding={'id': 2877, 'fingerprint': 'ef8d489b946783dd6210', 'kind': 'node.unhealthy', 'severity': 'warning', 'cluster': 'production', 'subject': 'node/NodeNotReady', 'title': 'pods on an unready node: 7 affected in 30 min', 'facts': {'reason': 'NodeNotReady', 'count_30m': 7, 'objects': ['collector-2vdgt', 'collector-9bsr2', 'collector-lgfss', 'collector-qr2hq', 'collector-r8p6m', 'collector-ttq5l', 'collector-zdpr4'], 'last_message': 'Node is not ready', 'discriminator': 'NodeNotReady'}, 'evidence': [{'label': 'Kubernetes events', 'href': '/logs?cluster=production&from=1794856376&to=1794859976&source=events'}, {'label': 'Pods', 'href': '/pods?cluster=production'}], 'provenance': {'source': 'x-ray', 'note': 'Kubernetes events (logs/events in BigQuery), last 45 min'}, 'impact': 34.7, 'status': 'resolved', 'first_seen': 1790694098, 'last_seen': 1794859976, 'resolved_at': 1794860947, 'acked_by': None, 'acked_at': None, 'snoozed_until': None, 'occurrences': 744, 'narrative': 'Node problem: pods on an unready node: 7 affected in 30 min. Facts: reason NodeNotReady, count_30m 7, last_message Node is not ready.', 'narrative_kind': 'template', 'discriminator': 'NodeNotReady', 'level': 'medium', 'told_level': 'medium', 'episode_at': 1794857024, 'chat_thread': None, 'kind_label': 'Node problem', 'group': 'Platform', 'age_s': 4166885, 'stale_s': 1007}
- 2026-11-16 20:46:12 UTCreopened x-ray · severity=warning was=warning title=pods on an unready node: 2 affected in 30 min level=medium was_level=medium finding={'id': 2877, 'fingerprint': 'ef8d489b946783dd6210', 'kind': 'node.unhealthy', 'severity': 'warning', 'cluster': 'production', 'subject': 'node/NodeNotReady', 'title': 'pods on an unready node: 2 affected in 30 min', 'facts': {'reason': 'NodeNotReady', 'count_30m': 2, 'objects': ['collector-2llwj', 'collector-grwps'], 'last_message': 'Node is not ready', 'discriminator': 'NodeNotReady'}, 'evidence': [{'label': 'Kubernetes events', 'href': '/logs?cluster=production&from=1794858372&to=1794861972&source=events'}, {'label': 'Pods', 'href': '/pods?cluster=production'}], 'provenance': {'source': 'x-ray', 'note': 'Kubernetes events (logs/events in BigQuery), last 45 min'}, 'impact': 29.7, 'status': 'open', 'first_seen': 1790694098, 'last_seen': 1794861972, 'resolved_at': None, 'acked_by': None, 'acked_at': None, 'snoozed_until': None, 'occurrences': 745, 'narrative': 'Node problem: pods on an unready node: 7 affected in 30 min. Facts: reason NodeNotReady, count_30m 7, last_message Node is not ready.', 'narrative_kind': 'template', 'discriminator': 'NodeNotReady', 'level': 'medium', 'told_level': 'medium', 'episode_at': 1794861972, 'chat_thread': None, 'kind_label': 'Node problem', 'group': 'Platform', 'age_s': 4167895, 'stale_s': 21}
- 2026-11-16 21:27:22 UTCresolved x-ray · reason=not observed grace_s=900 finding={'id': 2877, 'fingerprint': 'ef8d489b946783dd6210', 'kind': 'node.unhealthy', 'severity': 'warning', 'cluster': 'production', 'subject': 'node/NodeNotReady', 'title': 'pods on an unready node: 2 affected in 30 min', 'facts': {'reason': 'NodeNotReady', 'count_30m': 2, 'objects': ['collector-2llwj', 'collector-grwps'], 'last_message': 'Node is not ready', 'discriminator': 'NodeNotReady'}, 'evidence': [{'label': 'Kubernetes events', 'href': '/logs?cluster=production&from=1794859738&to=1794863338&source=events'}, {'label': 'Pods', 'href': '/pods?cluster=production'}], 'provenance': {'source': 'x-ray', 'note': 'Kubernetes events (logs/events in BigQuery), last 45 min'}, 'impact': 34.7, 'status': 'resolved', 'first_seen': 1790694098, 'last_seen': 1794863338, 'resolved_at': 1794864442, 'acked_by': None, 'acked_at': None, 'snoozed_until': None, 'occurrences': 748, 'narrative': 'Node problem: pods on an unready node: 2 affected in 30 min. Facts: reason NodeNotReady, count_30m 2, last_message Node is not ready.', 'narrative_kind': 'template', 'discriminator': 'NodeNotReady', 'level': 'medium', 'told_level': 'medium', 'episode_at': 1794861972, 'chat_thread': None, 'kind_label': 'Node problem', 'group': 'Platform', 'age_s': 4170365, 'stale_s': 1125}
- 2026-11-16 23:14:34 UTCreopened x-ray · severity=warning was=warning title=pods on an unready node: 1 affected in 30 min level=medium was_level=medium finding={'id': 2877, 'fingerprint': 'ef8d489b946783dd6210', 'kind': 'node.unhealthy', 'severity': 'warning', 'cluster': 'production', 'subject': 'node/NodeNotReady', 'title': 'pods on an unready node: 1 affected in 30 min', 'facts': {'reason': 'NodeNotReady', 'count_30m': 1, 'objects': ['collector-nfcbg'], 'last_message': 'Node is not ready', 'discriminator': 'NodeNotReady'}, 'evidence': [{'label': 'Kubernetes events', 'href': '/logs?cluster=production&from=1794867274&to=1794870874&source=events'}, {'label': 'Pods', 'href': '/pods?cluster=production'}], 'provenance': {'source': 'x-ray', 'note': 'Kubernetes events (logs/events in BigQuery), last 45 min'}, 'impact': 29.7, 'status': 'open', 'first_seen': 1790694098, 'last_seen': 1794870874, 'resolved_at': None, 'acked_by': None, 'acked_at': None, 'snoozed_until': None, 'occurrences': 749, 'narrative': 'Node problem: pods on an unready node: 2 affected in 30 min. Facts: reason NodeNotReady, count_30m 2, last_message Node is not ready.', 'narrative_kind': 'template', 'discriminator': 'NodeNotReady', 'level': 'medium', 'told_level': 'medium', 'episode_at': 1794870874, 'chat_thread': None, 'kind_label': 'Node problem', 'group': 'Platform', 'age_s': 4176795, 'stale_s': 19}
- 2026-11-17 01:31:55 UTCresolved x-ray · reason=not observed grace_s=900 finding={'id': 2877, 'fingerprint': 'ef8d489b946783dd6210', 'kind': 'node.unhealthy', 'severity': 'warning', 'cluster': 'production', 'subject': 'node/NodeNotReady', 'title': 'pods on an unready node: 1 affected in 30 min', 'facts': {'reason': 'NodeNotReady', 'count_30m': 1, 'objects': ['collector-w7jbl'], 'last_message': 'Node is not ready', 'discriminator': 'NodeNotReady'}, 'evidence': [{'label': 'Kubernetes events', 'href': '/logs?cluster=production&from=1794874527&to=1794878127&source=events'}, {'label': 'Pods', 'href': '/pods?cluster=production'}], 'provenance': {'source': 'x-ray', 'note': 'Kubernetes events (logs/events in BigQuery), last 45 min'}, 'impact': 34.7, 'status': 'resolved', 'first_seen': 1790694098, 'last_seen': 1794878127, 'resolved_at': 1794879115, 'acked_by': None, 'acked_at': None, 'snoozed_until': None, 'occurrences': 763, 'narrative': 'Node problem: pods on an unready node: 1 affected in 30 min. Facts: reason NodeNotReady, count_30m 1, last_message Node is not ready.', 'narrative_kind': 'template', 'discriminator': 'NodeNotReady', 'level': 'medium', 'told_level': 'medium', 'episode_at': 1794870874, 'chat_thread': None, 'kind_label': 'Node problem', 'group': 'Platform', 'age_s': 4185042, 'stale_s': 1013}
- 2026-11-17 02:54:44 UTCreopened x-ray · severity=warning was=warning title=pods on an unready node: 1 affected in 30 min level=medium was_level=medium finding={'id': 2877, 'fingerprint': 'ef8d489b946783dd6210', 'kind': 'node.unhealthy', 'severity': 'warning', 'cluster': 'production', 'subject': 'node/NodeNotReady', 'title': 'pods on an unready node: 1 affected in 30 min', 'facts': {'reason': 'NodeNotReady', 'count_30m': 1, 'objects': ['collector-mp8rg'], 'last_message': 'Node is not ready', 'discriminator': 'NodeNotReady'}, 'evidence': [{'label': 'Kubernetes events', 'href': '/logs?cluster=production&from=1794880484&to=1794884084&source=events'}, {'label': 'Pods', 'href': '/pods?cluster=production'}], 'provenance': {'source': 'x-ray', 'note': 'Kubernetes events (logs/events in BigQuery), last 45 min'}, 'impact': 29.7, 'status': 'open', 'first_seen': 1790694098, 'last_seen': 1794884084, 'resolved_at': None, 'acked_by': None, 'acked_at': None, 'snoozed_until': None, 'occurrences': 764, 'narrative': 'Node problem: pods on an unready node: 1 affected in 30 min. Facts: reason NodeNotReady, count_30m 1, last_message Node is not ready.', 'narrative_kind': 'template', 'discriminator': 'NodeNotReady', 'level': 'medium', 'told_level': 'medium', 'episode_at': 1794884084, 'chat_thread': None, 'kind_label': 'Node problem', 'group': 'Platform', 'age_s': 4190012, 'stale_s': 26}
- 2026-11-17 05:09:52 UTCresolved x-ray · reason=not observed grace_s=900 finding={'id': 2877, 'fingerprint': 'ef8d489b946783dd6210', 'kind': 'node.unhealthy', 'severity': 'warning', 'cluster': 'production', 'subject': 'node/NodeNotReady', 'title': 'pods on an unready node: 5 affected in 30 min', 'facts': {'reason': 'NodeNotReady', 'count_30m': 5, 'objects': ['collector-cs45b', 'collector-hjrk5', 'collector-prxk7', 'collector-s7drk', 'collector-x5jvs'], 'last_message': 'Node is not ready', 'discriminator': 'NodeNotReady'}, 'evidence': [{'label': 'Kubernetes events', 'href': '/logs?cluster=production&from=1794887157&to=1794890757&source=events'}, {'label': 'Pods', 'href': '/pods?cluster=production'}], 'provenance': {'source': 'x-ray', 'note': 'Kubernetes events (logs/events in BigQuery), last 45 min'}, 'impact': 34.7, 'status': 'resolved', 'first_seen': 1790694098, 'last_seen': 1794890757, 'resolved_at': 1794892192, 'acked_by': None, 'acked_at': None, 'snoozed_until': None, 'occurrences': 773, 'narrative': 'Node problem: pods on an unready node: 5 affected in 30 min. Facts: reason NodeNotReady, count_30m 5, last_message Node is not ready.', 'narrative_kind': 'template', 'discriminator': 'NodeNotReady', 'level': 'medium', 'told_level': 'medium', 'episode_at': 1794884084, 'chat_thread': None, 'kind_label': 'Node problem', 'group': 'Platform', 'age_s': 4198116, 'stale_s': 1457}
- 2026-11-17 05:43:34 UTCreopened x-ray · severity=warning was=warning title=pods on an unready node: 1 affected in 30 min level=medium was_level=medium finding={'id': 2877, 'fingerprint': 'ef8d489b946783dd6210', 'kind': 'node.unhealthy', 'severity': 'warning', 'cluster': 'production', 'subject': 'node/NodeNotReady', 'title': 'pods on an unready node: 1 affected in 30 min', 'facts': {'reason': 'NodeNotReady', 'count_30m': 1, 'objects': ['collector-mvvfp'], 'last_message': 'Node is not ready', 'discriminator': 'NodeNotReady'}, 'evidence': [{'label': 'Kubernetes events', 'href': '/logs?cluster=production&from=1794890614&to=1794894214&source=events'}, {'label': 'Pods', 'href': '/pods?cluster=production'}], 'provenance': {'source': 'x-ray', 'note': 'Kubernetes events (logs/events in BigQuery), last 45 min'}, 'impact': 29.7, 'status': 'open', 'first_seen': 1790694098, 'last_seen': 1794894214, 'resolved_at': None, 'acked_by': None, 'acked_at': None, 'snoozed_until': None, 'occurrences': 774, 'narrative': 'Node problem: pods on an unready node: 5 affected in 30 min. Facts: reason NodeNotReady, count_30m 5, last_message Node is not ready.', 'narrative_kind': 'template', 'discriminator': 'NodeNotReady', 'level': 'medium', 'told_level': 'medium', 'episode_at': 1794894214, 'chat_thread': None, 'kind_label': 'Node problem', 'group': 'Platform', 'age_s': 4200138, 'stale_s': 22}
- 2026-11-17 06:15:05 UTCresolved x-ray · reason=not observed grace_s=900 finding={'id': 2877, 'fingerprint': 'ef8d489b946783dd6210', 'kind': 'node.unhealthy', 'severity': 'warning', 'cluster': 'production', 'subject': 'node/NodeNotReady', 'title': 'pods on an unready node: 1 affected in 30 min', 'facts': {'reason': 'NodeNotReady', 'count_30m': 1, 'objects': ['collector-mvvfp'], 'last_message': 'Node is not ready', 'discriminator': 'NodeNotReady'}, 'evidence': [{'label': 'Kubernetes events', 'href': '/logs?cluster=production&from=1794891602&to=1794895202&source=events'}, {'label': 'Pods', 'href': '/pods?cluster=production'}], 'provenance': {'source': 'x-ray', 'note': 'Kubernetes events (logs/events in BigQuery), last 45 min'}, 'impact': 34.7, 'status': 'resolved', 'first_seen': 1790694098, 'last_seen': 1794895202, 'resolved_at': 1794896105, 'acked_by': None, 'acked_at': None, 'snoozed_until': None, 'occurrences': 775, 'narrative': 'Node problem: pods on an unready node: 1 affected in 30 min. Facts: reason NodeNotReady, count_30m 1, last_message Node is not ready.', 'narrative_kind': 'template', 'discriminator': 'NodeNotReady', 'level': 'medium', 'told_level': 'medium', 'episode_at': 1794894214, 'chat_thread': None, 'kind_label': 'Node problem', 'group': 'Platform', 'age_s': 4202081, 'stale_s': 977}
- 2026-11-17 07:09:11 UTCreopened x-ray · severity=warning was=warning title=pods on an unready node: 1 affected in 30 min level=medium was_level=medium finding={'id': 2877, 'fingerprint': 'ef8d489b946783dd6210', 'kind': 'node.unhealthy', 'severity': 'warning', 'cluster': 'production', 'subject': 'node/NodeNotReady', 'title': 'pods on an unready node: 1 affected in 30 min', 'facts': {'reason': 'NodeNotReady', 'count_30m': 1, 'objects': ['collector-vxjrh'], 'last_message': 'Node is not ready', 'discriminator': 'NodeNotReady'}, 'evidence': [{'label': 'Kubernetes events', 'href': '/logs?cluster=production&from=1794895751&to=1794899351&source=events'}, {'label': 'Pods', 'href': '/pods?cluster=production'}], 'provenance': {'source': 'x-ray', 'note': 'Kubernetes events (logs/events in BigQuery), last 45 min'}, 'impact': 29.7, 'status': 'open', 'first_seen': 1790694098, 'last_seen': 1794899351, 'resolved_at': None, 'acked_by': None, 'acked_at': None, 'snoozed_until': None, 'occurrences': 776, 'narrative': 'Node problem: pods on an unready node: 1 affected in 30 min. Facts: reason NodeNotReady, count_30m 1, last_message Node is not ready.', 'narrative_kind': 'template', 'discriminator': 'NodeNotReady', 'level': 'medium', 'told_level': 'medium', 'episode_at': 1794899351, 'chat_thread': None, 'kind_label': 'Node problem', 'group': 'Platform', 'age_s': 4205277, 'stale_s': 24}
- 2026-11-17 07:42:20 UTCresolved x-ray · reason=not observed grace_s=900 finding={'id': 2877, 'fingerprint': 'ef8d489b946783dd6210', 'kind': 'node.unhealthy', 'severity': 'warning', 'cluster': 'production', 'subject': 'node/NodeNotReady', 'title': 'pods on an unready node: 1 affected in 30 min', 'facts': {'reason': 'NodeNotReady', 'count_30m': 1, 'objects': ['collector-vxjrh'], 'last_message': 'Node is not ready', 'discriminator': 'NodeNotReady'}, 'evidence': [{'label': 'Kubernetes events', 'href': '/logs?cluster=production&from=1794896649&to=1794900249&source=events'}, {'label': 'Pods', 'href': '/pods?cluster=production'}], 'provenance': {'source': 'x-ray', 'note': 'Kubernetes events (logs/events in BigQuery), last 45 min'}, 'impact': 34.7, 'status': 'resolved', 'first_seen': 1790694098, 'last_seen': 1794900249, 'resolved_at': 1794901340, 'acked_by': None, 'acked_at': None, 'snoozed_until': None, 'occurrences': 777, 'narrative': 'Node problem: pods on an unready node: 1 affected in 30 min. Facts: reason NodeNotReady, count_30m 1, last_message Node is not ready.', 'narrative_kind': 'template', 'discriminator': 'NodeNotReady', 'level': 'medium', 'told_level': 'medium', 'episode_at': 1794899351, 'chat_thread': None, 'kind_label': 'Node problem', 'group': 'Platform', 'age_s': 4207269, 'stale_s': 1118}
- 2026-11-17 08:26:41 UTCreopened x-ray · severity=warning was=warning title=pods on an unready node: 5 affected in 30 min level=medium was_level=medium finding={'id': 2877, 'fingerprint': 'ef8d489b946783dd6210', 'kind': 'node.unhealthy', 'severity': 'warning', 'cluster': 'production', 'subject': 'node/NodeNotReady', 'title': 'pods on an unready node: 5 affected in 30 min', 'facts': {'reason': 'NodeNotReady', 'count_30m': 5, 'objects': ['collector-d4df5', 'collector-hbc64', 'collector-nspqs', 'collector-p7wkq', 'collector-s74fc'], 'last_message': 'Node is not ready', 'discriminator': 'NodeNotReady'}, 'evidence': [{'label': 'Kubernetes events', 'href': '/logs?cluster=production&from=1794900401&to=1794904001&source=events'}, {'label': 'Pods', 'href': '/pods?cluster=production'}], 'provenance': {'source': 'x-ray', 'note': 'Kubernetes events (logs/events in BigQuery), last 45 min'}, 'impact': 29.7, 'status': 'open', 'first_seen': 1790694098, 'last_seen': 1794904001, 'resolved_at': None, 'acked_by': None, 'acked_at': None, 'snoozed_until': None, 'occurrences': 778, 'narrative': 'Node problem: pods on an unready node: 1 affected in 30 min. Facts: reason NodeNotReady, count_30m 1, last_message Node is not ready.', 'narrative_kind': 'template', 'discriminator': 'NodeNotReady', 'level': 'medium', 'told_level': 'medium', 'episode_at': 1794904001, 'chat_thread': None, 'kind_label': 'Node problem', 'group': 'Platform', 'age_s': 4209984, 'stale_s': 81}
Check it yourself
Every link carries the finding's own time window, so it shows tomorrow what it shows now.
Actions
Sign in (IAP) to acknowledge, snooze or resolve.
Where the numbers come from
| source | x-ray |
| note | Kubernetes events (logs/events in BigQuery), last 45 min |
| detector | k8s_events |