Xray
1h 6h 24h 48h 3d 5d 7d 14d 30d ‹
Last 1 hour▾
Ends now. Anything up to this cluster's 30-day retention.
Start and end times
Cancel
Interpreted in UTC (change it at the right of this bar). Earliest available: 2026-10-20 15:35:25.
› →|
updated 2d ago
Sample data. This database was generated by scripts/seed_dev_db.py — every service, deploy, person and figure on this page is synthetic. Names are sample.*@seed.invalid and image tags are prefixed SEED-. Nothing here happened.
← findings

HorizontalPodAutoscaler/docproc-hpa (tilda) cannot read its scaling metric — 27× in 2 h

warning Autoscaler blind automation resolved impact 24 opened 27d ago · last observed 2d ago · observed 1501× · #5455 · 20c2a80bc27f7a2e7d13

What happened template

Autoscaler blind: HorizontalPodAutoscaler/docproc-hpa (tilda) cannot read its scaling metric — 27× in 2 h. Facts: namespace tilda, object HorizontalPodAutoscaler/docproc-hpa, failures_2h 27, last_message did not receive metrics for targeted pods (pods might be unready).

A KEDA scaler or HPA that cannot read its metric — it will not scale when load changes.

The facts

namespacetilda
objectHorizontalPodAutoscaler/docproc-hpa
failures_2h27
last_messagedid not receive metrics for targeted pods (pods might be unready)
discriminator

The story — No deploy or hand change is recorded in the hour before this opened.

History

  • 2026-11-14 14:52:48 UTCreopened x-ray · severity=warning was=warning title=HorizontalPodAutoscaler/docproc-hpa (tilda) cannot read its scaling metric — 2× in 2 h level=medium was_level=medium finding={'id': 5455, 'fingerprint': '20c2a80bc27f7a2e7d13', 'kind': 'scaler.failing', 'severity': 'warning', 'cluster': 'automation', 'subject': 'tilda/HorizontalPodAutoscaler/docproc-hpa', 'title': 'HorizontalPodAutoscaler/docproc-hpa (tilda) cannot read its scaling metric — 2× in 2 h', 'facts': {'namespace': 'tilda', 'object': 'HorizontalPodAutoscaler/docproc-hpa', 'failures_2h': 2, 'last_message': 'unable to get metric custom.googleapis.com|docproc_memory_demand_bytes: unable to fetch metrics from custom metrics API: the server could not find the descriptor for metric custom.googleapis.com/docproc_memory_demand_bytes: googleapi: Error 503: Policy checks are unavailable., backendError', 'discriminator': ''}, 'evidence': [{'label': 'Kubernetes events', 'href': '/logs?cluster=automation&from=1794664368&to=1794667968&source=events&q=HorizontalPodAutoscaler%2Fdocproc-hpa'}, {'label': 'Pods', 'href': '/pods?cluster=automation'}], 'provenance': {'source': 'x-ray', 'note': 'Kubernetes events (logs/events in BigQuery), last 45 min'}, 'impact': 19.3, 'status': 'open', 'first_seen': 1792760595, 'last_seen': 1794667968, 'resolved_at': None, 'acked_by': None, 'acked_at': None, 'snoozed_until': None, 'occurrences': 1410, 'narrative': 'Autoscaler blind: HorizontalPodAutoscaler/docproc-hpa (tilda) cannot read its scaling metric — 2× in 2 h. Facts: namespace tilda, object HorizontalPodAutoscaler/docproc-hpa, failures_2h 2, last_message did not receive metrics for targeted pods (pods might be unready).', 'narrative_kind': 'template', 'discriminator': '', 'level': 'medium', 'told_level': None, 'episode_at': 1794667968, 'chat_thread': None, 'kind_label': 'Autoscaler blind', 'group': 'Platform', 'age_s': 1907386, 'stale_s': 13}
  • 2026-11-14 17:03:02 UTCresolved x-ray · reason=not observed grace_s=900 finding={'id': 5455, 'fingerprint': '20c2a80bc27f7a2e7d13', 'kind': 'scaler.failing', 'severity': 'warning', 'cluster': 'automation', 'subject': 'tilda/HorizontalPodAutoscaler/docproc-hpa', 'title': 'HorizontalPodAutoscaler/docproc-hpa (tilda) cannot read its scaling metric — 2× in 2 h', 'facts': {'namespace': 'tilda', 'object': 'HorizontalPodAutoscaler/docproc-hpa', 'failures_2h': 2, 'last_message': 'unable to get metric custom.googleapis.com|docproc_memory_demand_bytes: unable to fetch metrics from custom metrics API: the server could not find the descriptor for metric custom.googleapis.com/docproc_memory_demand_bytes: googleapi: Error 503: Policy checks are unavailable., backendError', 'discriminator': ''}, 'evidence': [{'label': 'Kubernetes events', 'href': '/logs?cluster=automation&from=1794670946&to=1794674546&source=events&q=HorizontalPodAutoscaler%2Fdocproc-hpa'}, {'label': 'Pods', 'href': '/pods?cluster=automation'}], 'provenance': {'source': 'x-ray', 'note': 'Kubernetes events (logs/events in BigQuery), last 45 min'}, 'impact': 24.3, 'status': 'resolved', 'first_seen': 1792760595, 'last_seen': 1794674546, 'resolved_at': 1794675782, 'acked_by': None, 'acked_at': None, 'snoozed_until': None, 'occurrences': 1426, 'narrative': 'Autoscaler blind: HorizontalPodAutoscaler/docproc-hpa (tilda) cannot read its scaling metric — 2× in 2 h. Facts: namespace tilda, object HorizontalPodAutoscaler/docproc-hpa, failures_2h 2, last_message unable to get metric custom.googleapis.com|docproc_memory_demand_bytes: unable to fetch metrics from custom metrics API: the server could not find the descriptor for metric custom.googleapis.com/docproc_memory_demand_bytes: googleapi: Error 503: Policy checks are unavailable., backendError.', 'narrative_kind': 'template', 'discriminator': '', 'level': 'medium', 'told_level': None, 'episode_at': 1794667968, 'chat_thread': None, 'kind_label': 'Autoscaler blind', 'group': 'Platform', 'age_s': 1915217, 'stale_s': 1266}
  • 2026-11-14 19:08:30 UTCreopened x-ray · severity=warning was=warning title=HorizontalPodAutoscaler/docproc-hpa (tilda) cannot read its scaling metric — 25× in 2 h level=medium was_level=medium finding={'id': 5455, 'fingerprint': '20c2a80bc27f7a2e7d13', 'kind': 'scaler.failing', 'severity': 'warning', 'cluster': 'automation', 'subject': 'tilda/HorizontalPodAutoscaler/docproc-hpa', 'title': 'HorizontalPodAutoscaler/docproc-hpa (tilda) cannot read its scaling metric — 25× in 2 h', 'facts': {'namespace': 'tilda', 'object': 'HorizontalPodAutoscaler/docproc-hpa', 'failures_2h': 25, 'last_message': 'unable to get metric memory: no metrics returned from resource metrics API', 'discriminator': ''}, 'evidence': [{'label': 'Kubernetes events', 'href': '/logs?cluster=automation&from=1794679710&to=1794683310&source=events&q=HorizontalPodAutoscaler%2Fdocproc-hpa'}, {'label': 'Pods', 'href': '/pods?cluster=automation'}], 'provenance': {'source': 'x-ray', 'note': 'Kubernetes events (logs/events in BigQuery), last 45 min'}, 'impact': 19.3, 'status': 'open', 'first_seen': 1792760595, 'last_seen': 1794683310, 'resolved_at': None, 'acked_by': None, 'acked_at': None, 'snoozed_until': None, 'occurrences': 1427, 'narrative': 'Autoscaler blind: HorizontalPodAutoscaler/docproc-hpa (tilda) cannot read its scaling metric — 2× in 2 h. Facts: namespace tilda, object HorizontalPodAutoscaler/docproc-hpa, failures_2h 2, last_message unable to get metric custom.googleapis.com|docproc_memory_demand_bytes: unable to fetch metrics from custom metrics API: the server could not find the descriptor for metric custom.googleapis.com/docproc_memory_demand_bytes: googleapi: Error 503: Policy checks are unavailable., backendError.', 'narrative_kind': 'template', 'discriminator': '', 'level': 'medium', 'told_level': None, 'episode_at': 1794683310, 'chat_thread': None, 'kind_label': 'Autoscaler blind', 'group': 'Platform', 'age_s': 1922746, 'stale_s': 31}
  • 2026-11-14 21:27:53 UTCresolved x-ray · reason=not observed grace_s=900 finding={'id': 5455, 'fingerprint': '20c2a80bc27f7a2e7d13', 'kind': 'scaler.failing', 'severity': 'warning', 'cluster': 'automation', 'subject': 'tilda/HorizontalPodAutoscaler/docproc-hpa', 'title': 'HorizontalPodAutoscaler/docproc-hpa (tilda) cannot read its scaling metric — 2× in 2 h', 'facts': {'namespace': 'tilda', 'object': 'HorizontalPodAutoscaler/docproc-hpa', 'failures_2h': 2, 'last_message': 'did not receive metrics for targeted pods (pods might be unready)', 'discriminator': ''}, 'evidence': [{'label': 'Kubernetes events', 'href': '/logs?cluster=automation&from=1794687119&to=1794690719&source=events&q=HorizontalPodAutoscaler%2Fdocproc-hpa'}, {'label': 'Pods', 'href': '/pods?cluster=automation'}], 'provenance': {'source': 'x-ray', 'note': 'Kubernetes events (logs/events in BigQuery), last 45 min'}, 'impact': 24.3, 'status': 'resolved', 'first_seen': 1792760595, 'last_seen': 1794690719, 'resolved_at': 1794691673, 'acked_by': None, 'acked_at': None, 'snoozed_until': None, 'occurrences': 1441, 'narrative': 'Autoscaler blind: HorizontalPodAutoscaler/docproc-hpa (tilda) cannot read its scaling metric — 2× in 2 h. Facts: namespace tilda, object HorizontalPodAutoscaler/docproc-hpa, failures_2h 2, last_message did not receive metrics for targeted pods (pods might be unready).', 'narrative_kind': 'template', 'discriminator': '', 'level': 'medium', 'told_level': None, 'episode_at': 1794683310, 'chat_thread': None, 'kind_label': 'Autoscaler blind', 'group': 'Platform', 'age_s': 1931093, 'stale_s': 969}
  • 2026-11-15 00:18:41 UTCreopened x-ray · severity=warning was=warning title=HorizontalPodAutoscaler/docproc-hpa (tilda) cannot read its scaling metric — 26× in 2 h level=medium was_level=medium finding={'id': 5455, 'fingerprint': '20c2a80bc27f7a2e7d13', 'kind': 'scaler.failing', 'severity': 'warning', 'cluster': 'automation', 'subject': 'tilda/HorizontalPodAutoscaler/docproc-hpa', 'title': 'HorizontalPodAutoscaler/docproc-hpa (tilda) cannot read its scaling metric — 26× in 2 h', 'facts': {'namespace': 'tilda', 'object': 'HorizontalPodAutoscaler/docproc-hpa', 'failures_2h': 26, 'last_message': 'No recommendation', 'discriminator': ''}, 'evidence': [{'label': 'Kubernetes events', 'href': '/logs?cluster=automation&from=1794698321&to=1794701921&source=events&q=HorizontalPodAutoscaler%2Fdocproc-hpa'}, {'label': 'Pods', 'href': '/pods?cluster=automation'}], 'provenance': {'source': 'x-ray', 'note': 'Kubernetes events (logs/events in BigQuery), last 45 min'}, 'impact': 19.3, 'status': 'open', 'first_seen': 1792760595, 'last_seen': 1794701921, 'resolved_at': None, 'acked_by': None, 'acked_at': None, 'snoozed_until': None, 'occurrences': 1442, 'narrative': 'Autoscaler blind: HorizontalPodAutoscaler/docproc-hpa (tilda) cannot read its scaling metric — 2× in 2 h. Facts: namespace tilda, object HorizontalPodAutoscaler/docproc-hpa, failures_2h 2, last_message did not receive metrics for targeted pods (pods might be unready).', 'narrative_kind': 'template', 'discriminator': '', 'level': 'medium', 'told_level': None, 'episode_at': 1794701921, 'chat_thread': None, 'kind_label': 'Autoscaler blind', 'group': 'Platform', 'age_s': 1941344, 'stale_s': 18}
  • 2026-11-15 02:37:32 UTCresolved x-ray · reason=not observed grace_s=900 finding={'id': 5455, 'fingerprint': '20c2a80bc27f7a2e7d13', 'kind': 'scaler.failing', 'severity': 'warning', 'cluster': 'automation', 'subject': 'tilda/HorizontalPodAutoscaler/docproc-hpa', 'title': 'HorizontalPodAutoscaler/docproc-hpa (tilda) cannot read its scaling metric — 6× in 2 h', 'facts': {'namespace': 'tilda', 'object': 'HorizontalPodAutoscaler/docproc-hpa', 'failures_2h': 6, 'last_message': 'did not receive metrics for targeted pods (pods might be unready)', 'discriminator': ''}, 'evidence': [{'label': 'Kubernetes events', 'href': '/logs?cluster=automation&from=1794705192&to=1794708792&source=events&q=HorizontalPodAutoscaler%2Fdocproc-hpa'}, {'label': 'Pods', 'href': '/pods?cluster=automation'}], 'provenance': {'source': 'x-ray', 'note': 'Kubernetes events (logs/events in BigQuery), last 45 min'}, 'impact': 24.3, 'status': 'resolved', 'first_seen': 1792760595, 'last_seen': 1794708792, 'resolved_at': 1794710252, 'acked_by': None, 'acked_at': None, 'snoozed_until': None, 'occurrences': 1454, 'narrative': 'Autoscaler blind: HorizontalPodAutoscaler/docproc-hpa (tilda) cannot read its scaling metric — 6× in 2 h. Facts: namespace tilda, object HorizontalPodAutoscaler/docproc-hpa, failures_2h 6, last_message did not receive metrics for targeted pods (pods might be unready).', 'narrative_kind': 'template', 'discriminator': '', 'level': 'medium', 'told_level': None, 'episode_at': 1794701921, 'chat_thread': None, 'kind_label': 'Autoscaler blind', 'group': 'Platform', 'age_s': 1949688, 'stale_s': 1491}
  • 2026-11-15 19:09:24 UTCreopened x-ray · severity=warning was=warning title=HorizontalPodAutoscaler/docproc-hpa (tilda) cannot read its scaling metric — 18× in 2 h level=medium was_level=medium finding={'id': 5455, 'fingerprint': '20c2a80bc27f7a2e7d13', 'kind': 'scaler.failing', 'severity': 'warning', 'cluster': 'automation', 'subject': 'tilda/HorizontalPodAutoscaler/docproc-hpa', 'title': 'HorizontalPodAutoscaler/docproc-hpa (tilda) cannot read its scaling metric — 18× in 2 h', 'facts': {'namespace': 'tilda', 'object': 'HorizontalPodAutoscaler/docproc-hpa', 'failures_2h': 18, 'last_message': 'unable to calculate ready pods: no pods returned by selector while calculating replica count', 'discriminator': ''}, 'evidence': [{'label': 'Kubernetes events', 'href': '/logs?cluster=automation&from=1794766164&to=1794769764&source=events&q=HorizontalPodAutoscaler%2Fdocproc-hpa'}, {'label': 'Pods', 'href': '/pods?cluster=automation'}], 'provenance': {'source': 'x-ray', 'note': 'Kubernetes events (logs/events in BigQuery), last 45 min'}, 'impact': 19.3, 'status': 'open', 'first_seen': 1792760595, 'last_seen': 1794769764, 'resolved_at': None, 'acked_by': None, 'acked_at': None, 'snoozed_until': None, 'occurrences': 1455, 'narrative': 'Autoscaler blind: HorizontalPodAutoscaler/docproc-hpa (tilda) cannot read its scaling metric — 6× in 2 h. Facts: namespace tilda, object HorizontalPodAutoscaler/docproc-hpa, failures_2h 6, last_message did not receive metrics for targeted pods (pods might be unready).', 'narrative_kind': 'template', 'discriminator': '', 'level': 'medium', 'told_level': None, 'episode_at': 1794769764, 'chat_thread': None, 'kind_label': 'Autoscaler blind', 'group': 'Platform', 'age_s': 2009184, 'stale_s': 15}
  • 2026-11-15 21:24:06 UTCresolved x-ray · reason=not observed grace_s=900 finding={'id': 5455, 'fingerprint': '20c2a80bc27f7a2e7d13', 'kind': 'scaler.failing', 'severity': 'warning', 'cluster': 'automation', 'subject': 'tilda/HorizontalPodAutoscaler/docproc-hpa', 'title': 'HorizontalPodAutoscaler/docproc-hpa (tilda) cannot read its scaling metric — 27× in 2 h', 'facts': {'namespace': 'tilda', 'object': 'HorizontalPodAutoscaler/docproc-hpa', 'failures_2h': 27, 'last_message': 'did not receive metrics for targeted pods (pods might be unready)', 'discriminator': ''}, 'evidence': [{'label': 'Kubernetes events', 'href': '/logs?cluster=automation&from=1794773296&to=1794776896&source=events&q=HorizontalPodAutoscaler%2Fdocproc-hpa'}, {'label': 'Pods', 'href': '/pods?cluster=automation'}], 'provenance': {'source': 'x-ray', 'note': 'Kubernetes events (logs/events in BigQuery), last 45 min'}, 'impact': 24.3, 'status': 'resolved', 'first_seen': 1792760595, 'last_seen': 1794776896, 'resolved_at': 1794777846, 'acked_by': None, 'acked_at': None, 'snoozed_until': None, 'occurrences': 1470, 'narrative': 'Autoscaler blind: HorizontalPodAutoscaler/docproc-hpa (tilda) cannot read its scaling metric — 27× in 2 h. Facts: namespace tilda, object HorizontalPodAutoscaler/docproc-hpa, failures_2h 27, last_message did not receive metrics for targeted pods (pods might be unready).', 'narrative_kind': 'template', 'discriminator': '', 'level': 'medium', 'told_level': None, 'episode_at': 1794769764, 'chat_thread': None, 'kind_label': 'Autoscaler blind', 'group': 'Platform', 'age_s': 2017314, 'stale_s': 1013}
  • 2026-11-16 08:15:41 UTCreopened x-ray · severity=warning was=warning title=HorizontalPodAutoscaler/docproc-hpa (tilda) cannot read its scaling metric — 25× in 2 h level=medium was_level=medium finding={'id': 5455, 'fingerprint': '20c2a80bc27f7a2e7d13', 'kind': 'scaler.failing', 'severity': 'warning', 'cluster': 'automation', 'subject': 'tilda/HorizontalPodAutoscaler/docproc-hpa', 'title': 'HorizontalPodAutoscaler/docproc-hpa (tilda) cannot read its scaling metric — 25× in 2 h', 'facts': {'namespace': 'tilda', 'object': 'HorizontalPodAutoscaler/docproc-hpa', 'failures_2h': 25, 'last_message': 'No recommendation', 'discriminator': ''}, 'evidence': [{'label': 'Kubernetes events', 'href': '/logs?cluster=automation&from=1794813341&to=1794816941&source=events&q=HorizontalPodAutoscaler%2Fdocproc-hpa'}, {'label': 'Pods', 'href': '/pods?cluster=automation'}], 'provenance': {'source': 'x-ray', 'note': 'Kubernetes events (logs/events in BigQuery), last 45 min'}, 'impact': 19.3, 'status': 'open', 'first_seen': 1792760595, 'last_seen': 1794816941, 'resolved_at': None, 'acked_by': None, 'acked_at': None, 'snoozed_until': None, 'occurrences': 1471, 'narrative': 'Autoscaler blind: HorizontalPodAutoscaler/docproc-hpa (tilda) cannot read its scaling metric — 27× in 2 h. Facts: namespace tilda, object HorizontalPodAutoscaler/docproc-hpa, failures_2h 27, last_message did not receive metrics for targeted pods (pods might be unready).', 'narrative_kind': 'template', 'discriminator': '', 'level': 'medium', 'told_level': None, 'episode_at': 1794816941, 'chat_thread': None, 'kind_label': 'Autoscaler blind', 'group': 'Platform', 'age_s': 2056379, 'stale_s': 33}
  • 2026-11-16 10:49:21 UTCresolved x-ray · reason=not observed grace_s=900 finding={'id': 5455, 'fingerprint': '20c2a80bc27f7a2e7d13', 'kind': 'scaler.failing', 'severity': 'warning', 'cluster': 'automation', 'subject': 'tilda/HorizontalPodAutoscaler/docproc-hpa', 'title': 'HorizontalPodAutoscaler/docproc-hpa (tilda) cannot read its scaling metric — 7× in 2 h', 'facts': {'namespace': 'tilda', 'object': 'HorizontalPodAutoscaler/docproc-hpa', 'failures_2h': 7, 'last_message': 'did not receive metrics for targeted pods (pods might be unready)', 'discriminator': ''}, 'evidence': [{'label': 'Kubernetes events', 'href': '/logs?cluster=automation&from=1794820778&to=1794824378&source=events&q=HorizontalPodAutoscaler%2Fdocproc-hpa'}, {'label': 'Pods', 'href': '/pods?cluster=automation'}], 'provenance': {'source': 'x-ray', 'note': 'Kubernetes events (logs/events in BigQuery), last 45 min'}, 'impact': 24.3, 'status': 'resolved', 'first_seen': 1792760595, 'last_seen': 1794824378, 'resolved_at': 1794826161, 'acked_by': None, 'acked_at': None, 'snoozed_until': None, 'occurrences': 1478, 'narrative': 'Autoscaler blind: HorizontalPodAutoscaler/docproc-hpa (tilda) cannot read its scaling metric — 7× in 2 h. Facts: namespace tilda, object HorizontalPodAutoscaler/docproc-hpa, failures_2h 7, last_message did not receive metrics for targeted pods (pods might be unready).', 'narrative_kind': 'template', 'discriminator': '', 'level': 'medium', 'told_level': None, 'episode_at': 1794816941, 'chat_thread': None, 'kind_label': 'Autoscaler blind', 'group': 'Platform', 'age_s': 2065590, 'stale_s': 1807}
  • 2026-11-16 19:14:41 UTCreopened x-ray · severity=warning was=warning title=HorizontalPodAutoscaler/docproc-hpa (tilda) cannot read its scaling metric — 26× in 2 h level=medium was_level=medium finding={'id': 5455, 'fingerprint': '20c2a80bc27f7a2e7d13', 'kind': 'scaler.failing', 'severity': 'warning', 'cluster': 'automation', 'subject': 'tilda/HorizontalPodAutoscaler/docproc-hpa', 'title': 'HorizontalPodAutoscaler/docproc-hpa (tilda) cannot read its scaling metric — 26× in 2 h', 'facts': {'namespace': 'tilda', 'object': 'HorizontalPodAutoscaler/docproc-hpa', 'failures_2h': 26, 'last_message': 'did not receive metrics for targeted pods (pods might be unready)', 'discriminator': ''}, 'evidence': [{'label': 'Kubernetes events', 'href': '/logs?cluster=automation&from=1794852881&to=1794856481&source=events&q=HorizontalPodAutoscaler%2Fdocproc-hpa'}, {'label': 'Pods', 'href': '/pods?cluster=automation'}], 'provenance': {'source': 'x-ray', 'note': 'Kubernetes events (logs/events in BigQuery), last 45 min'}, 'impact': 19.3, 'status': 'open', 'first_seen': 1792760595, 'last_seen': 1794856481, 'resolved_at': None, 'acked_by': None, 'acked_at': None, 'snoozed_until': None, 'occurrences': 1479, 'narrative': 'Autoscaler blind: HorizontalPodAutoscaler/docproc-hpa (tilda) cannot read its scaling metric — 7× in 2 h. Facts: namespace tilda, object HorizontalPodAutoscaler/docproc-hpa, failures_2h 7, last_message did not receive metrics for targeted pods (pods might be unready).', 'narrative_kind': 'template', 'discriminator': '', 'level': 'medium', 'told_level': None, 'episode_at': 1794856481, 'chat_thread': None, 'kind_label': 'Autoscaler blind', 'group': 'Platform', 'age_s': 2095907, 'stale_s': 21}
  • 2026-11-16 21:27:22 UTCresolved x-ray · reason=not observed grace_s=900 finding={'id': 5455, 'fingerprint': '20c2a80bc27f7a2e7d13', 'kind': 'scaler.failing', 'severity': 'warning', 'cluster': 'automation', 'subject': 'tilda/HorizontalPodAutoscaler/docproc-hpa', 'title': 'HorizontalPodAutoscaler/docproc-hpa (tilda) cannot read its scaling metric — 2× in 2 h', 'facts': {'namespace': 'tilda', 'object': 'HorizontalPodAutoscaler/docproc-hpa', 'failures_2h': 2, 'last_message': 'did not receive metrics for targeted pods (pods might be unready)', 'discriminator': ''}, 'evidence': [{'label': 'Kubernetes events', 'href': '/logs?cluster=automation&from=1794859738&to=1794863338&source=events&q=HorizontalPodAutoscaler%2Fdocproc-hpa'}, {'label': 'Pods', 'href': '/pods?cluster=automation'}], 'provenance': {'source': 'x-ray', 'note': 'Kubernetes events (logs/events in BigQuery), last 45 min'}, 'impact': 24.3, 'status': 'resolved', 'first_seen': 1792760595, 'last_seen': 1794863338, 'resolved_at': 1794864442, 'acked_by': None, 'acked_at': None, 'snoozed_until': None, 'occurrences': 1490, 'narrative': 'Autoscaler blind: HorizontalPodAutoscaler/docproc-hpa (tilda) cannot read its scaling metric — 2× in 2 h. Facts: namespace tilda, object HorizontalPodAutoscaler/docproc-hpa, failures_2h 2, last_message did not receive metrics for targeted pods (pods might be unready).', 'narrative_kind': 'template', 'discriminator': '', 'level': 'medium', 'told_level': None, 'episode_at': 1794856481, 'chat_thread': None, 'kind_label': 'Autoscaler blind', 'group': 'Platform', 'age_s': 2103865, 'stale_s': 1122}
  • 2026-11-17 00:12:03 UTCreopened x-ray · severity=warning was=warning title=HorizontalPodAutoscaler/docproc-hpa (tilda) cannot read its scaling metric — 25× in 2 h level=medium was_level=medium finding={'id': 5455, 'fingerprint': '20c2a80bc27f7a2e7d13', 'kind': 'scaler.failing', 'severity': 'warning', 'cluster': 'automation', 'subject': 'tilda/HorizontalPodAutoscaler/docproc-hpa', 'title': 'HorizontalPodAutoscaler/docproc-hpa (tilda) cannot read its scaling metric — 25× in 2 h', 'facts': {'namespace': 'tilda', 'object': 'HorizontalPodAutoscaler/docproc-hpa', 'failures_2h': 25, 'last_message': 'unable to get metric memory: no metrics returned from resource metrics API', 'discriminator': ''}, 'evidence': [{'label': 'Kubernetes events', 'href': '/logs?cluster=automation&from=1794870723&to=1794874323&source=events&q=HorizontalPodAutoscaler%2Fdocproc-hpa'}, {'label': 'Pods', 'href': '/pods?cluster=automation'}], 'provenance': {'source': 'x-ray', 'note': 'Kubernetes events (logs/events in BigQuery), last 45 min'}, 'impact': 19.3, 'status': 'open', 'first_seen': 1792760595, 'last_seen': 1794874323, 'resolved_at': None, 'acked_by': None, 'acked_at': None, 'snoozed_until': None, 'occurrences': 1491, 'narrative': 'Autoscaler blind: HorizontalPodAutoscaler/docproc-hpa (tilda) cannot read its scaling metric — 2× in 2 h. Facts: namespace tilda, object HorizontalPodAutoscaler/docproc-hpa, failures_2h 2, last_message did not receive metrics for targeted pods (pods might be unready).', 'narrative_kind': 'template', 'discriminator': '', 'level': 'medium', 'told_level': None, 'episode_at': 1794874323, 'chat_thread': None, 'kind_label': 'Autoscaler blind', 'group': 'Platform', 'age_s': 2113747, 'stale_s': 19}
  • 2026-11-17 02:23:20 UTCresolved x-ray · reason=not observed grace_s=900 finding={'id': 5455, 'fingerprint': '20c2a80bc27f7a2e7d13', 'kind': 'scaler.failing', 'severity': 'warning', 'cluster': 'automation', 'subject': 'tilda/HorizontalPodAutoscaler/docproc-hpa', 'title': 'HorizontalPodAutoscaler/docproc-hpa (tilda) cannot read its scaling metric — 27× in 2 h', 'facts': {'namespace': 'tilda', 'object': 'HorizontalPodAutoscaler/docproc-hpa', 'failures_2h': 27, 'last_message': 'did not receive metrics for targeted pods (pods might be unready)', 'discriminator': ''}, 'evidence': [{'label': 'Kubernetes events', 'href': '/logs?cluster=automation&from=1794877580&to=1794881180&source=events&q=HorizontalPodAutoscaler%2Fdocproc-hpa'}, {'label': 'Pods', 'href': '/pods?cluster=automation'}], 'provenance': {'source': 'x-ray', 'note': 'Kubernetes events (logs/events in BigQuery), last 45 min'}, 'impact': 24.3, 'status': 'resolved', 'first_seen': 1792760595, 'last_seen': 1794881180, 'resolved_at': 1794882200, 'acked_by': None, 'acked_at': None, 'snoozed_until': None, 'occurrences': 1501, 'narrative': 'Autoscaler blind: HorizontalPodAutoscaler/docproc-hpa (tilda) cannot read its scaling metric — 27× in 2 h. Facts: namespace tilda, object HorizontalPodAutoscaler/docproc-hpa, failures_2h 27, last_message did not receive metrics for targeted pods (pods might be unready).', 'narrative_kind': 'template', 'discriminator': '', 'level': 'medium', 'told_level': None, 'episode_at': 1794874323, 'chat_thread': None, 'kind_label': 'Autoscaler blind', 'group': 'Platform', 'age_s': 2121624, 'stale_s': 1039}

Check it yourself

Every link carries the finding's own time window, so it shows tomorrow what it shows now.

Actions

Sign in (IAP) to acknowledge, snooze or resolve.

Where the numbers come from

sourcex-ray
noteKubernetes events (logs/events in BigQuery), last 45 min
detectork8s_events