Xray
hourly rollups 1h 6h 24h 48h 3d 5d 7d 14d 30d ‹
Last 48 hours▾
Ends now. Anything up to this cluster's 30-day retention.
Start and end times
Cancel
Interpreted in UTC (change it at the right of this bar). Earliest available: 2026-10-19 16:54:56.
› →|
updated 1d ago
Sample data. This database was generated by scripts/seed_dev_db.py — every service, deploy, person and figure on this page is synthetic. Names are sample.*@seed.invalid and image tags are prefixed SEED-. Nothing here happened.
← findings

execsvc (tilda) image pull failing for at least 13 min — 1 pod

warning Pod cannot start test26 resolved impact 26 opened 21d ago · last observed 1d ago · observed 9× · #8069 · cec3813a64bb1a4e873f

What happened template

Pod cannot start: execsvc (tilda) image pull failing for at least 13 min — 1 pod. Facts: namespace tilda, workload execsvc, why image pull failing, pending_minutes 13, since 1794901864.

A workload's pods have been unable to start for 10+ minutes — image pull failing, a container config error, or no node that can take them — and are still being reported.

The facts

namespacetilda
workloadexecsvc
whyimage pull failing
podsexecsvc-66c7974fcc-5svfx
pending_minutes13
since1,794,901,864
events32
last_messageFailed to pull image "us-central1-docker.pkg.dev/tilda-dev-325721/artifacts/services/execsvc:cc27b3c-shashank": rpc error: code = NotFound desc = failed to pull and unpack image "us-central1-docker.pkg.dev/tilda-dev-325721/artifacts/services/execsvc:cc27b3c-shashank": failed to resolve reference "us-central1-docker.pkg.dev/tilda-dev-325721/artifacts/services/execsvc:cc27b3c-shashank": us-central1-
discriminatorimage pull failing

The story — No deploy or hand change is recorded in the hour before this opened.

History

  • 2026-11-17 08:04:09 UTCreopened x-ray · severity=warning was=warning title=execsvc (tilda) image pull failing for at least 13 min — 1 pod level=medium was_level=medium finding={'id': 8069, 'fingerprint': 'cec3813a64bb1a4e873f', 'kind': 'pod.cannot_start', 'severity': 'warning', 'cluster': 'test26', 'subject': 'tilda/execsvc', 'title': 'execsvc (tilda) image pull failing for at least 13 min — 1 pod', 'facts': {'namespace': 'tilda', 'workload': 'execsvc', 'why': 'image pull failing', 'pods': ['execsvc-66c7974fcc-5svfx'], 'pending_minutes': 13, 'since': 1794901864, 'events': 32, 'last_message': 'Failed to pull image "us-central1-docker.pkg.dev/tilda-dev-325721/artifacts/services/execsvc:cc27b3c-shashank": rpc error: code = NotFound desc = failed to pull and unpack image "us-central1-docker.pkg.dev/tilda-dev-325721/artifacts/services/execsvc:cc27b3c-shashank": failed to resolve reference "us-central1-docker.pkg.dev/tilda-dev-325721/artifacts/services/execsvc:cc27b3c-shashank": us-central1-', 'discriminator': 'image pull failing'}, 'evidence': [{'label': 'Kubernetes events', 'href': '/logs?cluster=test26&from=1794899049&to=1794902649&source=events&q=execsvc'}, {'label': 'Pods', 'href': '/pods?cluster=test26'}], 'provenance': {'source': 'x-ray', 'note': 'Kubernetes events (logs/events in BigQuery), last 45 min'}, 'impact': 21.2, 'status': 'open', 'first_seen': 1793152954, 'last_seen': 1794902649, 'resolved_at': None, 'acked_by': None, 'acked_at': None, 'snoozed_until': None, 'occurrences': 9, 'narrative': 'Pod cannot start: execsvc (tilda) image pull failing for at least 92 min — 1 pod. Facts: namespace tilda, workload execsvc, why image pull failing, pending_minutes 92, since 1793151919.', 'narrative_kind': 'template', 'discriminator': 'image pull failing', 'level': 'medium', 'told_level': None, 'episode_at': 1794902649, 'chat_thread': None, 'kind_label': 'Pod cannot start', 'group': 'Pods', 'age_s': 1749724, 'stale_s': 29}
  • 2026-11-17 08:26:41 UTCresolved x-ray · reason=not observed grace_s=900 finding={'id': 8069, 'fingerprint': 'cec3813a64bb1a4e873f', 'kind': 'pod.cannot_start', 'severity': 'warning', 'cluster': 'test26', 'subject': 'tilda/execsvc', 'title': 'execsvc (tilda) image pull failing for at least 13 min — 1 pod', 'facts': {'namespace': 'tilda', 'workload': 'execsvc', 'why': 'image pull failing', 'pods': ['execsvc-66c7974fcc-5svfx'], 'pending_minutes': 13, 'since': 1794901864, 'events': 32, 'last_message': 'Failed to pull image "us-central1-docker.pkg.dev/tilda-dev-325721/artifacts/services/execsvc:cc27b3c-shashank": rpc error: code = NotFound desc = failed to pull and unpack image "us-central1-docker.pkg.dev/tilda-dev-325721/artifacts/services/execsvc:cc27b3c-shashank": failed to resolve reference "us-central1-docker.pkg.dev/tilda-dev-325721/artifacts/services/execsvc:cc27b3c-shashank": us-central1-', 'discriminator': 'image pull failing'}, 'evidence': [{'label': 'Kubernetes events', 'href': '/logs?cluster=test26&from=1794899049&to=1794902649&source=events&q=execsvc'}, {'label': 'Pods', 'href': '/pods?cluster=test26'}], 'provenance': {'source': 'x-ray', 'note': 'Kubernetes events (logs/events in BigQuery), last 45 min'}, 'impact': 26.2, 'status': 'resolved', 'first_seen': 1793152954, 'last_seen': 1794902649, 'resolved_at': 1794904001, 'acked_by': None, 'acked_at': None, 'snoozed_until': None, 'occurrences': 9, 'narrative': 'Pod cannot start: execsvc (tilda) image pull failing for at least 13 min — 1 pod. Facts: namespace tilda, workload execsvc, why image pull failing, pending_minutes 13, since 1794901864.', 'narrative_kind': 'template', 'discriminator': 'image pull failing', 'level': 'medium', 'told_level': None, 'episode_at': 1794902649, 'chat_thread': None, 'kind_label': 'Pod cannot start', 'group': 'Pods', 'age_s': 1751132, 'stale_s': 1437}

Check it yourself

Every link carries the finding's own time window, so it shows tomorrow what it shows now.

Actions

Sign in (IAP) to acknowledge, snooze or resolve.

Where the numbers come from

sourcex-ray
noteKubernetes events (logs/events in BigQuery), last 45 min
detectork8s_events