X-ray, monitoring itself
Every cron job and scheduled task X-ray runs — named here on purpose, not discovered from logs. Each row's health is read from the freshness of the data the job writes; its spend is real: LLM from the call log (exact), BigQuery from X-ray's own service account priced at $6.25/TiB. Click a job for its detail, recent runs and any failures.
Local flags describe this process, not the ingester or external CronJobs. Health below is based on recorded writes, not this web replica's scheduler flag.
Notification workers · this process
Not enabled on this web process. Workers on the ingester or other processes are not described by this flag. · supervisor not running here · deadline 300 seconds
No worker attempts recorded in this process.
| Job | Runs | Where | Last run | Health | LLM | BigQuery | Total | |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Log ingest Reads each cluster's logs (BigQuery logs_raw) and rolls up API traffic, Neo4j load and error shapes into the Cloud SQL Postgres tiers. X-ray's heaviest BigQuery reader. |
scheduled every 300s (single ingester) |
master → all clusters single ingester not enabled here run_scheduler=false |
21h ago | stalePer-unit state (14)
|
$0.000 | $0.000 | $0.000 | |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| Detectors Runs the due finding detectors (budgets, outliers, job.failing, anomalies, …) after each ingest cycle and opens/resolves findings. |
scheduled after each ingest cycle |
master → all clusters single ingester not enabled here run_scheduler=false · detect=true · detect_live=true |
2d ago | stalePer-unit stateNo per-unit state available; this does not establish that the job is disabled. |
$0.000 | $0.000 | $0.000 | |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| ArgoCD collector Snapshots ArgoCD sync history and the ReplicaSet trail into the change feed — the deploy markers behind before/after latency comparisons. |
cronjob 7 * * * * · k8s CronJob, ns default |
master external CronJob local enablement not applicable or unknown run_scheduler=false |
— | unknownPer-unit state (10)
|
$0.000 | $0.000 | $0.000 | |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| Skill graph Snapshots master and production into the shared database via the API; unchanged commits reuse extraction but still report branch delivery. |
cronjob 17 */6 * * * · k8s CronJob, ns default |
master external CronJob local enablement not applicable or unknown run_scheduler=false |
— | unknownPer-unit state (2)
|
$0.000 | $0.000 | $0.000 | |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| Weaviate stats Daily master content coverage (Neo4j versus Weaviate), with per-environment attempt/success heartbeats. Production/delta collectors are not provisioned here. |
cronjob 10 2 * * * · k8s CronJob, ns tilda |
master external CronJob local enablement not applicable or unknown run_scheduler=false |
— | unknownPer-unit state (1)
|
$0.000 | $0.000 | $0.000 | |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| Cost ledger Mirrors the GCP billing export into Cloud SQL Postgres so the cost pages answer in milliseconds. Reads the billing-export BigQuery dataset, not logs. |
scheduled every ~6 h (in-app, off the request path) |
master single ingester not enabled here run_scheduler=false · costs_enabled=false |
— | unknownPer-unit stateNo per-unit state available; this does not establish that the job is disabled. |
$0.000 | $0.000 | $0.000 | |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| Baseline refresh Rebuilds the hour-of-week baselines the anomaly detectors compare each service against (traffic, error rate, p95, Neo4j load). |
scheduled daily |
master → all clusters single ingester not enabled here run_scheduler=false |
1d ago | okPer-unit stateNo per-unit state available; this does not establish that the job is disabled. |
$0.000 | $0.000 | $0.000 | |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| Ask X-ray (chat) The conversational agent: answers from the tools, proposes gated actions, reads source. The only interactive LLM spend. |
llm on demand (interactive) |
master on demand local enablement not applicable or unknown run_scheduler=false |
— | idlePer-unit stateNo per-unit state available; this does not establish that the job is disabled. |
$0.000 | $0.000 | $0.000 | |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| Alert composer Turns raw findings into human alert wording, narratives and rule text (Sonnet). |
llm when an alert or narrative is written |
master on demand local enablement not applicable or unknown run_scheduler=false |
20h ago | okPer-unit stateNo per-unit state available; this does not establish that the job is disabled. |
$0.041 50 calls |
$0.000 | $0.041 | |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| Query optimizer Suggests cheaper Cypher/SQL shapes. Requires an LLM key; health tracks the daily master run (other clusters run weekly in maintenance). |
scheduled daily on master; weekly across ingested clusters; also on demand |
master → all clusters single ingester not enabled here run_scheduler=false · llm_enabled=true |
— | unknownPer-unit state (1)
|
$0.486 5 calls |
$0.000 | $0.486 | |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| Watches LLM-assisted custom watches. |
llm when a watch fires |
master on demand local enablement not applicable or unknown run_scheduler=false |
— | idlePer-unit stateNo per-unit state available; this does not establish that the job is disabled. |
$0.000 | $0.000 | $0.000 |
Health: ok within cadence · late past 3× · stale past 12× · idle an on-demand job unused this window · unknown no freshness source yet.