test27: LiteLLM's OpenAI cost is $2.03 (5.0%) over OpenAI's bill over 7 days (2026-11-10 to 2026-11-16)
warning
LLM cost off the provider's bill
test27
open
impact 19
opened 36d ago · last observed 1d ago · observed 73× · #4438 · 7f8b952d14891315562f
What happened template
Over 7 UTC days (2026-11-10 to 2026-11-16) OpenAI billed test27 $40.21; the LiteLLM log says $42.24, a difference of $2.03 (5.0%, log above the bill), past the 1.0% this alert allows. Largest gaps: gpt-5.6-terra billed $35.26, logged $37.23; gpt-5.4 billed $3.02, logged $3.04; gpt-6.1-terra billed $1.84, logged $1.86. Any charge worked out from the log inherits that difference; OpenAI's bill is the authority.
What the LiteLLM log says a cluster spent on OpenAI no longer matches what OpenAI billed for it — a figure usage is charged from.
The facts
| first_day | 2026-11-10 |
| last_day | 2026-11-16 |
| days | 7 |
| billed_usd | 40.21 |
| logged_usd | 42.24 |
| diff_usd | -2.03 |
| share_pct | 5.04 |
| tolerance_pct | 1.00 |
| direction | log above the bill |
| models_off | {'model': 'gpt-5.6-terra', 'billed': 35.26, 'logged': 37.23}, {'model': 'gpt-5.4', 'billed': 3.02, 'logged': 3.04}, {'model': 'gpt-6.1-terra', 'billed': 1.84, 'logged': 1.86}, {'model': 'gpt-5.6-luna', 'billed': 0.0, 'logged': 0.02}, {'model': 'gpt-4o', 'billed': 0.03, 'logged': 0.03} |
| billed_not_logged_usd | 0 |
| openai_project | test27 |
| discriminator |
The story — No deploy or hand change is recorded in the hour before this opened.
- 2026-10-12 10:32:18 UTCcypher ontologysvc shape 00000000 p95 went 47 ms → 775 ms across the window (357 runs)
- 2026-10-12 11:32:18 UTCthis finding test27: LiteLLM's OpenAI cost is $2.03 (5.0%) over OpenAI's bill over 7 days (2026-11-10 to 2026-11-16)
- 2026-10-16 14:46:26 UTCfinding · warning onboardingsvc GET /api/myprofile/visibility/v2: permission denied — 114 of 125 calls (91 %; 403×114) in the last 15 min — 8× its usual 15.1
- 2026-10-23 13:03:15 UTCfinding · warning HorizontalPodAutoscaler/tmfsync-hpa (tilda) cannot read its scaling metric — 7× in 2 h
- 2026-10-23 13:03:15 UTCfinding · warning HorizontalPodAutoscaler/docproc-hpa (tilda) cannot read its scaling metric — 15× in 2 h
- 2026-10-23 13:03:15 UTCfinding · warning onboardingsvc is burning its error budget at 7.3× (1 h) / 7.4× (6 h) against a 99.00% objective
- 2026-10-23 13:12:51 UTCfinding · info docproc Neo4j load 87 q/min vs a normal 11 q/min ± 1 q/min for Mon 19:00 UTC (3 of the last 4 checks)
- 2026-10-23 13:33:46 UTCfinding · warning pubsub.dashboards-test27-dashsub: 5 failed runs in the last 6 h — SyncForAIRun: merge recommendations: MergeRecommendations: failed to fetch existing IDs: failed to q
- 2026-10-23 13:42:32 UTCfinding · info docproc: Neo4j queries per request 53.3 — 9.2× the fleet's usual 5.8
- 2026-10-23 13:42:32 UTCfinding · info enrollsvc: Neo4j queries per request 42.0 — 7.1× the fleet's usual 5.9 (also p95 latency (ms) 1.98 s)
- 2026-11-14 12:00:44 UTChand change [email protected] changed apps/v1/namespaces/tilda/deployments/studiosvc by hand (kubectl/v1.35.9 (darwin/arm64) kubernetes/d834de3,gzip(gfe))
- 2026-11-14 12:01:11 UTChand change [email protected] changed apps/v1/namespaces/tilda/deployments/execsvc by hand (kubectl/v1.35.9 (darwin/arm64) kubernetes/d834de3,gzip(gfe))
- 2026-11-14 14:26:23 UTChand change [email protected] changed apps/v1/namespaces/tilda/deployments/execsvc by hand (kubectl/v1.35.9 (darwin/arm64) kubernetes/d834de3,gzip(gfe))
- 2026-11-14 14:26:39 UTChand change [email protected] changed apps/v1/namespaces/tilda/deployments/studiosvc by hand (kubectl/v1.35.9 (darwin/arm64) kubernetes/d834de3,gzip(gfe))
- 2026-11-14 17:58:01 UTChand change [email protected] changed apps/v1/namespaces/tilda/deployments/docproc by hand (kubectl/v1.35.9 (darwin/arm64) kubernetes/d834de3,gzip(gfe))
- 2026-11-15 06:12:43 UTChand change [email protected] changed apps/v1/namespaces/tilda/deployments/tmfsync by hand (kubectl/v1.34.1 (darwin/arm64) kubernetes/93248f9,gzip(gfe))
- 2026-11-15 06:40:00 UTCerrors cluster 5xx peaked at 34 in one five-minute bucket (median 0 in this window)
- 2026-11-15 06:52:31 UTChand change [email protected] changed apps/v1/namespaces/tilda/deployments/tmfsync by hand (kubectl/v1.34.1 (darwin/arm64) kubernetes/93248f9,gzip(gfe))
- 2026-11-15 15:15:12 UTChand change [email protected] changed apps/v1/namespaces/tilda/deployments/enrollsvc by hand (kubectl/v1.32.2 (darwin/amd64) kubernetes/67a30c0,gzip(gfe))
- 2026-11-15 15:15:14 UTChand change [email protected] changed apps/v1/namespaces/tilda/deployments/chat-agent by hand (kubectl/v1.32.2 (darwin/amd64) kubernetes/67a30c0,gzip(gfe))
- 2026-11-15 16:03:03 UTChand change [email protected] changed apps/v1/namespaces/tilda/deployments/studiosvc by hand (kubectl/v1.32.2 (darwin/amd64) kubernetes/67a30c0,gzip(gfe))
- 2026-11-15 16:32:04 UTChand change [email protected] changed apps/v1/namespaces/tilda/deployments/chat-agent by hand (kubectl/v1.32.2 (darwin/amd64) kubernetes/67a30c0,gzip(gfe))
- 2026-11-15 16:35:21 UTChand change [email protected] changed apps/v1/namespaces/tilda/deployments/chat-agent by hand (kubectl/v1.32.2 (darwin/amd64) kubernetes/67a30c0,gzip(gfe))
- 2026-11-15 17:14:46 UTChand change [email protected] changed apps/v1/namespaces/tilda/deployments/chat-agent by hand (kubectl/v1.32.2 (darwin/amd64) kubernetes/67a30c0,gzip(gfe))
- 2026-11-15 17:25:50 UTChand change [email protected] changed apps/v1/namespaces/tilda/deployments/chat-agent by hand (kubectl/v1.32.2 (darwin/amd64) kubernetes/67a30c0,gzip(gfe))
- 2026-11-15 17:31:26 UTChand change [email protected] changed apps/v1/namespaces/tilda/deployments/chat-agent by hand (kubectl/v1.32.2 (darwin/amd64) kubernetes/67a30c0,gzip(gfe))
- 2026-11-15 19:09:20 UTChand change [email protected] changed apps/v1/namespaces/tilda/deployments/execsvc by hand (kubectl/v1.35.9 (darwin/arm64) kubernetes/d834de3,gzip(gfe))
- 2026-11-15 19:16:56 UTChand change [email protected] changed apps/v1/namespaces/tilda/deployments/execsvc by hand (kubectl/v1.35.9 (darwin/arm64) kubernetes/d834de3,gzip(gfe))
- 2026-11-15 19:17:23 UTChand change [email protected] changed apps/v1/namespaces/tilda/deployments/execsvc by hand (kubectl/v1.35.9 (darwin/arm64) kubernetes/d834de3,gzip(gfe))
- 2026-11-15 20:26:13 UTChand change [email protected] changed apps/v1/namespaces/tilda/deployments/chat-agent by hand (kubectl/v1.32.2 (darwin/amd64) kubernetes/67a30c0,gzip(gfe))
- 2026-11-15 20:39:53 UTChand change [email protected] changed apps/v1/namespaces/tilda/deployments/chat-agent by hand (kubectl/v1.32.2 (darwin/amd64) kubernetes/67a30c0,gzip(gfe))
- 2026-11-15 21:16:01 UTChand change [email protected] changed apps/v1/namespaces/tilda/deployments/execsvc by hand (kubectl/v1.35.9 (darwin/arm64) kubernetes/d834de3,gzip(gfe))
- 2026-11-15 22:15:52 UTChand change [email protected] changed apps/v1/namespaces/tilda/deployments/execsvc by hand (kubectl/v1.32.2 (darwin/amd64) kubernetes/67a30c0,gzip(gfe))
- 2026-11-15 22:15:53 UTChand change [email protected] changed apps/v1/namespaces/tilda/deployments/chat-agent by hand (kubectl/v1.32.2 (darwin/amd64) kubernetes/67a30c0,gzip(gfe))
- 2026-11-16 01:14:19 UTChand change [email protected] changed apps/v1/namespaces/tilda/deployments/chat-agent by hand (kubectl/v1.32.2 (darwin/amd64) kubernetes/67a30c0,gzip(gfe))
- 2026-11-16 04:26:06 UTChand change [email protected] changed apps/v1/namespaces/tilda/deployments/docsvc by hand (kubectl/v1.35.1 (darwin/arm64) kubernetes/8fea90b,gzip(gfe))
- 2026-11-16 05:10:12 UTChand change [email protected] changed apps/v1/namespaces/tilda/deployments/onboardingsvc by hand (kubectl/v1.35.1 (darwin/arm64) kubernetes/8fea90b,gzip(gfe))
- 2026-11-16 06:42:17 UTChand change [email protected] changed apps/v1/namespaces/tilda/deployments/tmfsync by hand (kubectl/v1.34.1 (darwin/arm64) kubernetes/93248f9,gzip(gfe))
- 2026-11-16 06:54:26 UTChand change [email protected] changed apps/v1/namespaces/tilda/deployments/tmfsync by hand (kubectl/v1.34.1 (darwin/arm64) kubernetes/93248f9,gzip(gfe))
- 2026-11-16 06:55:52 UTChand change [email protected] changed apps/v1/namespaces/tilda/deployments/onboardingsvc by hand (kubectl/v1.35.1 (darwin/arm64) kubernetes/8fea90b,gzip(gfe))
- 2026-11-16 07:02:15 UTChand change [email protected] changed apps/v1/namespaces/tilda/deployments/tmfsync by hand (kubectl/v1.34.1 (darwin/arm64) kubernetes/93248f9,gzip(gfe))
- 2026-11-16 07:10:55 UTChand change [email protected] changed apps/v1/namespaces/tilda/deployments/docsvc by hand (kubectl/v1.34.1 (darwin/arm64) kubernetes/93248f9,gzip(gfe))
- 2026-11-16 07:15:20 UTChand change [email protected] changed apps/v1/namespaces/tilda/deployments/docsvc by hand (kubectl/v1.34.1 (darwin/arm64) kubernetes/93248f9,gzip(gfe))
- 2026-11-16 07:50:00 UTClatency cluster p95 peaked at 1.5 min
- 2026-11-16 08:20:06 UTChand change [email protected] changed apps/v1/namespaces/tilda/deployments/chat-agent by hand (kubectl/v1.36.4 (darwin/arm64) kubernetes/bb826b1,gzip(gfe))
- 2026-11-16 08:30:42 UTChand change [email protected] changed apps/v1/namespaces/tilda/deployments/chat-agent by hand (kubectl/v1.36.4 (darwin/arm64) kubernetes/bb826b1,gzip(gfe))
- 2026-11-16 10:14:14 UTChand change [email protected] changed core/v1/namespaces/tilda/secrets/sheet-edit-svc-syncfusion by hand (kubectl/v1.36.4 (darwin/arm64) kubernetes/bb826b1,gzip(gfe))
- 2026-11-16 10:14:59 UTChand change [email protected] changed apps/v1/namespaces/tilda/deployments/chat-agent by hand (kubectl/v1.36.4 (darwin/arm64) kubernetes/bb826b1,gzip(gfe))
- 2026-11-16 10:15:07 UTChand change [email protected] changed apps/v1/namespaces/tilda/deployments/chat-agent by hand (kubectl/v1.36.4 (darwin/arm64) kubernetes/bb826b1,gzip(gfe))
- 2026-11-16 10:16:16 UTChand change [email protected] changed core/v1/namespaces/tilda/services/sheet-edit-svc by hand (kubectl/v1.36.4 (darwin/arm64) kubernetes/bb826b1,gzip(gfe))
- 2026-11-16 10:16:19 UTChand change [email protected] changed apps/v1/namespaces/tilda/deployments/sheet-edit-svc by hand (kubectl/v1.36.4 (darwin/arm64) kubernetes/bb826b1,gzip(gfe))
- 2026-11-16 10:18:07 UTChand change [email protected] changed apps/v1/namespaces/tilda/deployments/docsvc by hand (kubectl/v1.35.1 (darwin/arm64) kubernetes/8fea90b,gzip(gfe))
- 2026-11-16 10:23:54 UTChand change [email protected] changed apps/v1/namespaces/tilda/deployments/chat-agent by hand (kubectl/v1.36.4 (darwin/arm64) kubernetes/bb826b1,gzip(gfe))
- 2026-11-16 10:24:04 UTChand change [email protected] changed apps/v1/namespaces/tilda/deployments/chat-agent by hand (kubectl/v1.36.4 (darwin/arm64) kubernetes/bb826b1,gzip(gfe))
- 2026-11-16 10:25:00 UTChand change [email protected] changed core/v1/namespaces/tilda/services/sheet-edit-svc by hand (kubectl/v1.36.4 (darwin/arm64) kubernetes/bb826b1,gzip(gfe))
- 2026-11-16 10:25:00 UTChand change [email protected] changed apps/v1/namespaces/tilda/deployments/sheet-edit-svc by hand (kubectl/v1.36.4 (darwin/arm64) kubernetes/bb826b1,gzip(gfe))
- 2026-11-16 10:25:07 UTChand change [email protected] changed core/v1/namespaces/tilda/secrets/sheet-edit-svc-syncfusion by hand (kubectl/v1.36.4 (darwin/arm64) kubernetes/bb826b1,gzip(gfe))
- 2026-11-16 15:00:56 UTChand change [email protected] changed apps/v1/namespaces/tilda/deployments/chat-agent by hand (kubectl/v1.32.2 (darwin/amd64) kubernetes/67a30c0,gzip(gfe))
- 2026-11-16 15:18:43 UTChand change [email protected] changed apps/v1/namespaces/tilda/deployments/virtual-assistant by hand (kubectl/v1.33.4 (darwin/arm64) kubernetes/74cdb42,gzip(gfe))
- 2026-11-16 15:27:04 UTChand change [email protected] changed apps/v1/namespaces/tilda/deployments/chat-agent by hand (kubectl/v1.32.2 (darwin/amd64) kubernetes/67a30c0,gzip(gfe))
- 2026-11-16 16:28:29 UTChand change [email protected] changed apps/v1/namespaces/tilda/deployments/studiosvc by hand (kubectl/v1.33.3 (darwin/amd64) kubernetes/80779bd,gzip(gfe))
- 2026-11-16 16:38:14 UTChand change [email protected] changed core/v1/namespaces/tilda/secrets/sheet-edit-svc-syncfusion by hand (kubectl/v1.36.4 (darwin/arm64) kubernetes/bb826b1,gzip(gfe))
- 2026-11-16 16:38:27 UTChand change [email protected] changed core/v1/namespaces/tilda/services/sheet-edit-svc by hand (kubectl/v1.36.4 (darwin/arm64) kubernetes/bb826b1,gzip(gfe))
- 2026-11-16 16:38:30 UTChand change [email protected] changed apps/v1/namespaces/tilda/deployments/sheet-edit-svc by hand (kubectl/v1.36.4 (darwin/arm64) kubernetes/bb826b1,gzip(gfe))
- 2026-11-16 16:41:05 UTChand change [email protected] changed apps/v1/namespaces/tilda/deployments/tmfsync by hand (kubectl/v1.34.1 (darwin/arm64) kubernetes/93248f9,gzip(gfe))
- 2026-11-16 16:41:18 UTChand change [email protected] changed apps/v1/namespaces/tilda/deployments/chat-agent by hand (kubectl/v1.36.4 (darwin/arm64) kubernetes/bb826b1,gzip(gfe))
- 2026-11-16 16:41:30 UTChand change [email protected] changed apps/v1/namespaces/tilda/deployments/chat-agent by hand (kubectl/v1.36.4 (darwin/arm64) kubernetes/bb826b1,gzip(gfe))
- 2026-11-16 16:46:16 UTChand change [email protected] changed apps/v1/namespaces/tilda/deployments/docsvc by hand (kubectl/v1.34.1 (darwin/arm64) kubernetes/93248f9,gzip(gfe))
- 2026-11-16 16:51:21 UTChand change [email protected] changed apps/v1/namespaces/tilda/deployments/chat-agent by hand (kubectl/v1.36.4 (darwin/arm64) kubernetes/bb826b1,gzip(gfe))
- 2026-11-16 16:51:32 UTChand change [email protected] changed apps/v1/namespaces/tilda/deployments/chat-agent by hand (kubectl/v1.36.4 (darwin/arm64) kubernetes/bb826b1,gzip(gfe))
- 2026-11-16 16:51:51 UTChand change [email protected] changed core/v1/namespaces/tilda/services/sheet-edit-svc by hand (kubectl/v1.36.4 (darwin/arm64) kubernetes/bb826b1,gzip(gfe))
- 2026-11-16 16:51:51 UTChand change [email protected] changed apps/v1/namespaces/tilda/deployments/sheet-edit-svc by hand (kubectl/v1.36.4 (darwin/arm64) kubernetes/bb826b1,gzip(gfe))
- 2026-11-16 16:51:59 UTChand change [email protected] changed core/v1/namespaces/tilda/secrets/sheet-edit-svc-syncfusion by hand (kubectl/v1.36.4 (darwin/arm64) kubernetes/bb826b1,gzip(gfe))
- 2026-11-16 17:01:20 UTChand change [email protected] changed apps/v1/namespaces/tilda/deployments/tmfsync by hand (kubectl/v1.34.1 (darwin/arm64) kubernetes/93248f9,gzip(gfe))
- 2026-11-16 17:53:39 UTChand change [email protected] changed apps/v1/namespaces/tilda/deployments/studiosvc by hand (kubectl/v1.33.3 (darwin/amd64) kubernetes/80779bd,gzip(gfe))
- 2026-11-16 18:04:21 UTChand change [email protected] changed apps/v1/namespaces/tilda/deployments/studiosvc by hand (kubectl/v1.32.2 (darwin/amd64) kubernetes/67a30c0,gzip(gfe))
- 2026-11-16 18:30:32 UTChand change [email protected] changed apps/v1/namespaces/tilda/deployments/docsvc by hand (kubectl/v1.30.5 (darwin/arm64) kubernetes/633f2e9,gzip(gfe))
- 2026-11-16 18:30:33 UTChand change [email protected] changed apps/v1/namespaces/tilda/deployments/docsvc by hand (kubectl/v1.30.5 (darwin/arm64) kubernetes/633f2e9,gzip(gfe))
- 2026-11-16 18:30:34 UTChand change [email protected] changed apps/v1/namespaces/tilda/deployments/docproc by hand (kubectl/v1.30.5 (darwin/arm64) kubernetes/633f2e9,gzip(gfe))
- 2026-11-16 18:30:36 UTChand change [email protected] changed apps/v1/namespaces/tilda/deployments/docproc by hand (kubectl/v1.30.5 (darwin/arm64) kubernetes/633f2e9,gzip(gfe))
- 2026-11-16 18:40:42 UTChand change [email protected] changed apps/v1/namespaces/tilda/deployments/tmfsync by hand (kubectl/v1.34.1 (darwin/arm64) kubernetes/93248f9,gzip(gfe))
- 2026-11-16 18:41:58 UTChand change [email protected] changed apps/v1/namespaces/tilda/deployments/docproc by hand (kubectl/v1.30.5 (darwin/arm64) kubernetes/633f2e9,gzip(gfe))
- 2026-11-16 18:48:43 UTChand change [email protected] changed apps/v1/namespaces/tilda/deployments/studiosvc by hand (kubectl/v1.33.3 (darwin/amd64) kubernetes/80779bd,gzip(gfe))
- 2026-11-16 18:53:59 UTChand change [email protected] changed apps/v1/namespaces/tilda/deployments/tmfsync by hand (kubectl/v1.34.1 (darwin/arm64) kubernetes/93248f9,gzip(gfe))
- 2026-11-16 18:54:20 UTChand change [email protected] changed apps/v1/namespaces/tilda/deployments/docproc by hand (kubectl/v1.30.5 (darwin/arm64) kubernetes/633f2e9,gzip(gfe))
- 2026-11-16 18:54:22 UTChand change [email protected] changed apps/v1/namespaces/tilda/deployments/docproc by hand (kubectl/v1.30.5 (darwin/arm64) kubernetes/633f2e9,gzip(gfe))
- 2026-11-16 18:54:23 UTChand change [email protected] changed apps/v1/namespaces/tilda/deployments/docsvc by hand (kubectl/v1.30.5 (darwin/arm64) kubernetes/633f2e9,gzip(gfe))
- 2026-11-16 18:54:24 UTChand change [email protected] changed apps/v1/namespaces/tilda/deployments/docsvc by hand (kubectl/v1.30.5 (darwin/arm64) kubernetes/633f2e9,gzip(gfe))
- 2026-11-16 18:58:41 UTChand change [email protected] changed apps/v1/namespaces/tilda/deployments/tmfsync by hand (kubectl/v1.34.1 (darwin/arm64) kubernetes/93248f9,gzip(gfe))
- 2026-11-16 19:09:53 UTChand change [email protected] changed apps/v1/namespaces/tilda/deployments/studiosvc by hand (kubectl/v1.33.3 (darwin/amd64) kubernetes/80779bd,gzip(gfe))
- 2026-11-16 19:30:41 UTChand change [email protected] changed apps/v1/namespaces/tilda/deployments/studiosvc by hand (kubectl/v1.33.3 (darwin/amd64) kubernetes/80779bd,gzip(gfe))
- 2026-11-16 19:53:58 UTChand change [email protected] changed apps/v1/namespaces/tilda/deployments/studiosvc by hand (kubectl/v1.33.3 (darwin/amd64) kubernetes/80779bd,gzip(gfe))
- 2026-11-16 20:24:14 UTChand change [email protected] changed apps/v1/namespaces/tilda/deployments/tmfsync by hand (kubectl/v1.34.1 (darwin/arm64) kubernetes/93248f9,gzip(gfe))
- 2026-11-16 20:37:25 UTChand change [email protected] changed apps/v1/namespaces/tilda/deployments/tmfsync by hand (kubectl/v1.34.1 (darwin/arm64) kubernetes/93248f9,gzip(gfe))
- 2026-11-16 20:50:35 UTChand change [email protected] changed apps/v1/namespaces/tilda/deployments/tmfsync by hand (kubectl/v1.34.1 (darwin/arm64) kubernetes/93248f9,gzip(gfe))
- 2026-11-16 21:30:24 UTChand change [email protected] changed apps/v1/namespaces/tilda/deployments/docsvc by hand (kubectl/v1.32.2 (darwin/amd64) kubernetes/67a30c0,gzip(gfe))
- 2026-11-16 21:30:25 UTChand change [email protected] changed apps/v1/namespaces/tilda/deployments/workplansvc by hand (kubectl/v1.32.2 (darwin/amd64) kubernetes/67a30c0,gzip(gfe))
- 2026-11-16 21:30:27 UTChand change [email protected] changed apps/v1/namespaces/tilda/deployments/docsvc by hand (kubectl/v1.32.2 (darwin/amd64) kubernetes/67a30c0,gzip(gfe))
- 2026-11-16 21:30:27 UTChand change [email protected] changed apps/v1/namespaces/tilda/deployments/workplansvc by hand (kubectl/v1.32.2 (darwin/amd64) kubernetes/67a30c0,gzip(gfe))
- 2026-11-16 21:31:28 UTChand change [email protected] changed apps/v1/namespaces/tilda/deployments/tmfsync by hand (kubectl/v1.34.1 (darwin/arm64) kubernetes/93248f9,gzip(gfe))
- 2026-11-16 21:35:58 UTChand change [email protected] changed apps/v1/namespaces/tilda/deployments/tmfsync by hand (kubectl/v1.34.1 (darwin/arm64) kubernetes/93248f9,gzip(gfe))
- 2026-11-16 21:46:25 UTChand change [email protected] changed apps/v1/namespaces/tilda/deployments/tmfsync by hand (kubectl/v1.34.1 (darwin/arm64) kubernetes/93248f9,gzip(gfe))
- 2026-11-16 22:14:55 UTChand change [email protected] changed apps/v1/namespaces/tilda/deployments/tmfsync by hand (kubectl/v1.34.1 (darwin/arm64) kubernetes/93248f9,gzip(gfe))
- 2026-11-16 22:33:12 UTChand change [email protected] changed apps/v1/namespaces/tilda/deployments/docproc by hand (kubectl/v1.30.5 (darwin/arm64) kubernetes/633f2e9,gzip(gfe))
- 2026-11-16 22:38:11 UTChand change [email protected] changed apps/v1/namespaces/tilda/deployments/docproc by hand (kubectl/v1.30.5 (darwin/arm64) kubernetes/633f2e9,gzip(gfe))
- 2026-11-16 22:41:00 UTChand change [email protected] changed apps/v1/namespaces/tilda/deployments/tmfsync by hand (kubectl/v1.34.1 (darwin/arm64) kubernetes/93248f9,gzip(gfe))
- 2026-11-16 22:42:47 UTChand change [email protected] changed apps/v1/namespaces/tilda/deployments/docproc by hand (kubectl/v1.30.5 (darwin/arm64) kubernetes/633f2e9,gzip(gfe))
History
- 2026-11-17 00:12:03 UTCreopened x-ray · severity=warning was=warning title=test27: LiteLLM's OpenAI cost is $2.03 (5.0%) over OpenAI's bill over 7 days (2026-11-10 to 2026-11-16) level=medium was_level=medium finding={'id': 4438, 'fingerprint': '7f8b952d14891315562f', 'kind': 'llm.cost_drift', 'severity': 'warning', 'cluster': 'test27', 'subject': 'openai-cost', 'title': "test27: LiteLLM's OpenAI cost is $2.03 (5.0%) over OpenAI's bill over 7 days (2026-11-10 to 2026-11-16)", 'facts': {'first_day': '2026-11-10', 'last_day': '2026-11-16', 'days': 7, 'billed_usd': 40.21, 'logged_usd': 42.24, 'diff_usd': -2.03, 'share_pct': 5.04, 'tolerance_pct': 1.0, 'direction': 'log above the bill', 'models_off': [{'model': 'gpt-5.6-terra', 'billed': 35.26, 'logged': 37.23}, {'model': 'gpt-5.4', 'billed': 3.02, 'logged': 3.04}, {'model': 'gpt-6.1-terra', 'billed': 1.84, 'logged': 1.86}, {'model': 'gpt-5.6-luna', 'billed': 0.0, 'logged': 0.02}, {'model': 'gpt-4o', 'billed': 0.03, 'logged': 0.03}], 'billed_not_logged_usd': 0, 'openai_project': 'test27', 'discriminator': ''}, 'evidence': [{'label': 'OpenAI spend', 'href': '/costs/openai?cluster=test27&from=1794268800&to=1794873600'}, {'label': 'AI usage', 'href': '/ai?cluster=test27&from=1794268800&to=1794873600'}], 'provenance': {'source': 'live', 'collected_at': None, 'age_seconds': None, 'stale': False, 'shown': None, 'total': None, 'truncated': False, 'coverage_from': None, 'retain_days': None, 'note': "BigQuery tilda_llm_logs link and OpenAI's organization API (stored copy)"}, 'impact': 14.4, 'status': 'open', 'first_seen': 1791804738, 'last_seen': 1794874323, 'resolved_at': None, 'acked_by': None, 'acked_at': None, 'snoozed_until': None, 'occurrences': 73, 'narrative': "Over 7 UTC days (2026-10-29 to 2026-11-04) OpenAI billed test27 $33.10; the LiteLLM log says $45.00, a difference of $11.89 (35.9%, log above the bill), past the 1.0% this alert allows. Largest gaps: gpt-5.6-terra billed $28.43, logged $38.85; gpt-5.2 billed $0.68, logged $1.39; gpt-5.4 billed $2.47, logged $2.91. Any charge worked out from the log inherits that difference; OpenAI's bill is the authority.", 'narrative_kind': 'template', 'discriminator': '', 'level': 'medium', 'told_level': None, 'episode_at': 1794874323, 'chat_thread': None, 'kind_label': "LLM cost off the provider's bill", 'group': 'AI', 'age_s': 3069619, 'stale_s': 34}
Check it yourself
Every link carries the finding's own time window, so it shows tomorrow what it shows now.
Actions
Sign in (IAP) to acknowledge, snooze or resolve.
Where the numbers come from
| source | live |
| collected_at | None |
| age_seconds | None |
| stale | False |
| shown | None |
| total | None |
| truncated | False |
| coverage_from | None |
| retain_days | None |
| note | BigQuery tilda_llm_logs link and OpenAI's organization API (stored copy) |
| detector | openai_cost_drift |