Total API Requests (24h)
4,182,907
+12.4%vs. previous 24h
Avg. Latency Overhead
18.7 ms
-3.2msp50 routing decision
Cost Arbitrage Savings
$128,446.18
+$9,412 todaynet of gateway fees
Inference Flight Log
live
| Timestamp | Request ID | Original Target | Routed Model | Tokens | Saved | Status |
|---|---|---|---|---|---|---|
| 04:19:33.777Z | req_e675834b77f8 | claude-opus-4.6 | claude-opus-4.6 | 13,806 | — | Success |
| 04:19:32.679Z | req_238e6d10962a | gemini-3.1-pro | mistral-small-3 | 10,635 | $0.830 | Success |
| 04:19:30.317Z | req_9ebcdbb3463f | claude-opus-4.6 | claude-opus-4.6 | 2,895 | — | Success |
| 04:19:27.082Z | req_b3a3c4023ff5 | gpt-5.2-turbo | gpt-5.2-turbo | 3,321 | — | Success |
| 04:19:25.208Z | req_c148afcbcfcd | claude-haiku-4.5 | mistral-small-3 | 3,925 | $0.832 | Fallback |
| 04:19:23.586Z | req_9bbf7debd530 | qwen3-72b | llama-4-70b-groq | 4,541 | $0.718 | Success |
| 04:19:21.979Z | req_73988df20dc8 | llama-4-405b | llama-4-405b | 11,725 | — | Success |
| 04:19:20.355Z | req_77a3ac9252d1 | llama-4-405b | claude-haiku-4.5 | 7,426 | $1.364 | Success |
| 04:19:19.000Z | req_44fa3433efa6 | claude-opus-4.6 | claude-opus-4.6 | 12,942 | — | Success |
| 04:19:16.624Z | req_d31d69d65804 | qwen3-72b | mistral-small-3 | 10,684 | $2.377 | Fallback |
| 04:19:14.665Z | req_ce749a4ecaa8 | gemini-3.1-pro | gemini-3.1-pro | 10,744 | — | Success |
| 04:19:11.621Z | req_02b2326f7bdc | gemini-3.1-pro | gemini-3.1-pro | 9,085 | — | Cached |
| 04:19:09.711Z | req_664a53ac8fde | gemini-3.1-pro | mistral-small-3 | 4,721 | $0.645 | Success |
| 04:19:07.080Z | req_0c1b875a94cd | deepseek-v4 | deepseek-v4 | 4,133 | — | Success |
| 04:19:05.642Z | req_c5b5f0fb7445 | qwen3-72b | qwen3-72b | 7,482 | — | Success |
| 04:19:04.491Z | req_ed7c27a63fe6 | gpt-5.2-turbo | gemini-3-flash | 9,688 | $2.055 | Success |
| 04:19:02.476Z | req_6c361f339986 | gpt-5.2-turbo | qwen3-32b-fireworks | 9,340 | $0.998 | Success |
| 04:18:59.866Z | req_0e5ffc2541a8 | claude-opus-4.6 | claude-opus-4.6 | 11,988 | — | Success |
| 04:18:56.388Z | req_aa1abc0d3851 | claude-opus-4.6 | llama-4-70b-groq | 14,026 | $2.960 | Fallback |
| 04:18:53.127Z | req_13bcfde3b8d3 | gpt-5.2-turbo | qwen3-32b-fireworks | 3,742 | $0.748 | Success |
| 04:18:50.975Z | req_919e3d3f7606 | gpt-5.2-turbo | llama-4-70b-groq | 11,163 | $1.258 | Success |
| 04:18:47.880Z | req_c876fb75b494 | gpt-5.2-turbo | gpt-5.2-turbo | 5,293 | — | Success |
| 04:18:46.870Z | req_5ade3978b96f | mistral-large-3 | deepseek-v4 | 5,759 | $0.700 | Success |
| 04:18:44.962Z | req_1889f8a8ee13 | claude-opus-4.6 | claude-opus-4.6 | 12,655 | — | Success |
| 04:18:41.718Z | req_5edf72a9cf66 | qwen3-72b | qwen3-72b | 3,311 | — | Success |
| 04:18:39.217Z | req_2a407b2b3495 | llama-4-405b | llama-4-405b | 749 | — | Success |
| 04:18:38.303Z | req_ea8e9d7a79aa | gemini-3.1-pro | deepseek-v4 | 8,578 | $0.625 | Success |
| 04:18:36.582Z | req_a9f4f3f48634 | claude-haiku-4.5 | mistral-small-3 | 781 | $0.124 | Success |
| 04:18:35.291Z | req_ef695afeb5e8 | claude-opus-4.6 | qwen3-32b-fireworks | 4,483 | $0.378 | Success |
| 04:18:32.856Z | req_6d53ba0a9d96 | gpt-5.2-turbo | gemini-3-flash | 503 | $0.059 | Success |
| 04:18:31.866Z | req_2ab98aec001e | mistral-large-3 | mistral-large-3 | 14,346 | — | Success |
| 04:18:28.796Z | req_6da578f291ac | gemini-3.1-pro | mistral-small-3 | 7,110 | $1.090 | Cached |
| 04:18:26.118Z | req_5b02395af6cb | deepseek-v4 | deepseek-v4 | 2,697 | — | Cached |
| 04:18:24.039Z | req_fcfc21f07dac | qwen3-72b | mistral-small-3 | 14,388 | $2.873 | Success |
| 04:18:21.696Z | req_7c1b9fd70e08 | gpt-5.2-turbo | claude-haiku-4.5 | 6,756 | $1.146 | Success |
| 04:18:18.450Z | req_87790b0b25be | gpt-5.2-turbo | gemini-3-flash | 7,319 | $1.152 | Success |
| 04:18:15.840Z | req_7470d56480a1 | claude-opus-4.6 | qwen3-32b-fireworks | 6,812 | $1.260 | Success |
| 04:18:12.784Z | req_83d12f37897a | qwen3-72b | deepseek-v4 | 9,605 | $2.171 | Success |
| 04:18:09.906Z | req_983e8b0f9405 | claude-opus-4.6 | claude-opus-4.6 | 9,850 | — | Success |
| 04:18:08.469Z | req_c821c6dc7f22 | deepseek-v4 | claude-haiku-4.5 | 3,383 | $0.569 | Success |
| 04:18:05.882Z | req_1cbe100533f9 | deepseek-v4 | claude-haiku-4.5 | 8,885 | $0.932 | Success |
| 04:18:04.258Z | req_104b4daee51a | llama-4-405b | mistral-small-3 | 10,183 | $1.336 | Success |
| 04:18:03.105Z | req_e8717ea679b8 | deepseek-v4 | deepseek-v4 | 12,503 | $0.898 | Success |
| 04:18:00.566Z | req_5e658d9db24f | deepseek-v4 | claude-haiku-4.5 | 12,946 | $1.194 | Success |
| 04:17:58.864Z | req_ea9c47c8a88f | claude-haiku-4.5 | gemini-3-flash | 12,692 | $2.356 | Fallback |
| 04:17:57.432Z | req_104aa8f0654d | mistral-large-3 | mistral-large-3 | 1,588 | — | Success |
| 04:17:55.106Z | req_681d053b91fc | claude-opus-4.6 | llama-4-70b-groq | 12,843 | $2.457 | Success |
| 04:17:53.856Z | req_877765428488 | qwen3-72b | deepseek-v4 | 9,942 | $1.224 | Success |
| 04:17:51.478Z | req_01abfe7b2420 | gemini-3.1-pro | llama-4-70b-groq | 5,673 | $0.702 | Success |
| 04:17:48.141Z | req_acfdadd957ea | gpt-5.2-turbo | gpt-5.2-turbo | 7,672 | — | Success |
| 04:17:45.308Z | req_8de729c368f7 | qwen3-72b | llama-4-70b-groq | 12,800 | $2.563 | Cached |
| 04:17:42.557Z | req_5a32b5150937 | claude-opus-4.6 | claude-opus-4.6 | 4,722 | — | Success |
| 04:17:40.237Z | req_2284666a65e5 | claude-opus-4.6 | gemini-3-flash | 14,517 | $2.266 | Success |
| 04:17:38.462Z | req_baee39720bb4 | qwen3-72b | qwen3-72b | 615 | — | Success |
| 04:17:36.541Z | req_f2bb362a53ae | gpt-5.2-turbo | qwen3-32b-fireworks | 2,325 | $0.443 | Cached |
| 04:17:33.598Z | req_5b47dbfe6841 | llama-4-405b | claude-haiku-4.5 | 8,946 | $0.890 | Cached |
| 04:17:31.235Z | req_79e1be4b28d1 | gpt-5.2-turbo | gpt-5.2-turbo | 5,598 | — | Success |
| 04:17:27.886Z | req_bd83441aabe1 | claude-opus-4.6 | deepseek-v4 | 4,791 | $0.584 | Success |
| 04:17:25.539Z | req_02c802d7c570 | mistral-large-3 | mistral-large-3 | 4,270 | — | Success |
| 04:17:22.462Z | req_49d73eb438a9 | qwen3-72b | deepseek-v4 | 7,957 | $1.030 | Success |
Routing Policy
Applies to all edge regions instantly.
Reroute to healthy providers on 5xx or timeout.
Serve near-duplicate prompts from the vector cache.
Hard-stop requests once the org spend cap is hit.
Provider API Keys
OpenAI
sk-live-••••••••••••4f2a
Anthropic
sk-ant-••••••••••••9c17
Google Vertex
vx-••••••••••••be03
Monthly Budget
on track
$41,208
of $90,000 cap · 46% consumed