Continuous inference provider benchmarks

Updated Trailing 72 hours

Provider comparison

Continuous inference provider benchmarks provider routes · All regions · trailing 72 hours
Experiential Labsvia dealignai DeepSeek V4.1 Flash 1017 uncensoredUnknown1,000,000 $0.394$0.225$0.900 243.40.62.7 100.0%32 / 32 requests ok07 Nov 2026, 18:05 UTC
NanoGPT → Heabsy DeepSeek V4.1 Flash 1017 uncensoredUnknown1,000,000 $0.610$0.350$1.390 227.41.33.7 62.5%20 / 32 requests failing07 Nov 2026, 18:14 UTC
NanoGPT → OrcaRouter DeepSeek V4.1 Flash 1017 uncensoredUnknown1,000,000 $1.050$0.840$1.680 158.01.44.9 100.0%32 / 32 requests ok07 Nov 2026, 18:14 UTC
NanoGPT → Sable DeepSeek V4.1 Flash 1017 hereticNATIVE512,000 $0.303$0.173$0.693 135.81.55.3 100.0%32 / 32 requests ok07 Nov 2026, 18:14 UTC
OpenRoutervia morph/fp8 DeepSeek V4.1 Flash 1017 noneFP81,048,576 $0.117$0.022$0.400 119.40.85.5 100.0%32 / 32 requests ok07 Nov 2026, 18:11 UTC
Venice DeepSeek V4.1 Flash 1017 uncensoredUnknown1,000,000 $0.578$0.330$1.320 190.70.63.2 100.0%32 / 32 requests ok07 Nov 2026, 18:10 UTC

p50 = median. Missing speed or latency values mean fewer than 8 usable successes. Success rate includes failed requests. Status and last success describe the route across all regions. Precision and context are provider declarations; different modifications are different products. Measurement details →

Output speed

tok/s · Higher is better · p50

Output speed, tok/s; higher is better0.068.1136.3204.4272.6Experiential Labs · deali…Experiential Labs · dealignai: 243.4 tok/s243.4NanoGPT → HeabsyNanoGPT → Heabsy: 227.4 tok/s227.4VeniceVenice: 190.7 tok/s190.7NanoGPT → OrcaRouterNanoGPT → OrcaRouter: 158.0 tok/s158.0NanoGPT → SableNanoGPT → Sable: 135.8 tok/s135.8OpenRouter · morph/fp8OpenRouter · morph/fp8: 119.4 tok/s119.4
Output speed, tok/s; higher is better0.068.1136.3204.4272.6Experiential Lab…Experiential Labs · dealignai: 243.4 tok/s243.4NanoGPT → HeabsyNanoGPT → Heabsy: 227.4 tok/s227.4VeniceVenice: 190.7 tok/s190.7NanoGPT → OrcaRo…NanoGPT → OrcaRouter: 158.0 tok/s158.0NanoGPT → SableNanoGPT → Sable: 135.8 tok/s135.8OpenRouter · mor…OpenRouter · morph/fp8: 119.4 tok/s119.4

Reported completion tokens after the first chunk, divided by streaming time. Samples without reported usage are excluded. Methodology ↗

Time to first token

s · Lower is better · p50

Time to first token, s; lower is better0.00.40.81.31.7VeniceVenice: 0.6 s0.6Experiential Labs · deali…Experiential Labs · dealignai: 0.6 s0.6OpenRouter · morph/fp8OpenRouter · morph/fp8: 0.8 s0.8NanoGPT → HeabsyNanoGPT → Heabsy: 1.3 s1.3NanoGPT → OrcaRouterNanoGPT → OrcaRouter: 1.4 s1.4NanoGPT → SableNanoGPT → Sable: 1.5 s1.5
Time to first token, s; lower is better0.00.40.81.31.7VeniceVenice: 0.6 s0.6Experiential Lab…Experiential Labs · dealignai: 0.6 s0.6OpenRouter · mor…OpenRouter · morph/fp8: 0.8 s0.8NanoGPT → HeabsyNanoGPT → Heabsy: 1.3 s1.3NanoGPT → OrcaRo…NanoGPT → OrcaRouter: 1.4 s1.4NanoGPT → SableNanoGPT → Sable: 1.5 s1.5

Request sent to first non-empty content, reasoning or tool-argument delta. Includes network time from the selected region. Methodology ↗

Time to 500 tokens

s · Lower is better · p50

Time to 500 tokens, s; lower is better0.01.53.14.66.1Experiential Labs · deali…Experiential Labs · dealignai: 2.7 s2.7VeniceVenice: 3.2 s3.2NanoGPT → HeabsyNanoGPT → Heabsy: 3.7 s3.7NanoGPT → OrcaRouterNanoGPT → OrcaRouter: 4.9 s4.9NanoGPT → SableNanoGPT → Sable: 5.3 s5.3OpenRouter · morph/fp8OpenRouter · morph/fp8: 5.5 s5.5
Time to 500 tokens, s; lower is better0.01.53.14.66.1Experiential Lab…Experiential Labs · dealignai: 2.7 s2.7VeniceVenice: 3.2 s3.2NanoGPT → HeabsyNanoGPT → Heabsy: 3.7 s3.7NanoGPT → OrcaRo…NanoGPT → OrcaRouter: 4.9 s4.9NanoGPT → SableNanoGPT → Sable: 5.3 s5.3OpenRouter · mor…OpenRouter · morph/fp8: 5.5 s5.5

Per request: TTFT + 500 ÷ output tok/s. Percentiles are computed after this calculation; this is a derived response time. Methodology ↗

Blended price

$ / 1M tokens · Lower is better

Blended price, $ / 1M tokens; lower is better0.000.290.590.881.18OpenRouter · morph/fp8OpenRouter · morph/fp8: 0.117 $ / 1M tokens0.117NanoGPT → SableNanoGPT → Sable: 0.303 $ / 1M tokens0.303Experiential Labs · deali…Experiential Labs · dealignai: 0.394 $ / 1M tokens0.394VeniceVenice: 0.578 $ / 1M tokens0.578NanoGPT → HeabsyNanoGPT → Heabsy: 0.610 $ / 1M tokens0.610NanoGPT → OrcaRouterNanoGPT → OrcaRouter: 1.050 $ / 1M tokens1.050
Blended price, $ / 1M tokens; lower is better0.000.290.590.881.18OpenRouter · mor…OpenRouter · morph/fp8: 0.117 $ / 1M tokens0.117NanoGPT → SableNanoGPT → Sable: 0.303 $ / 1M tokens0.303Experiential Lab…Experiential Labs · dealignai: 0.394 $ / 1M tokens0.394VeniceVenice: 0.578 $ / 1M tokens0.578NanoGPT → HeabsyNanoGPT → Heabsy: 0.610 $ / 1M tokens0.610NanoGPT → OrcaRo…NanoGPT → OrcaRouter: 1.050 $ / 1M tokens1.050

Declared price: (3 × input + output) ÷ 4. Excludes cache discounts. Prices are not measured billing receipts. Methodology ↗

Output speed vs. price

Median output speed and declared blended price

Output speed versus blended price. Upper left is faster and cheaper. Shading divides each axis at its midpoint.Faster · cheaper0.0000.30700.601400.912101.21280Blended price ($ / 1M tokens) →Output speed (tok/s) →Experiential Labs · dealignai: $0.394 / 1M tokens; 243.4 tok/sNanoGPT → Heabsy: $0.610 / 1M tokens; 227.4 tok/sNanoGPT → OrcaRouter: $1.050 / 1M tokens; 158.0 tok/sNanoGPT → Sable: $0.303 / 1M tokens; 135.8 tok/sOpenRouter · morph/fp8: $0.117 / 1M tokens; 119.4 tok/sVenice: $0.578 / 1M tokens; 190.7 tok/s
Output speed versus blended price. Upper left is faster and cheaper. Shading divides each axis at its midpoint.Faster · cheaper0.0000.30700.601400.912101.21280Blended price ($ / 1M tokens) →Output speed (tok/s) →Experiential Labs · dealignai: $0.394 / 1M tokens; 243.4 tok/sNanoGPT → Heabsy: $0.610 / 1M tokens; 227.4 tok/sNanoGPT → OrcaRouter: $1.050 / 1M tokens; 158.0 tok/sNanoGPT → Sable: $0.303 / 1M tokens; 135.8 tok/sOpenRouter · morph/fp8: $0.117 / 1M tokens; 119.4 tok/sVenice: $0.578 / 1M tokens; 190.7 tok/s
  • Experiential Labs · dealignai
  • NanoGPT → Heabsy
  • NanoGPT → OrcaRouter
  • NanoGPT → Sable
  • OpenRouter · morph/fp8
  • Venice

Each point is one route. Shading divides the displayed axes at their midpoints; it is not a quality rating. Blended price uses a 3:1 input/output mix. Routes without usable speed samples are omitted. Methodology ↗

Further reading