Skip to contentT/TTokens or Towers

Compare

LeaderboardEvery tracked model, ranked and priced side by sideBenchmarksWhat each test measures and who leads itPricesAPI, media, and hardware rates with a cost calculator

Plan

Stack plannerSix questions to a priced local and hosted stackShortlistOur picks for subscriptions, APIs, and hardwareEnterpriseSeat plans against self-hosting for a whole team

Build

HardwareGPUs and workstations, and which models they fitHostsWhere to rent open-weight inference, and for how muchHarnessesCoding agents and the models they drive

Lab

FindingsResults from our own evaluationsScanAudit a repo’s AI usage in the browserMethodWhere the numbers come from and how we check them
Data checked September 25, 2026
Data checked September 25, 2026
Plan a stack
T/TTokens or Towers

An independent guide to AI models, what they cost, and the hardware to run them. No account, no API key, no sponsors.

Compare

  • Leaderboard
  • Benchmarks
  • Prices

Plan

  • Stack planner
  • Shortlist
  • Enterprise

Build

  • Hardware
  • Hosts
  • Harnesses

Lab

  • Findings
  • Scan
  • Method
Data checked September 25, 2026 · Every number links to its sourceRSS · Source on GitHub

Hosts

Everywhere a model can answer you.

First-party APIs, inference clouds that serve open models, and gateways that route across them. Each row shows what it serves, what it charges, and whether it speaks the OpenAI API, which lets any harness point at it the way it points at hardware you own.

Open the planner →

Rows were last checked on 2026-09-25. Catalogs and API shapes move; confirm pricing and endpoint support against each operator’s current docs before you wire anything up.

Filters

Narrow the host set.

35 of 35 hosts

The OpenAI-compatible marker is what lets a harness treat a host like a local endpoint. See which tools speak that protocol in the harness directory.

Kind
Serves open weights
OpenAI-compatible
  • OpenAI API

    OpenAI

    First-party

    OpenAI-compatible API

    Links
    Site ↗Pricing ↗
    Checked
    2026-09-25

    First-party Chat Completions and Responses APIs for OpenAI models.

  • Anthropic API

    Anthropic

    First-party
    • First-party catalog only
    Links
    Site ↗Pricing ↗
    Checked
    2026-09-25

    Messages API is the native surface. Anthropic documents an OpenAI SDK compatibility layer at api.anthropic.com/v1 for testing and comparison, but says it is not a long-term or production-ready path (no prompt caching, strict tool schemas ignored).

  • Google Gemini API

    Google

    First-party

    OpenAI-compatible API

    Links
    Site ↗Pricing ↗
    Checked
    2026-09-25

    Gemini Developer API with an OpenAI-compatible endpoint option.

  • Gemini Enterprise Agent Platform (formerly Vertex AI)

    Google Cloud

    First-party

    OpenAI-compatible API

    • Serves open weights
    Links
    Site ↗Pricing ↗
    Checked
    2026-09-25

    Google Cloud’s enterprise platform formerly called Vertex AI: Gemini, partner models such as Claude, and Model Garden open models. Catalog is Google-managed; arbitrary self-upload is outside what we mark as BYO here.

  • Microsoft Foundry

    Microsoft Azure

    First-party

    OpenAI-compatible API

    • Serves open weights
    Links
    Site ↗Pricing ↗
    Checked
    2026-09-25

    Formerly Azure AI Foundry. Azure-hosted OpenAI models plus directly sold DeepSeek, Kimi, Grok, Llama, Mistral, and gpt-oss models behind Chat Completions and Responses APIs. Managed-compute deployment of catalog models exists; arbitrary custom-weight upload is not counted as BYO here.

  • xAI API

    xAI

    First-party

    OpenAI-compatible API

    Links
    Site ↗Pricing ↗
    Checked
    2026-09-25

    Grok models behind an OpenAI-compatible chat completions surface.

  • DeepSeek API

    DeepSeek

    First-party

    OpenAI-compatible API

    Links
    Site ↗Pricing ↗
    Checked
    2026-09-25

    Hosted DeepSeek models. Open-weight checkpoints are published separately for self-hosting; this row covers the first-party API only.

  • Moonshot AI

    Moonshot AI

    First-party

    OpenAI-compatible API

    Links
    Site ↗Pricing ↗
    Checked
    2026-09-25

    Kimi models via an OpenAI-compatible platform API. The platform moved from platform.moonshot.ai to platform.kimi.ai.

  • Alibaba Model Studio

    Alibaba Cloud

    First-party

    OpenAI-compatible API

    • Serves open weights
    Links
    Site ↗Pricing ↗
    Checked
    2026-09-25

    Qwen and related Model Studio models, including open-weight Qwen variants in the catalog.

  • Z.ai

    Zhipu AI

    First-party

    OpenAI-compatible API

    Links
    Site ↗Pricing ↗
    Checked
    2026-09-25

    GLM models on the Z.ai platform with an OpenAI-compatible API (base URL api.z.ai/api/paas/v4).

  • Mistral AI

    Mistral AI

    First-party

    OpenAI-compatible API

    • Serves open weights
    Links
    Site ↗Pricing ↗
    Checked
    2026-09-25

    Mistral open and commercial models through an OpenAI-compatible API, managed from Mistral Studio.

  • Amazon Bedrock

    Amazon Web Services

    First-party

    OpenAI-compatible API

    • Serves open weights
    Links
    Site ↗Pricing ↗
    Checked
    2026-09-25

    Multi-provider catalog on AWS. Native Bedrock APIs plus OpenAI Chat Completions/Responses and Anthropic Messages-compatible endpoints (bedrock-runtime and bedrock-mantle). Open-weight catalog tends to trail specialist hosts by a version or two.

  • Cohere API

    Cohere

    First-party

    OpenAI-compatible API

    Links
    Site ↗Pricing ↗
    Checked
    2026-09-25

    Command and Embed models on Cohere’s native API, plus an OpenAI-compatible Compatibility API at api.cohere.ai/compatibility/v1.

  • MiniMax

    MiniMax

    First-party

    OpenAI-compatible API

    Links
    Site ↗Pricing ↗
    Checked
    2026-09-25

    MiniMax text and speech models on the MiniMax platform API. Pay-as-you-go pricing moved into the platform docs.

  • ByteDance ModelArk

    ByteDance / Volcengine

    First-party

    OpenAI-compatible API

    Links
    Site ↗Pricing ↗
    Checked
    2026-09-25

    Volcengine ModelArk hosts Doubao and related ByteDance models, with an OpenAI SDK-compatible endpoint. Pricing is in CNY for the China region; international customers use BytePlus ModelArk.

  • Baidu Qianfan

    Baidu

    First-party

    OpenAI-compatible API

    • Serves open weights
    Links
    Site ↗Pricing ↗
    Checked
    2026-09-25

    Qianfan platform for ERNIE plus open models such as DeepSeek and Qwen, with an OpenAI-compatible API at qianfan.baidubce.com/v2.

  • Thinking Machines Tinker

    Thinking Machines Lab

    First-party

    OpenAI-compatible API

    • Serves open weights
    Links
    Site ↗Pricing ↗
    Checked
    2026-09-25

    Tinker is a fine-tuning (LoRA) and sampling API over open models plus Thinking Machines’ own Inkling models. Serverless inference for Inkling and Inkling-Small is in beta, with OpenAI- and Anthropic-compatible API docs. Prices are per million tokens, split by prefill, sample, and train.

  • NVIDIA NIM

    NVIDIA

    First-party

    OpenAI-compatible API

    • Serves open weights
    Links
    Site ↗Pricing ↗
    Checked
    2026-09-25

    Microservice containers and hosted endpoints for NVIDIA-optimized and partner open models. Hosted endpoints are free for prototyping via the NVIDIA Developer Program; production self-hosting needs NVIDIA AI Enterprise (from $4,500 per GPU per year).

  • Cerebras Inference

    Cerebras

    Host

    OpenAI-compatible API

    • Serves open weights

    Positions on wafer-scale chips for very high tokens-per-second on supported models.

    Links
    Site ↗Pricing ↗
    Checked
    2026-09-25

    Public pay-as-you-go catalog is down to two open models, GPT OSS 120B and Qwen 3.8 27B, on Cerebras hardware. BYO custom weights are outside the public inference product as checked.

  • GroqCloud

    Groq

    Host

    OpenAI-compatible API

    • Serves open weights

    LPU inference marketed for low latency on a fixed open-model catalog.

    Links
    Site ↗Pricing ↗
    Checked
    2026-09-25

    OpenAI-compatible chat and audio endpoints for Groq’s hosted model list. Llama 3.1 8B and Llama 3.3 70B are still served but now priced through sales; Qwen 3.8 27B (preview) replaced Qwen 3.6 27B.

  • SambaNova Cloud

    SambaNova

    Host

    OpenAI-compatible API

    • Serves open weights
    • Bring your own model

    Custom dataflow (RDU) chips marketed for high tokens-per-second on large open models.

    Links
    Site ↗Pricing ↗
    Checked
    2026-09-25

    Small catalog of open models (MiniMax M3 and M2.7, DeepSeek V3.x, gpt-oss-120b, Gemma 4 31B, Llama 3.3 70B) on SambaNova hardware. Docs describe running inference on your own fine-tuned checkpoints.

  • Together AI

    Together AI

    Host

    OpenAI-compatible API

    • Serves open weights
    • Bring your own model
    Links
    Site ↗Pricing ↗
    Checked
    2026-09-25

    Serverless open-model inference plus dedicated endpoints and fine-tuning. Serverless list now includes Kimi K3, Qwen3.8-2.4T-A95B, and DeepSeek V4 Pro 0813; Nemotron 3 Ultra is no longer offered.

  • Fireworks AI

    Fireworks AI

    Host

    OpenAI-compatible API

    • Serves open weights
    • Bring your own model
    Links
    Site ↗Pricing ↗
    Checked
    2026-09-25

    Fast open-model inference with deployment options for custom fine-tunes. Every serverless model also has a pricier Priority mode, and US-only serverless models cost 1.5x base since September 1, 2026.

  • DeepInfra

    DeepInfra

    Host

    OpenAI-compatible API

    • Serves open weights
    • Bring your own model
    Links
    Site ↗Pricing ↗
    Checked
    2026-09-25

    Broad open-model catalog with OpenAI-compatible and native HTTP APIs.

  • Baseten

    Baseten

    Host

    OpenAI-compatible API

    • Serves open weights
    • Bring your own model
    Links
    Site ↗Pricing ↗
    Checked
    2026-09-25

    Model deployment platform; OpenAI-compatible wrappers are common on deployed Truss apps.

  • Nebius Token Factory

    Nebius

    Host

    OpenAI-compatible API

    • Serves open weights
    Links
    Site ↗Pricing ↗
    Checked
    2026-09-25

    Open-model serverless and dedicated endpoints on Nebius cloud with an OpenAI-compatible API. Custom model weights on dedicated endpoints are in beta and available on request.

  • Novita AI

    Novita AI

    Host

    OpenAI-compatible API

    • Serves open weights
    • Bring your own model
    Links
    Site ↗Pricing ↗
    Checked
    2026-09-25

    Open-model serverless API with GPU deployment options.

  • Replicate

    Replicate (Cloudflare)

    Host

    OpenAI-compatible API

    • Serves open weights
    • Bring your own model
    Links
    Site ↗Pricing ↗
    Checked
    2026-09-25

    Strong on image, video, and audio models alongside LLMs; Replicate is now part of Cloudflare and its catalog is being integrated into Workers AI. OpenAI-compatible HTTP is available for a subset of language models.

  • Cloudflare Workers AI

    Cloudflare

    Host

    OpenAI-compatible API

    • Serves open weights
    Links
    Site ↗Pricing ↗
    Checked
    2026-09-25

    Serverless open-model inference on Cloudflare’s network, billed in Neurons ($0.011 per 1,000; 10,000 free per day) with per-token equivalents published. Cloudflare plans to add Replicate’s catalog and custom-model support.

  • OpenRouter

    OpenRouter

    Gateway

    OpenAI-compatible API

    • Serves open weights
    Links
    Site ↗Pricing ↗
    Checked
    2026-09-25

    One OpenAI-compatible key across many provider backends and open-model hosts. Model prices pass through at provider rates; credit purchases carry a 5.5% fee, and BYOK is free up to $25K/month of usage, then 5%.

  • Hugging Face Inference Providers

    Hugging Face

    Gateway

    OpenAI-compatible API

    • Serves open weights
    Links
    Site ↗Pricing ↗
    Checked
    2026-09-25

    One Hugging Face token routed across partner hosts such as Groq, Cerebras, Together, Fireworks, and Novita. OpenAI-compatible chat endpoint with :fastest and :cheapest provider policies, no markup on provider rates, and a small free monthly credit.

  • Vercel AI Gateway

    Vercel

    Gateway

    OpenAI-compatible API

    • Serves open weights
    Links
    Site ↗Pricing ↗
    Checked
    2026-09-25

    Routes through Vercel’s AI Gateway to multiple providers at provider list price with no token markup (including BYOK), plus shared observability. Some team-wide add-ons (allowlist, ZDR, reporting) bill extra.

  • LiteLLM

    BerriAI

    Gateway

    OpenAI-compatible API

    • Serves open weights
    • Bring your own model
    Links
    Site ↗Pricing ↗
    Checked
    2026-09-25

    Self-hosted (or proxied) gateway that translates one OpenAI-compatible surface onto many providers. You run the proxy; usage cost is whatever backends you attach.

  • Cloudflare AI Gateway

    Cloudflare

    Gateway

    OpenAI-compatible API

    • Serves open weights
    Links
    Site ↗Pricing ↗
    Checked
    2026-09-25

    Proxy layer in front of provider APIs for caching, logging, and rate controls. Core features are free; optional Unified Billing adds a 5% fee on credit purchases.

  • Portkey (Prisma AIRS AI Gateway)

    Palo Alto Networks

    Gateway

    OpenAI-compatible API

    • Serves open weights
    • Bring your own model
    Links
    Site ↗Pricing ↗
    Checked
    2026-09-25

    AI gateway with routing, guardrails, and an OpenAI-compatible control plane. Acquired by Palo Alto Networks (closed May 29, 2026) and being folded into Prisma AIRS; the free Developer and $49/month Production plans are still listed.