T/TTokens or Towers
PlannerCatalogScanPricesBenchmarksHarnessesHosts
SITEMAP.XML · checked August 4, 2026
Tokens or Towers prototypeEvery recommendation shows its work.

Hosts directory

Everywhere a model can answer you.

A sourced directory of the places models run. First-party provider APIs sit here beside dedicated inference hosts and gateways that route across backends. When a host exposes an OpenAI-compatible surface, harnesses that speak that protocol can point at it the way they point at hardware you own.

Open the planner →

Rows were last checked on 2026-08-05. Catalogs and API shapes move; confirm pricing and endpoint support against each operator’s current docs before you wire anything up.

Filters

Narrow the host set.

33 of 33 hosts

The OpenAI-compatible marker is what lets a harness treat a host like a local endpoint. See which tools speak that protocol in the harness directory.

Kind
Serves open weights
OpenAI-compatible
  • OpenAI API

    OpenAI

    First-party

    OpenAI-compatible API

    Links
    Site ↗Pricing ↗
    Checked
    2026-08-05

    First-party Chat Completions and Responses APIs for OpenAI models.

  • Anthropic API

    Anthropic

    First-party
    • First-party catalog only
    Links
    Site ↗Pricing ↗
    Checked
    2026-08-05

    Messages API is the native surface. An OpenAI-compatible shim exists in some SDKs; confirm against current Anthropic docs before relying on it.

  • Google Gemini API

    Google

    First-party

    OpenAI-compatible API

    Links
    Site ↗Pricing ↗
    Checked
    2026-08-05

    Gemini Developer API with an OpenAI-compatible endpoint option.

  • Google Vertex AI

    Google Cloud

    First-party

    OpenAI-compatible API

    • Serves open weights
    Links
    Site ↗Pricing ↗
    Checked
    2026-08-05

    Enterprise Gemini plus Model Garden open models. Catalog is Google-managed; arbitrary self-upload is outside what we mark as BYO here.

  • xAI API

    xAI

    First-party

    OpenAI-compatible API

    Links
    Site ↗Pricing ↗
    Checked
    2026-08-05

    Grok models behind an OpenAI-compatible chat completions surface.

  • DeepSeek API

    DeepSeek

    First-party

    OpenAI-compatible API

    Links
    Site ↗Pricing ↗
    Checked
    2026-08-05

    Hosted DeepSeek models. Open-weight checkpoints are published separately for self-hosting; this row covers the first-party API only.

  • Moonshot AI

    Moonshot AI

    First-party

    OpenAI-compatible API

    Links
    Site ↗Pricing ↗
    Checked
    2026-08-05

    Kimi models via an OpenAI-compatible platform API.

  • Alibaba Model Studio

    Alibaba Cloud

    First-party

    OpenAI-compatible API

    • Serves open weights
    Links
    Site ↗Pricing ↗
    Checked
    2026-08-05

    Qwen and related Model Studio models, including open-weight Qwen variants in the catalog.

  • Z.ai

    Zhipu AI

    First-party

    OpenAI-compatible API

    Links
    Site ↗Pricing ↗
    Checked
    2026-08-05

    GLM models on the Z.ai platform with an OpenAI-compatible API path.

  • Mistral AI

    Mistral AI

    First-party

    OpenAI-compatible API

    • Serves open weights
    Links
    Site ↗Pricing ↗
    Checked
    2026-08-05

    La Plateforme serves Mistral open and commercial models through an OpenAI-compatible API.

  • Amazon Bedrock

    Amazon Web Services

    First-party
    • Serves open weights
    Links
    Site ↗Pricing ↗
    Checked
    2026-08-05

    Multi-provider catalog on AWS. Native Bedrock APIs are the documented path; OpenAI-compatible access is not counted as first-class here.

  • Cohere API

    Cohere

    First-party
    • First-party catalog only
    Links
    Site ↗Pricing ↗
    Checked
    2026-08-05

    Command and Embed models on Cohere’s native API surface.

  • MiniMax

    MiniMax

    First-party

    OpenAI-compatible API

    Links
    Site ↗Pricing ↗
    Checked
    2026-08-05

    MiniMax text and speech models. Confirm current OpenAI-compatible path in their platform docs.

  • ByteDance ModelArk

    ByteDance / Volcengine

    First-party

    OpenAI-compatible API

    Links
    Site ↗Pricing ↗
    Checked
    2026-08-05

    Volcengine ModelArk hosts Doubao and related ByteDance models. Pricing pages are region-specific; confirm on the console you use.

  • Baidu Qianfan

    Baidu

    First-party

    OpenAI-compatible API

    • Serves open weights
    Links
    Site ↗Pricing ↗
    Checked
    2026-08-05

    Qianfan platform for ERNIE and selected open models. Capability marks are conservative pending console verification.

  • Thinking Machines Tinker

    Thinking Machines Lab

    First-party
    • Serves open weights
    Links
    Site ↗Pricing ↗
    Checked
    2026-08-05

    Tinker is positioned for fine-tuning and sampling open models. Pricing and OpenAI-compatibility were not clear from public pages at check time, so both marks stay conservative.

  • NVIDIA NIM

    NVIDIA

    First-party

    OpenAI-compatible API

    • Serves open weights
    Links
    Site ↗Pricing ↗
    Checked
    2026-08-05

    Microservice containers and hosted endpoints for NVIDIA-optimized and partner open models.

  • Cerebras Inference

    Cerebras

    Host

    OpenAI-compatible API

    • Serves open weights

    Positions on wafer-scale chips for very high tokens-per-second on supported models.

    Links
    Site ↗Pricing ↗
    Checked
    2026-08-05

    Catalog of open models on Cerebras hardware. BYO custom weights are outside the public inference product as checked.

  • GroqCloud

    Groq

    Host

    OpenAI-compatible API

    • Serves open weights

    LPU inference marketed for low latency on a fixed open-model catalog.

    Links
    Site ↗Pricing ↗
    Checked
    2026-08-05

    OpenAI-compatible chat and audio endpoints for Groq’s hosted model list.

  • Together AI

    Together AI

    Host

    OpenAI-compatible API

    • Serves open weights
    • Bring your own model
    Links
    Site ↗Pricing ↗
    Checked
    2026-08-05

    Serverless open-model inference plus dedicated endpoints and fine-tuning.

  • Fireworks AI

    Fireworks AI

    Host

    OpenAI-compatible API

    • Serves open weights
    • Bring your own model
    Links
    Site ↗Pricing ↗
    Checked
    2026-08-05

    Fast open-model inference with deployment options for custom fine-tunes.

  • DeepInfra

    DeepInfra

    Host

    OpenAI-compatible API

    • Serves open weights
    • Bring your own model
    Links
    Site ↗Pricing ↗
    Checked
    2026-08-05

    Broad open-model catalog with OpenAI-compatible and native HTTP APIs.

  • Baseten

    Baseten

    Host

    OpenAI-compatible API

    • Serves open weights
    • Bring your own model
    Links
    Site ↗Pricing ↗
    Checked
    2026-08-05

    Model deployment platform; OpenAI-compatible wrappers are common on deployed Truss apps.

  • Nebius Token Factory

    Nebius

    Host

    OpenAI-compatible API

    • Serves open weights
    Links
    Site ↗Pricing ↗
    Checked
    2026-08-05

    Open-model serving on Nebius cloud. Custom weight upload was not clearly documented at check time.

  • Lambda Inference

    Lambda

    Host

    OpenAI-compatible API

    • Serves open weights
    Links
    Site ↗Pricing ↗
    Checked
    2026-08-05

    Inference API alongside Lambda GPU cloud. Catalog coverage changes; confirm the live model list.

  • Novita AI

    Novita AI

    Host

    OpenAI-compatible API

    • Serves open weights
    • Bring your own model
    Links
    Site ↗Pricing ↗
    Checked
    2026-08-05

    Open-model serverless API with GPU deployment options.

  • Hyperbolic

    Hyperbolic

    Host

    OpenAI-compatible API

    • Serves open weights
    Links
    Site ↗Pricing ↗
    Checked
    2026-08-05

    Open-model inference API. BYO custom weights were not clearly offered on the public API at check time.

  • Replicate

    Replicate

    Host

    OpenAI-compatible API

    • Serves open weights
    • Bring your own model
    Links
    Site ↗Pricing ↗
    Checked
    2026-08-05

    Strong on image, video, and audio models alongside LLMs. OpenAI-compatible HTTP is available for a subset of language models.

  • OpenRouter

    OpenRouter

    Gateway

    OpenAI-compatible API

    • Serves open weights
    Links
    Site ↗Pricing ↗
    Checked
    2026-08-05

    One OpenAI-compatible key across many provider backends and open-model hosts.

  • Vercel AI Gateway

    Vercel

    Gateway

    OpenAI-compatible API

    • Serves open weights
    Links
    Site ↗Pricing ↗
    Checked
    2026-08-05

    Routes through Vercel’s AI Gateway to multiple providers with shared observability.

  • LiteLLM

    BerriAI

    Gateway

    OpenAI-compatible API

    • Serves open weights
    • Bring your own model
    Links
    Site ↗Pricing ↗
    Checked
    2026-08-05

    Self-hosted (or proxied) gateway that translates one OpenAI-compatible surface onto many providers. You run the proxy; usage cost is whatever backends you attach.

  • Cloudflare AI Gateway

    Cloudflare

    Gateway

    OpenAI-compatible API

    • Serves open weights
    Links
    Site ↗Pricing ↗
    Checked
    2026-08-05

    Proxy layer in front of provider APIs for caching, logging, and rate controls.

  • Portkey

    Portkey

    Gateway

    OpenAI-compatible API

    • Serves open weights
    • Bring your own model
    Links
    Site ↗Pricing ↗
    Checked
    2026-08-05

    AI gateway with routing, guardrails, and an OpenAI-compatible control plane.