Shardio documentation

Shardio serves open models over an OpenAI-compatible API. Independently owned GPUs do the inference; you change one line of client configuration and pay per token from a prepaid balance.

Two ways in

If you are building, start with the quickstart — the integration is a base_url swap and a key. If you own a GPU and want to earn from it, start at join the mesh.

The whole integration

from openai import OpenAI

client = OpenAI(
    base_url="https://api.shardio.ai/v1",
    api_key="tsk_live_...",
)

Everything else

Start here

QuickstartSwap base_url, make your first call.ModelsEvery model, its context window and its price.

API

OpenAI compatibilityWhich parameters we forward, and which we ignore.EndpointsChat, completions, embeddings, models, rates.StreamingThe SSE contract, including how a stream can fail.ErrorsEvery error code, its cause and its fix.

Account

CreditsPrepaid balance, holds, and what happens at zero.API keysOne key per agent, because attribution needs it.

Run a node

Join the meshRequirements and the CLI that gets you serving.CertificationHow a node earns the right to serve a model.EarningsThe 0.70 share, and when it lands.