Skip to content
Menu
Base URLhttps://api.getworg.com/v1

Combos

A combo is an ordered list of lanes that you call as one model. Worg tries the lanes in your order and stops at the first one that answers.

1Build a combo in the console

Open Combos, give it a name, and add lanes in the order you want them tried. Only lanes your organization can use are offered. A combo holds up to 5 lanes, and an organization can have up to 10 combos. Names use lowercase letters, digits, dot, _ or -, up to 40 characters.

2Call it by name

Base URLhttps://api.getworg.com/v1
Modelcombo/<name>

The model field in the response names the lane that served the request. Your combos also appear in GET /v1/models.

3How the lanes are tried

  • Worg moves to the next lane when a lane fails before it sends anything: a server error, no answer within 60 seconds, or the lane is busy or refusing requests.
  • A server error or a dropped connection before anything arrives is tried once more on the same lane, then the next lane.
  • An error about your request itself, such as a bad parameter, comes back to you as it is. The next lane is not tried.
  • Once the first chunk of a stream reaches you, the request stays on that lane.
  • A lane that failed three times in a row is tried last for the next 30 seconds, still within your list.
  • When every lane fails, the answer is 429 capacity_busy if a lane was busy, otherwise 502 upstream_unavailable.

4How it is billed

Each request is billed at the rate of the lane that served it. Before sending, Worg sets aside the cost for the most expensive lane in the combo, then charges only what the serving lane used. Usage shows the combo name and the serving lane side by side.

Next: Errors and retriesModels and compatibility