1. Create an API key
Create or sign in to your IteraCompute account, then create a key in the Console.
Route requests through one interface.
Create or sign in to your IteraCompute account, then create a key in the Console.
Set api_base and use openai/ before the API Model ID. This prefix is LiteLLM routing metadata.
Use the exact API Model ID for your chosen model. Check its context and capabilities before enabling agent or vision features.
Keep API keys in your server environment or tool credential store. Replace the example key field with your own key where applicable.
import os
from litellm import completion
response = completion(
model="openai/Auto",
api_base="https://api.iteracompute.com/v1",
api_key=os.environ["ITERACOMPUTE_API_KEY"],
messages=[{"role": "user", "content": "Hello!"}],
max_tokens=512,
)
print(response.choices[0].message.content)model_list:
- model_name: itera-model
litellm_params:
model: openai/Auto
api_base: https://api.iteracompute.com/v1
api_key: os.environ/ITERACOMPUTE_API_KEY# Bash / zsh / WSL; set ITERACOMPUTE_API_KEY in your environment first.
curl --fail-with-body https://api.iteracompute.com/v1/chat/completions \
-H "Authorization: Bearer $ITERACOMPUTE_API_KEY" \
-H "Content-Type: application/json" \
-d '{"model":"Auto","messages":[{"role":"user","content":"Reply with exactly: Hello!"}],"max_tokens":512}'Check that choices[0].message.content contains visible text; HTTP 200 alone is insufficient. Reasoning may consume the output budget. For free Auto, use the first free call example to disable thinking, then send a prompt inside your tool.
Capabilities describe the IteraCompute API. Feature availability in your workflow also depends on the tool and its settings; reasoning controls vary by model.
Use openai/Auto for LiteLLM routing and api_base=https://api.iteracompute.com/v1. The openai/ prefix is routing metadata, not part of the API model ID.
The client calls model_name from your proxy configuration; litellm_params.model contains the target API model ID. Check which name you are sending.
Set the key in the LiteLLM process, including the proxy process when used. Confirm choices[0].message.content has text before testing routing or fallback policies.
Check account-wide monthly usage and concurrency. Honor Retry-After and avoid parallel retries. Free Auto has no automatic paid overage; other models use their published prices.
401 / 403: check the key and model permission. Free Auto requires no balance or card. For paid models, also check available balance.
Connect your key, choose a model and send your first request.