Provider | Context Size | Throughput | Latency | Input Cost | Output Cost |
|---|---|---|---|---|---|
Usage
Generate your API key and query the model through the OpenAI-compatible interface. The preference parameter allows you to define the routing strategy. For more details, see the documentation.