FAQ

Frequently Asked Questions

Do I need to change my message schema?

No. Use the same role/content message format as OpenAI Chat Completions.

Does compatibility include streaming and vision?

Yes. Streaming works with stream: true. Vision works when you use a vision-capable model and send images via the content array format.

Does it support function calling and structured output?

Yes. Send functions plus function_call for tool invocation and response_format: { type: "json_object" } for structured JSON.

Does streaming work?

Yes. Set stream: true and consume delta chunks as they arrive.

Is the base path different?

Use the /v1 base path and the /chat/completions endpoint.