FAQ

Frequently Asked Questions

Do I need to change my message format?

No. The message format is identical to OpenAI. Your existing role/content arrays work unchanged.

Does streaming work?

Yes. Set stream=True and iterate over chunks exactly like OpenAI.

Can I switch back to OpenAI later?

Yes. Remove the base_url parameter to return to the OpenAI default endpoint.