Do React hooks like useChat still work?
Yes. Configure the provider in your API route, and client-side hooks work unchanged.
SDK Migration
The Vercel AI SDK supports OpenAI-compatible providers via @ai-sdk/openai-compatible.
Your generateText, streamText, and useChat hooks work unchanged after configuration.
Switching the Vercel AI SDK base URL means configuring an OpenAI-compatible provider to route requests through an alternative endpoint.
import { createOpenAICompatible } from "@ai-sdk/openai-compatible";
import { generateText, streamText } from "ai";
// Create abliteration.ai provider
const ablit = createOpenAICompatible({
baseURL: "https://api.abliteration.ai/v1",
apiKey: process.env.ABLIT_KEY,
name: "abliteration",
});
// generateText works unchanged
const { text } = await generateText({
model: ablit.chatModel("abliterated-model"),
prompt: "Summarize this document.",
});
// streamText works unchanged
const result = await streamText({
model: ablit.chatModel("abliterated-model"),
messages: [{ role: "user", content: "Write a short story." }],
});
for await (const chunk of result.textStream) {
process.stdout.write(chunk);
}FAQ
Yes. Configure the provider in your API route, and client-side hooks work unchanged.
Yes. The OpenAI-compatible provider works in both Node.js and Edge runtimes.
Yes. Create multiple providers and select them based on your routing logic.