Docs
Compatibility Matrix
See which popular SDKs and frameworks are plug-and-play with abliteration.ai.
Each row links to a dedicated integration guide with copy-paste code.
Quick start
Base URL
Example request
# Base URL for OpenAI-compatible SDKs https://api.abliteration.ai/v1
Service notes
- Pricing model: Usage-based pricing (~$5 per 1M tokens) billed on total tokens (input + output). See the API pricing page for current plans.
- Data retention: No prompt/output retention by default. Operational telemetry (token counts, timestamps, error codes) is retained for billing and reliability.
- Compatibility: OpenAI-style /v1/chat/completions request and response format with a base URL switch.
- Latency: Depends on model size, prompt length, and load. Streaming reduces time-to-first-token.
- Throughput: Team plans include priority throughput. Actual throughput varies with demand.
- Rate limits: Limits vary by plan and load. Handle 429s with backoff and respect any Retry-After header.
Compatibility Matrix
OpenAI-style /v1/chat/completions means you can keep your SDKs and swap the base URL.
| SDK / Framework | Status |
|---|---|
| OpenAI Python SDK | ✅ |
| OpenAI Node SDK | ✅ |
| LangChain (Python/JS) | ✅ |
| Vercel AI SDK | ✅ |
| LlamaIndex | ✅ |
Need another integration? Start from the OpenAI compatibility guide and swap the base URL.
Common errors & fixes
- 401 Unauthorized: Check that your API key is set and sent as a Bearer token.
- 404 Not Found: Make sure the base URL ends with /v1 and you call /chat/completions.
- 400 Bad Request: Verify the model id and that messages are an array of { role, content } objects.
- 429 Rate limit: Back off and retry. Use the Retry-After header for pacing.