Docs
LlamaIndex integration
Point LlamaIndex's OpenAI LLM to abliteration.ai by setting api_base and api_key. OpenAI-compatible chat completions.
Updated 2026-08-04
LlamaIndex's OpenAI LLM supports OpenAI-compatible endpoints. Set api_base to the abliteration.ai base URL.
Use the standard LlamaIndex interfaces while keeping your model and prompt logic intact.
from llama_index.llms.openai import OpenAI
llm = OpenAI(
model="abliterated-model",
api_base="https://api.abliteration.ai/v1",
api_key="YOUR_ABLIT_KEY",
)
response = llm.complete("Summarize this in one sentence.")
print(response.text)