Switch LangChain to abliteration.ai

Definition of Switch LangChain to abliteration.ai

Switching LangChain's base URL means configuring ChatOpenAI to route requests through an alternative OpenAI-compatible provider.

Why Switch LangChain to abliteration.ai matters

• Keep your existing LangChain chains and agents unchanged.
• No code changes to prompts, memory, or tool definitions.
• Test alternative models without rebuilding your application.
• Works with LangChain Expression Language (LCEL) and LangGraph.

How it works

• Install <code>langchain-openai</code> if not already installed.
• Set <code>base_url="https://api.abliteration.ai/v1"</code> in ChatOpenAI.
• Replace your OpenAI key with your abliteration.ai API key.
• Use a supported model id like <code>abliterated-model</code>.

LangChain base URL switch

from langchain_openai import ChatOpenAI

# Before: OpenAI default
# llm = ChatOpenAI(model="gpt-4")

# After: abliteration.ai
llm = ChatOpenAI(
    model="abliterated-model",
    base_url="https://api.abliteration.ai/v1",
    api_key="YOUR_ABLIT_KEY",
)

# Your chains work unchanged
response = llm.invoke("Summarize this document in three bullet points.")
print(response.content)

# Works with chains, agents, and LCEL
from langchain_core.prompts import ChatPromptTemplate

prompt = ChatPromptTemplate.from_messages([
    ("system", "You are a helpful assistant."),
    ("user", "{input}")
])
chain = prompt | llm
result = chain.invoke({"input": "What is abliteration?"})