Do you store prompts or chat logs?
No. Payload retention is zero by default, so prompts and outputs are not stored as chat logs.
Reference
Zero data retention LLM API
Zero data retention means prompts and outputs are processed transiently and not stored after the request completes.
Operational telemetry (token counts, timestamps, error codes) may still be retained for billing and reliability.
Look for explicit separation between payload retention and operational telemetry in provider policies.
Definition of Zero data retention LLM API
A zero data retention LLM API processes prompts and outputs in memory and does not persist payload content after the request completes, while retaining minimal operational telemetry for billing.
Why Zero data retention LLM API matters
- Reduce exposure when handling sensitive or regulated data.
- Limit leakage of proprietary prompts and outputs.
- Meet internal security and compliance expectations.
- Minimize blast radius if logging systems are compromised.
How it works
- Process payloads transiently and avoid storing raw prompts or outputs.
- Retain only operational telemetry required for billing (token counts, timestamps, error codes).
- Publish clear terms that separate payload retention from telemetry.
- Verify behavior with test traffic and check for payload logging.
Example request
curl https://api.abliteration.ai/v1/chat/completions \
-H "Authorization: Bearer $ABLIT_KEY" \
-H "Content-Type: application/json" \
-d '{
"model": "abliterated-model",
"messages": [{"role":"user","content":"Summarize this file."}]
}'FAQ
Frequently Asked Questions
What counts as payload retention?
Payload retention means storing prompts or outputs as logs, conversations, or training data after the request completes.
Is any data retained at all?
Operational telemetry such as timestamps, token counts, and error codes can be retained for billing and reliability.
How can I verify a provider's policy?
Review the privacy policy and terms, then run tests to confirm payloads are not stored or echoed in logs.