Skip to main content
Aptible’s LLM Gateway gives you full visibility into LLM activity. Every request is logged automatically with no configuration required.
If you’re processing PHI: this feature satisfies the audit logging requirement under HIPAA’s audit control standard. See Security & Compliance for LLM Gateway for more info.

​
What Gets Logged

Every request captures: prompt content, response, timestamp, model used, scope and key attribution, token counts (input and output), and cost. This gives you the full record needed to answer compliance questions, troubleshoot issues, and investigate incidents.

​
Request History

View request activity for each key over the past week from the key details page. Each row shows token consumption and associated costs, giving you a quick read on how your keys are being used.

​
Request Logs

Full LLM request and response logs are available in the Aptible dashboard for 7 days. Logs are useful for prompt refinement, troubleshooting, and compliance review. Click the chevron on any request row to expand the full request details.

​
Long-term Retention

For retention beyond 7 days, you can drain logs to Langfuse. LLM trace drains are configured at the environment level under the Integrations tab. See the Langfuse integration for setup instructions. If you have other retention requirements (S3, SIEM, etc.), contact Aptible Support.
Misconfigured log drains can fail silently. After setting up a drain, verify that logs are arriving in your destination before relying on it for compliance purposes. Contact Aptible Support if you want to set up alerting for drain delivery failures.