llmonitor is an open-source monitoring platform for AI developers. It enables:

  • ๐Ÿ’ธ
    analytics on cost & usage
  • ๐Ÿ—ž๏ธ
    log prompts & requests
  • ๐Ÿพ
    debug your agents with traces
  • ๐Ÿ‘จโ€๐Ÿ‘ฉโ€๐Ÿ‘งโ€๐Ÿ‘ฆ
    user tracking, cost / user
  • ๐Ÿ–ฒ๏ธ
    frontend feedback buttons (soon)
  • ๐Ÿ”Ž
    analytics & logs on embeddings (soon)
  • ๐Ÿ’ฌ
    chat conversation replays (soon)
  • ๐Ÿงช
    prompt testing suit (soon)

Getting started

The first thing you'll need to get started is to sign up and get a tracking ID.

Get a tracking ID (it's free) โ†’

Pick an integration

We support integrating with the most popular AI libraries, with more in the work.

Step 1: install module & set required environment variable
pip install llmonitor
Step 2: import and use
import openai
from llmonitor import monitor
openai.api_key = "sk-..."
chat_completion = openai.ChatCompletion.create(
messages=[{"role": "user", "content": "Hello world"}]
Read more about the OpenAI integration โ†’

Questions? We're here to help.