Welcome

llmonitor is an open-source monitoring platform for AI developers. It enables:

• 💸

  analytics on cost & usage
• 🗞️

  log prompts & requests
• 🐾

  debug your agents with traces
• 👨‍👩‍👧‍👦

  user tracking, cost / user
• 🖲️

  frontend feedback buttons (soon)
• 🔎

  analytics & logs on embeddings (soon)
• 💬

  chat conversation replays (soon)
• 🧪

  prompt testing suit (soon)

Getting started

The first thing you'll need to get started is to sign up and get a tracking ID.

Pick an integration

We support integrating with the most popular AI libraries, with more in the work.

Python

JavaScript

Library:

OpenAI

LangChain

LiteLLM

Other

Step 1: install module & set required environment variable

pip install llmonitor

LLMONITOR_APP_ID="00000000-0000-0000-0000-000000000000"

Step 2: import and use

import openai
from llmonitor import monitor

monitor(openai)

openai.api_key = "sk-..."

chat_completion = openai.ChatCompletion.create(
  model="gpt-3.5-turbo", 
  messages=[{"role": "user", "content": "Hello world"}]
)

Read more about the OpenAI integration →