Back to app
PeerLMDocs
Getting Started
What is PeerLM?Quick Start GuideSetting Up Your LibraryCreating Your First SuiteUnderstanding Your Results
Core Concepts
How Evaluations WorkCredits & PricingPlans & LimitsModel Tiers & CapabilitiesCachingDeterministic Mode
Features & Workflows
Evaluation Assistant (AI)Managing System PromptsManaging Test Prompts & DatasetsConfiguring Evaluation CriteriaPass/Fail ThresholdsAuto-Run (CI/CD for LLMs)Monitors & comparison RunsSharing & Exporting ResultsBaselines & Run ComparisonPrompt Writing Guide
Monitors
OverviewSDK IntegrationObservability ConnectorsAuto-Runs & Triggers
Integrations
REST API OverviewWebhooks (Coming Soon)MCP Server
Team & Account
Workspaces & OrganizationsTeam ManagementBilling & SubscriptionsAudit Log
API Reference
AuthenticationEndpointsMonitors API EndpointsError Codes & Responses
Troubleshooting
Run Failures & Action RequiredCommon Error MessagesEvaluation ErrorsCredit DiscrepanciesGlossary

PeerLM Documentation

Everything you need to evaluate, compare, and optimize LLMs.

Press ⌘K to search

Popular

Quick Start GuideEvaluation Assistant (AI)How Evaluations WorkMonitors & comparison RunsAPI EndpointsMonitors Overview

Getting Started

5 articles
  • What is PeerLM?
  • Quick Start Guide
  • Setting Up Your Library
  • Creating Your First Suite
  • Understanding Your Results

Core Concepts

6 articles
  • How Evaluations Work
  • Credits & Pricing
  • Plans & Limits
  • Model Tiers & Capabilities
  • Caching
  • Deterministic Mode

Features & Workflows

10 articles
  • Evaluation Assistant (AI)
  • Managing System Prompts
  • Managing Test Prompts & Datasets
  • Configuring Evaluation Criteria
  • Pass/Fail Thresholds
  • Auto-Run (CI/CD for LLMs)
  • Monitors & comparison Runs
  • Sharing & Exporting Results
  • Baselines & Run Comparison
  • Prompt Writing Guide

Monitors

4 articles
  • Overview
  • SDK Integration
  • Observability Connectors
  • Auto-Runs & Triggers

Integrations

3 articles
  • REST API Overview
  • Webhooks (Coming Soon)
  • MCP Server

Team & Account

4 articles
  • Workspaces & Organizations
  • Team Management
  • Billing & Subscriptions
  • Audit Log

API Reference

4 articles
  • Authentication
  • Endpoints
  • Monitors API Endpoints
  • Error Codes & Responses

Troubleshooting

5 articles
  • Run Failures & Action Required
  • Common Error Messages
  • Evaluation Errors
  • Credit Discrepancies
  • Glossary