Community

Blog

Llumo AI Docs

Getting Started

Cost Saving

LLM Evaluation

Developer tools

Sign-up

Support

Use LLUMO AI's proprietary technology to evaluate LLM output and gain insights.

Custom evaluation

Create custom evaluation

LLUMO compresses your tokens to build production ready AI at 50% cost and 10x speed.

Overview

LLUMO AI - Cut LLM Cost by 50%

Reduce LLM cost and gain 360° insights of your LLM outputs.

Quickstart

Sandbox

Sandbox - LLUMO AI

This guide will help to create your account

Create account

Create your LLUMO account

Activate your account

Activate your LLUMO account

Prompt Compression API

Setup prompt compression API

Prompt Evaluation API

Setup Prompt Evaluation API

Save cost in LLM calls with OpenAI using LLUMO compressor API

Production

Add LLUMO Compressor API to code and deploy

Save cost in Langchain pipeline using LLUMO compressor API

Langchain

LLUMO Compressor API with Langchain

Save cost in OpenAI API calls using LLUMO compressor API

OpenAI

LLUMO Compressor API with OpenAI

Save cost in Google Vertex pipeline using LLUMO compressor API

Google Vertex

LLUMO Compressor API with Google Vertex

Save cost in Llama Index pipeline using LLUMO compressor API

Llama Index

LLUMO Compressor API with Llama Index

Consulting Optimization

Compress Prompt API

Setup prompt evaluation API

Use LLUMO AI’s proprietary technology to evaluate output from OpenAI GPT models.

Setup Prompt Evaluation API with OpenAI output

Use LLUMO AI’s proprietary technology to evaluate output from Google Gemini models.

How to docs

Setup

API Reference

Create custom evaluation