Community

Blog

Llumo AI Docs

Getting Started

Cost Saving

LLM Evaluation

Developer tools

Sign-up

Support

Compress Prompt API

Getting started with LLUMO AI

Reduce LLM cost and gain 360° insights of your LLM outputs.

Quickstart

Welcome to LLumo AI’s Support Page

Prompt Compression API

Setup prompt compression API

Use LLUMO AI's proprietary technology to evaluate LLM output and gain insights.

Prompt Evaluation API

Setup Prompt Evaluation API

Save RAG cost

Save RAG cost using Prompt Compression

Compress Prompt

Guide to Prompt Compress with LLUMO AI

Save cost in LLM calls with OpenAI using LLUMO compressor API

Production

Add LLUMO Compressor API to code and deploy

Customize Evaluation

How to customize Evals for your use case?

Create Custom Evals

How to create a custom Eval from scratch?

Save cost in Langchain pipeline using LLUMO compressor API

Langchain

LLUMO Compressor API with Langchain

Save cost in OpenAI API calls using LLUMO compressor API

OpenAI

LLUMO Compressor API with OpenAI

Save cost in Google Vertex pipeline using LLUMO compressor API

Google Vertex

LLUMO Compressor API with Google Vertex

Save cost in Llama Index pipeline using LLUMO compressor API

Llama Index

LLUMO Compressor API with Llama Index

Consulting Optimization

Setup prompt evaluation API

Use LLUMO AI’s proprietary technology to evaluate output from OpenAI GPT models.

Setup Prompt Evaluation API with OpenAI output

Use LLUMO AI’s proprietary technology to evaluate output from Google Gemini models.

Vertex AI

Setup Prompt Evaluation API with Vertex output

Create Eval Analytics API

How to docs

Setup

API Reference

Compress Prompt API

Body

Response