Setup prompt compression API

If you’ve already done demo call and got the access to the LLUMO app, this step is complete.

If you are a new user for LLUMO AI, please refer to Create Account and Activate your account

After you have access and you login to LLUMO for the first time, you will see a modal asking you to select the journey - Cost saving and Evaluation. You need to select the Cost Saving option.

If you have already selected the Evaluation option, no worries. If you see the left navigation bar, you will see the compressor option.

Then you can see a banner on the top of the page, asking you to set up. Click on “Setup Now”

The setup modal provides an overview of Compressor and a “Connect Now” CTA.

Click on “Connect Now” and it will open the API connection detail modal

• API endpoint: The URL you will use to send requests to the Compressor API.
• API key: Your unique API key, which is required for authentication. You will be given one API key by default. But, if you want to create multiple API keys, refer to managing your keys.

Examples of codes containing request bodies in different languages is provided, that you can use to send a request to the Compressor API. Copy the sample code block and paste into editor of your choice. Below is an example of sample code block in python.

    import requests

    url = "https://app.llumo.ai/api/compress"

    payload = {"prompt": "<string>"}
    headers = {
      "Content-Type": "application/json"
      "Authorization": "Bearer <API_KEY>"  
    }

    response = requests.request("POST", url, json=payload, headers=headers)

    print(response.text)

The request body includes the following important parameters:

• prompt: (Mandatory) The text prompt you want to compress.

• topic: (Optional) The topic of the prompt. We highly recommend providing a topic for better compression results.

Here is an example of these two parameters.

"prompt": "In a forgotten corner of the universe, a nomadic tribe journeys across a desolate wasteland on colossal, bio-engineered sandworms. These colossal creatures, revered as both gods and transportation, are on the verge of extinction due to a mysterious blight. A young rider, ostracized for their curiosity about the world beyond the sand, discovers a hidden cache of ancient technology. This technology offers a glimmer of hope for saving the sandworms, but it also unlocks forbidden knowledge that threatens to shatter the tribe's long-held beliefs. Torn between tradition and the promise of progress, the young rider must embark on a perilous quest to uncover the truth about the blight and the tribe's origins. Their journey will lead them to face colossal sand creatures, navigate treacherous landscapes, and confront a powerful ruling class determined to maintain the status quo. Will they succeed in saving the sandworms and their people, or will they succumb to the dangers that lie hidden beneath the sands? Write a story about their fight for survival and the burden of knowledge."
"topic": "What are the potential consequences of the young rider's choice between tradition and progress in saving the sandworms?"

For fine-grained control over logging and cost visualization, explore the optional parameters within the request body. These parameters allow you to tailor metrics to your specific needs and visualize cost breakdowns on the dashboard. For a detailed breakdown on the API request and response, please refer to the API reference page.

1. Open your directory where LLM project reside in editor of your choice.

2. Edit the sample code snippet you copied from LLUMO setup modal.

3. Replace the placeholder values for prompt and topic with your specific prompt and topic.

4. Include your API key in the header of the request.

5. Run the code snippet.

You can find detailed instructions on setting up the API in your code on the dedicated guide page.

For a more interactive experience, we recommend using API testing tools like Postman or Thunder Client. Below is the step-by-step detailed video explaing the complete process.

After sending the request, you can view the logs and metrics generated on the dashboard to see how the compression process performed. This information can help you optimize your requests for better results.