Save cost in Google Vertex pipeline using LLUMO compressor API
os
module for operating system operations and the drive module from google.colab
.drive.mount()
attaches your Google Drive to the ‘/content/drive’ directory in the Colab environment.force_remount=True
ensures that the drive is remounted even if it was previously mounted, which can help resolve connection issues.GOOGLE_APPLICATION_CREDENTIALS
environment variable to point to your Google Cloud service account key file.os
: For operating system operations and environment variables.requests
: For making HTTP requests (will be used for Llumo API calls).json
: For JSON parsing and manipulation.logging
: For setting up logging in the script.getpass
: For securely inputting passwords or API keys.aiplatform
: The main module for interacting with Vertex AI.TextGenerationModel
: Specific class for text generation tasks in Vertex AI.logging.basicConfig()
configures the logging system with INFO level, meaning it will capture all info, warning, and error messages.logger = logging.getLogger(__name__)
creates a logger object. __name__
is a special Python variable that gets set to the module’s name when the module is executed.getpass()
to prompt for the Llumo API key without displaying it on the screen as it’s typed.compress_with_llumo
that takes a text input and an optional topic.requests.post()
to send a POST request to the Llumo API.
response.raise_for_status()
will raise an exception for HTTP errors.