Skip to content

LLMInspect Licensing Guide

LLMInspect Gateway platform requires a valid license to operate in an on- perm or SAS environment. LLMInspect basic license covers 10,000 enterprise GenAI queries per day. Larger organizations can stack multiple licenses to get higher queries per day volume.

Licensing Diagram

LLMInspect administrators should follow the steps below to configure licensing by setting the necessary environment variables in your .env file, used during the initial deployment of LLMInspect:

License Environment Variables

  • LICENSE_MODE: Specifies whether to use local or cloud licensing. Available values:
    • local (default): Only local licensing is supported for now.
    • cloud: If you require cloud licensing, please contact [email protected] for more information.
  • LLMGW_KEY: Your unique license key provided by Eunomatix. This key is necessary to validate your license.
  • AUTH_CODE: The authorization code provided by Eunomatix, required to activate your license.

Important: If either LLMGW_KEY or AUTH_CODE are missing or incorrect, LLM Gateway will not start.

Usage Limits

Your license allows a limited number of GenAI queries per day, depending on your license subscription. If you exceed this daily licensing limit, it will be counted as a violation.

  • License Violations: Accumulating 5 violations within a 30-day period will render your license invalid.
  • Service Restore: Service Restore: To restore LLMInspect services, you must restart the LLM Gateway services.

Tip: If you require a higher request limit, contact [email protected] for assistance with upgrading your license.

Troubleshooting Licensing Issues

If you're experiencing licensing issues, follow these steps:

  1. Check Configuration: Ensure your .env file contains valid values for LICENSE_MODE, LLMGW_KEY, and AUTH_CODE.
  2. Verify Usage Limits: Confirm that you haven’t exceeded your daily request limit by reviewing the below log message in the LLMInspect system logs. If you've reached the limit, consider upgrading your license.
  3. License Violations: If your license has become invalid due to multiple violations, restart the LLM Gateway server.

Support: If these steps don’t resolve your issue, visit Eunomatix Support and open a support ticket.

FAQs

1. When does my license start, and when does it expire?

Your license starts on the date the product is delivered and is valid for 365 days from that date. Once the license expires, the system will return a 403 Forbidden error when you attempt to make requests.

2. How can the LLMInspect license be renewed?

Please read the EUNOMATIX End User License Agreement (EULA) that explains the license and service renewals. Please read https://www.eunomatix.com/eula

3. Does my license apply to all services like OPENAI, GEMINI, Meta’s LLAMA, or just some?

Your license covers all LLM Gateway services, including RAG, Local LLM, and API requests. All requests made to any service will count toward your daily request limit.