Lutflow / Docs

FAQ

Frequently asked questions

Frequently Asked Questions

What is the license of the Lutflow SDK?

The SDK is source-available under the Business Source License 1.1 (BSL 1.1). Its Additional Use Grant lets you use it, provided you do not use it for a GPU Cost Management Service as the license defines it. Internal use, development, testing, evaluation, and non-commercial and educational use are permitted. It changes to the Apache License 2.0 on March 29, 2030. See Security & Trust; the LICENSE file in the package is the binding text.

What happens if I exceed my budget?

lutflow measure --endpoint only reads vLLM metrics; it does not enforce a budget or change serving traffic. Separate SDK wrappers can raise, warn or call your callback inside your Python process. They do not terminate a Kubernetes workload.

Do I need Kubernetes?

No. Tier 0 connects to an existing vLLM /metrics endpoint from your machine. If you do not have a vLLM server, vLLM on GKE with one L4 is a manual recipe to run one. Sentinel, Lutflow's Kubernetes agent, is in progress.

Do I need special hardware to run Lutflow?

You need a running vLLM server that exposes token counters. The Tier 0 command does not need a GPU sensor or node access. To calculate dollars, provide your real hourly GPU rate and its pricing basis.

On this page