v0.1.0 · MIT License
Enables an AI agent to check live GPU prices, get a cost quote, rent a per-minute GPU instance, upload code and data, run jobs in the background, tail logs, download results and destroy the instance to stop billing. Includes guardrail limits on spend, hours and idle time, safe file transfer, and access to an OpenAI-compatible model API for inference without renting a GPU.
— · MIT License
Enables MCP clients to coordinate local AI model runs by monitoring RAM, system commit, and VRAM, queueing tasks across clients, performing admission checks before inference, renewing leases, completing and releasing runs, and reporting status, history, and health while preserving original generation quality parameters. It also supports controlled start/stop and optional idle application memory reclamation.
— · MIT License
Enables agents to store LLM query-response pairs and retrieve them via fuzzy cosine similarity matching, reducing duplicate inference calls; it exposes tools for setting cache entries, semantic lookup, and hit-rate statistics.