21 RESULTS · “inference”
v20.22.5 · Apache-2.0
Persistent session memory for AI coding agents that never leaves your machine — including the on-device model that reasons over it. Restores your prior decisions, open TODOs, and changed files across sessions; adds associative recall of related past work,
— · no license
Web search and content extraction with Tavily and Exa via inference.sh CLI. Apps: Tavily Search, Tavily Extract, Exa Search, Exa Answer, Exa Extract. Capabilities: AI-powered search, content extraction, direct answers, research. Use for: research, RAG pipelines, fact-checking, content aggregation, a
Run AI apps via inference.sh CLI - image generation, video creation, LLMs, search, 3D, Twitter automation. Models: FLUX, Veo, Gemini, Grok, Claude, Seedance, OmniHuman, Tavily, Exa, OpenRouter, and many more. Use when running AI apps, generating images/videos, calling LLMs, web search, or automating
— · MIT License
Enables agents to store LLM query-response pairs and retrieve them via fuzzy cosine similarity matching, reducing duplicate inference calls; it exposes tools for setting cache entries, semantic lookup, and hit-rate statistics.
v1.0.0 · no license
Fit reports and search over Corey James's work: GPU inference, agent governance, enterprise AI.