trending

LLMSlim - Tool-aware context, contract-safe.

v0.4.0 adds contract-safe tooling for MCP, OpenAI function, Anthropic, and generic tool schemas: provider-aware adapters, deterministic canonical JSON, SHA-256 fingerprints, exact-equivalence checks, and schema inspection. Raw execution schemas remain authoritative. Tool retrieval is research-only and is never used for authorization or execution.

LLMSlim - Semantic prompt compression that never drops instructions.

Open-source Python package cutting LLM token costs by 40–70% in 1 line of code. Surgically compresses prompts, RAG document contexts, and multi-turn chat logs with guaranteed 100% instruction fidelity.

LLMSlim v0.3.0 - Cut LLM token costs 40-70% with offline prompt compression

v0.3.0 ships hybrid prompt compression: offline TF-IDF extraction pre-prunes context, then an optional LLM rewrite pass semantically optimizes what remains. Result: 40-70% fewer tokens billed, sub-30ms CPU latency, and 100% retention of system directives, code blocks, and JSON schemas. Works with OpenAI, Anthropic, Gemini, LangChain, LlamaIndex, Ollama and more. Zero dependencies. Pure Python. pip install llmslim