Skip to content
@llm-works

LLM Works

LLM Works

Open-source infrastructure for production AI agents.


Live:


Stack

Layer Package Purpose
Runtime llm-gent Agent orchestration
Communication llm-saia Structured LLM interaction
Learning llm-kelt Feedback collection, fine-tuning
Inference llm-infer Multi-backend model serving
Foundation appinfra Config, logging, lifecycle

~500K lines across all packages. ~1:1 test-to-code ratio.


llm-works.ai · about · info@llm-works.ai · LinkedIn · llms.txt

Pinned Loading

  1. llm-gent llm-gent Public

    Composable agent framework with trait-based architecture and production HTTP runtime

    Python

  2. llm-saia llm-saia Public

    Structured verbs for LLM interactions (verify, critique, decompose, extract, synthesize...)

    Python 1

  3. llm-kelt llm-kelt Public

    Framework for collecting and managing LLM context: facts storage, feedback collection, RAG retrieval, and LoRA fine-tuning

    Python 1

  4. llm-infer llm-infer Public

    LLM inference server with native, vLLM, and Ollama backends, including a client to interact with multiple LLM providers

    Python

  5. appinfra appinfra Public

    Production-grade Python infrastructure framework for building reliable CLI tools and services

    Python

Repositories

Showing 8 of 8 repositories

Top languages

Loading…

Most used topics

Loading…