Skip to content

Repository files navigation

cloudfits

CI MIT Sponsor

Estimate the real cost of running any LLM — per hour and per month — self-hosted or via any hosted inference provider. Compare providers and switch easily.

# Cost: local vs cloud
cloudfits cost --model llama-3.1-8b-instruct

# Compare providers
cloudfits compare --model llama-70b

# Switch: steps + cost impact
cloudfits switch --model llama-3.1-8b-instruct --from ollama --to groq

# Hardware (GPU/CPU) used for local estimates
cloudfits system

# Interactive TUI
cloudfits-tui

# Web UI + JSON API (localhost:8787)
cloudfits serve

Install

# Prebuilt binaries (Linux/macOS/Windows, x86_64 + ARM64)
./install.sh

# Or from source
cargo build --release

Release: v1.0.1 · SPONSORS.md · FUNDING.yml

MIT License — independent FOSS project (not derived from llmfit).

About

FOSS CLI + lib for LLM inference cost estimation, provider switching, and AI infrastructure measurement. Multi-arch releases (Linux/macOS/Windows, x86_64 + ARM64). MIT licensed. Open grants + sponsorship welcome — see SPONSORS.md and FUNDING.yml.

Resources

Code of conduct

Contributing

Security policy

Stars

1 star

Watchers

0 watching

Forks

Releases

Sponsor this project

Packages

Contributors

Languages