Skip to content
#

vram-aware

Star

Here are 3 public repositories matching this topic...

B-A-M-N / FlockParser

Sponsor
Star 5

Distributed document RAG system with intelligent GPU/CPU orchestration. Auto-discovers heterogeneous nodes, routes workloads adaptively, and achieves 60x+ speedups through VRAM-aware load balancing. Privacy-first architecture with 4 interfaces (CLI, API, MCP, Web UI). Real distributed systems engineering, not just an API wrapper.

python api cli mcp web-ui auto-discovery semantic-search document-processing load-balancing privacy-first rag heterogeneous-computing vector-database llm chromadb ollama gpu-orchestration distributed-rag vram-aware workload-orchestration
  • Updated Nov 13, 2025
  • Python

Improve this page

Add a description, image, and links to the vram-aware topic page so that developers can more easily learn about it.

Curate this topic

Add this topic to your repo

To associate your repository with the vram-aware topic, visit your repo's landing page and select "manage topics."

Learn more