A working RAG (Retrieval-Augmented Generation) prototype with local document embeddings, vector search, web search, and tool integration.
NOTE: Working on a 2060 RTX with ~6GB of memory!
- Install dependencies:
pip install -r requirements.txt-
(Optional) Place your documents in the
documents/folder. -
(Optional) Build the database:
python build_db.pyThis will embed documents into a FAISS vector store.
python rag_server.pypython rag_client.pypython rag_discord_bot.py- Embeds documents and stores them in a FAISS vector store
- Retrieves relevant knowledge for questions
- Supports web searches for additional context
- Tool integration for advanced RAG workflows
rag_server.pyRuns embedding, reranking, generation, websearch, and tool passes and allows for url queriesrag_client.pyallow for local queriesrag_discord_bot.pyallow for queries and responses through discord