Skip to content

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

12 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Chatbot test

Chatbot that will respond to inquiries about fre-cli based on the documentation

Install with bash

git clone https://github.com/thomas-robinson/frechatbot.git
mkdir -p models
mkdir -p faiss_index
if [ ! -f models/ggml-model-q4_0.gguf ]; then
  wget https://huggingface.co/TheBloke/Llama-2-7B-Chat-GGUF/resolve/main/llama-2-7b-chat.Q4_0.gguf -O ggml-model-q4_0.gguf
  mkdir -p models
  mv ggml-model-q4_0.gguf models/
fi
if [ ! -d fre-cli ]; then
  git clone --recursive https://github.com/NOAA-GFDL/fre-cli.git
fi
module load miniforge
conda deactivate
conda remove -n local-chatbot --all --yes
conda env create -f environment.yml
conda activate local-chatbot
python chat.py

Install with csh

mkdir -p models
mkdir -p faiss_index
if (! -f models/ggml-model-q4_0.gguf) then
  wget https://huggingface.co/TheBloke/Llama-2-7B-Chat-GGUF/resolve/main/llama-2-7b-chat.Q4_0.gguf -O ggml-model-q4_0.gguf
  if (! -d models) mkdir models
  mv ggml-model-q4_0.gguf models/
endif
if (! -d fre-cli) then
  git clone --recursive https://github.com/NOAA-GFDL/fre-cli.git
endif
module load miniforge
conda deactivate
conda remove -n local-chatbot --all --yes
conda env create -f environment.yml
conda activate local-chatbot
python chat.py

About

No description, website, or topics provided.

Resources

Stars

Watchers

Forks

Releases

Packages

Contributors

Languages