OpenBA-V2: 3B LLM (Large Language Model) with T5 architecture, utilizing model pruning technique and continuing pretraining from OpenBA-15B.
-
Updated
May 10, 2024 - Python
#
train-from-scratch
Here are 3 public repositories matching this topic...
pytorch implementation of several CNNs for image classification
cnn pytorch imagenet image-classification resnet cifar resnext pretrained-weights senet cbam sknet train-from-scratch
-
Updated
Jul 12, 2020 - Python
Experimental GPT-2 scale (~124M param) LLM trained from scratch. Trained on 22B tokens od Cosmopedia Dataset. Includes full training pipeline, with SFT FineTuning and log analysis tools with backend and frontend and deployment
nlp tokenizer pytorch transformer llama language-model nlp-machine-learning sft gpt2 train-from-scratch llm flashattention cosmopedia
-
Updated
Jul 29, 2026 - Python
Add this topic to your repo
To associate your repository with the train-from-scratch topic, visit your repo's landing page and select "manage topics."