pretraining-model

Here are 5 public repositories matching this topic...

shengchaochen82 / FFTS

[AAAI'25] The implementation of paper "Federated Foundation Models on Heterogeneous Time Series" | The first work to explore time series foundation models on federated setting.

time-series classification imputation pretrained-models federated forecasting-models anomaly-detection fine-tuning federated-learning timeseries-forecasting pretraining foundation-models pretraining-model

Updated May 10, 2026
Python

saiprabhakar / ChannelMAE

Star

ChannelMAE is a combination of MAE and ChannelViT

toxicology drug-discovery satellite-imagery healthcare-application fine-tuning masked-autoencoder vision-transformer bioloy cellpainting pretraining-model generative-ai ai-healthcare

Updated Mar 29, 2025
Python

Deceptrax123 / Self-Supervised-Pseudolabelling-using-CSPDarknet-53

Star

Self Supervised Pseudolabelling of images with multiple objects using YOLOv3's Backbone

research yolo object-detection self-supervised-learning pretraining-model

Updated Dec 13, 2023
Python

aya-multitokenizer / multi-tokernizer-llm

Star

Scripts to pre train a Multi Tokenizer and also evaluate the performance.

cohere-ai pretraining-model multi-tokenizer for-ai c4ai

Updated Mar 10, 2025
Python

kamalesh003 / special-fishstick

Star

Special-Fishstick introduces Windowed Masked Pretraining, an efficient BERT-style MLM approach where masking is applied globally while the encoder processes only random local windows. Achieves faster training and lower GPU memory with competitive language modeling performance.

nlp machine-learning deep-learning machine-learning-algorithms transformers artificial-intelligence language-model nlp-machine-learning bert bert-model pretraining bert-fine-tuning masked-language-modeling pretraining-model

Updated Aug 2, 2026
Jupyter Notebook

Improve this page

Add a description, image, and links to the pretraining-model topic page so that developers can more easily learn about it.

Curate this topic

Add this topic to your repo

To associate your repository with the pretraining-model topic, visit your repo's landing page and select "manage topics."

Learn more