tokenization-system

Here are 3 public repositories matching this topic...

ma-abdellaoui / anonymice

Reversible PII tokenization for LLM prompts and web pages. Names, IBANs, Phone numbers, cards and secrets leave as tokens, and the mapping back to the real value never leaves your infrastructure.

proxy data-privacy tokenization anonymization pii pii-detection anonymization-api pii-redaction llm llm-proxy litellm pii-protection pii-masking tokenization-system

Updated Aug 23, 2026
Python

allisson / secrets

Sponsor

Star

A lightweight secrets manager with envelope encryption, transit encryption, API auth, and audit logs.

encryption aes-gcm chacha20-poly1305 tokenization secrets-management secrets-engine transit-engine tokenization-system tokenization-engine

Updated Aug 10, 2026
Go

BohanSu / Lexical-Analyzer-Lab

Star

A lightweight lexical analyzer implemented in Python for tokenizing source code. (一个轻量级的 Python 词法分析器，用于源代码的分词。)

python lexer lexical-analysis tokenization compiler-construction tokenization-system

Updated Jan 2, 2026
Python

Improve this page

Add a description, image, and links to the tokenization-system topic page so that developers can more easily learn about it.

Curate this topic

Add this topic to your repo

To associate your repository with the tokenization-system topic, visit your repo's landing page and select "manage topics."

Learn more