Skip to content

chore: bump tokenizers from 0.23.1 to 0.23.2 - #25

Open
dependabot[bot] wants to merge 1 commit into
masterfrom
dependabot/cargo/tokenizers-0.23.2
Open

chore: bump tokenizers from 0.23.1 to 0.23.2#25
dependabot[bot] wants to merge 1 commit into
masterfrom
dependabot/cargo/tokenizers-0.23.2

Conversation

@dependabot

@dependabot dependabot Bot commented on behalf of github Sep 7, 2026

Copy link
Copy Markdown

Bumps tokenizers from 0.23.1 to 0.23.2.

Release notes

Sourced from tokenizers's releases.

v0.23.2

This is the last v0 release, we are moving to v1!!

More details coming soon 👀

What's Changed

New Contributors

Full Changelog: huggingface/tokenizers@v0.23.1...v0.23.2

Commits
  • 88a4498 add lock
  • e4ea65f real release
  • 7c5964b add lock
  • bc405ad push rc0
  • d582781 Add a ParityBpeTrainer example and list it in the trainers API docs (#2217)
  • 447890f fix(python): pin the ruff rule set so a ruff release can't redden main (#2292)
  • 68b3ab7 chore(node): take node security alerts from 33 to 0 (#2287)
  • 74ef81f ci: pin every action to one SHA, drop stale audit suppressions (#2291)
  • b26727f chore(node): drop 8 unused devDependencies (#2286)
  • 7c7cfd8 chore: remove stale examples (kills 50% of dependabot traffic) (#2285)
  • Additional commits viewable in compare view

Dependabot compatibility score

Dependabot will resolve any conflicts with this PR as long as you don't alter it yourself. You can also trigger a rebase manually by commenting @dependabot rebase.


Dependabot commands and options

You can trigger Dependabot actions by commenting on this PR:

  • @dependabot rebase will rebase this PR
  • @dependabot recreate will recreate this PR, overwriting any edits that have been made to it
  • @dependabot show <dependency name> ignore conditions will show all of the ignore conditions of the specified dependency
  • @dependabot ignore this major version will close this PR and stop Dependabot creating any more for this major version (unless you reopen the PR or upgrade to it yourself)
  • @dependabot ignore this minor version will close this PR and stop Dependabot creating any more for this minor version (unless you reopen the PR or upgrade to it yourself)
  • @dependabot ignore this dependency will close this PR and stop Dependabot creating any more for this dependency (unless you reopen the PR or upgrade to it yourself)

Bumps [tokenizers](https://github.com/huggingface/tokenizers) from 0.23.1 to 0.23.2.
- [Release notes](https://github.com/huggingface/tokenizers/releases)
- [Changelog](https://github.com/huggingface/tokenizers/blob/main/RELEASE.md)
- [Commits](huggingface/tokenizers@v0.23.1...v0.23.2)

---
updated-dependencies:
- dependency-name: tokenizers
  dependency-version: 0.23.2
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
@dependabot @github

dependabot Bot commented on behalf of github Sep 7, 2026

Copy link
Copy Markdown
Author

Labels

The following labels could not be found: dependencies. Please create it before Dependabot can add it to a pull request.

Please fix the above issues or remove invalid values from dependabot.yml.

@git-mind-pr-guardian

Copy link
Copy Markdown

GitMind PR Review

{'pr_url': '#25', 'repo': 'Ayyankhan101/Transformer-In-Rust', 'pr_num': '25', 'title': 'chore: bump tokenizers from 0.23.1 to 0.23.2', 'author': 'dependabot[bot]', 'additions': 5, 'deletions': 5, 'changed_files': 1, 'review': '## Summary\nDependency bump of tokenizers from 0.23.1 to 0.23.2 (and daachorse to 3.0.3) with only Cargo.lock changes. No code impact detected.\n\n## Issues\nNo significant issues found.\n\n## Verdict\n✅ APPROVE\nThe update is limited to lock‑file metadata, checksums are correct, and there are no breaking API changes affecting the current codebase. Safe to merge.'}


Auto-generated by GitMind — AI-powered code analysis.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

0 participants