Skip to content

Commit

Permalink
publish: 0.0.0
Browse files Browse the repository at this point in the history
Signed-off-by: YdrMaster <ydrml@hotmail.com>
  • Loading branch information
YdrMaster committed Aug 7, 2024
1 parent 810279b commit ad17461
Show file tree
Hide file tree
Showing 2 changed files with 11 additions and 2 deletions.
9 changes: 7 additions & 2 deletions Cargo.toml
Original file line number Diff line number Diff line change
@@ -1,10 +1,15 @@
[package]
name = "tokeneer"
description = "Another tokenizer crate"
version = "0.0.0"
edition = "2021"
authors = ["YdrMaster <ydrml@hotmail.com>"]

# See more keys and their definitions at https://doc.rust-lang.org/cargo/reference/manifest.html
repository = "https://github.com/YdrMaster/tokeneer"
documentation = "https://docs.rs/tokeneer"
license = "MIT"
readme = "README.md"
keywords = ["tokenizer", "bpe", "nlp"]
categories = ["algorithms", "encoding"]

[dependencies]
regex = "1.10"
Expand Down
4 changes: 4 additions & 0 deletions README.md
Original file line number Diff line number Diff line change
@@ -1,6 +1,8 @@
# Tokeneer

[![CI](https://github.com/YdrMaster/tokeneer/actions/workflows/build.yml/badge.svg?branch=main)](https://github.com/YdrMaster/tokeneer/actions)
[![Latest version](https://img.shields.io/crates/v/tokeneer.svg)](https://crates.io/crates/tokeneer)
[![Documentation](https://docs.rs/tokeneer/badge.svg)](https://docs.rs/tokeneer)
[![license](https://img.shields.io/github/license/YdrMaster/tokeneer)](https://mit-license.org/)
![GitHub repo size](https://img.shields.io/github/repo-size/YdrMaster/tokeneer)
![GitHub code size in bytes](https://img.shields.io/github/languages/code-size/YdrMaster/tokeneer)
Expand All @@ -9,3 +11,5 @@
[![GitHub Pull Requests](https://img.shields.io/github/issues-pr/YdrMaster/tokeneer)](https://github.com/YdrMaster/tokeneer/pulls)
![GitHub contributors](https://img.shields.io/github/contributors/YdrMaster/tokeneer)
![GitHub commit activity](https://img.shields.io/github/commit-activity/m/YdrMaster/tokeneer)

Another tokenizer crate.

0 comments on commit ad17461

Please sign in to comment.