Results 1 package
Sort by

dart_sentencepiece_tokenizercopy "dart_sentencepiece_tokenizer: ^1.3.0" to clipboard
dart_sentencepiece_tokenizer: ^1.3.0 copied to clipboard

3
likes
160
points
146
downloads
A lightweight, pure Dart implementation of SentencePiece tokenizer. Supports BPE (Gemma) and Unigram (Llama) algorithms.#nlp#sentencepiece#tokenizer#machine-learning#llm

Check our help page for details on search expressions and result ranking.