rowen

rowen

A developer specializing in optimization
#83528900 followers0 following
☀️ 2 day streak
Playground AIPython Package IndexGitHub
+1 stacked product

Badges

Tastemaker
Tastemaker
Gone streaking
Gone streaking

Maker History

  • GitHub
    GitHubBERT, Tokenizer, Python, WordPiece, pybind11,C++,Flash,Trie
    Apr 2025
    • 🎉
    Joined Product HuntApril 2nd, 2025

Forums

rowen•

10mo ago

GitHub - BERT, Tokenizer, Python, WordPiece, pybind11,C++,Flash,Trie

🚀 **FlashTokenizer: World's Fastest CPU Tokenizer!** ⚡ 8~15x faster than `BertTokenizerFast` 🛠️ High-performance C++ 🔄 Parallel with OpenMP 📦 Easy pip install 💻 Cross-platform (Win/Mac/Linux) ▶️ Demo: https://youtu.be/a_sTiAXeSE0
View more