Attenta is a from-scratch Rust implementation of the Transformer architecture (Vaswani et al. 2017) built without PyTorch or TensorFlow. Designed for high efficiency, it features multi-head attention, BPE tokenization, and custom matrix multiplication. This release comes pre-trained on Indian legal documents, showcasing a pure Rust pipeline for specialized NLP tasks from tokenization to beam search decoding. Fully tested with 85 unit tests and ready to self-host.
