Launching today
Attenta

Attenta

A from-scratch Rust Transformer trained on legal documents

2 followers

Visit website
Attenta is a from-scratch Rust implementation of the Transformer architecture (Vaswani et al. 2017) built without PyTorch or TensorFlow. Designed for high efficiency, it features multi-head attention, BPE tokenization, and custom matrix multiplication. This release comes pre-trained on Indian legal documents, showcasing a pure Rust pipeline for specialized NLP tasks from tokenization to beam search decoding. Fully tested with 85 unit tests and ready to self-host.

Attenta makers

Here are the founders, developers, designers and product people who worked on Attenta

Meet MendaparaAI Researcher | AI & Cognitive Systems
AttentaAttenta