Most LLMs assume language must be broken into tokens (BPE, WordPiece) before computation. The tokenizer is a fundamental component.
While building a new experimental framework called NINMENI, we asked: What if tokenization isn't the only foundation?
A Different Starting Point NINMENI explores a different primitive: 1 Character = 1 ID.
Character models aren't new, but what happens next is. Instead of treating characters as smaller tokens, the framework treats the character space as a native substrate. Meaning formation emerges from runtime interactions, not a tokenizer.
NINMENI — Framework Model Bahasa Native Indonesia
NINMENI adalah kerangka riset dan rekayasa untuk membangun model bahasa yang native terhadap bahasa Indonesia, dari lapisan paling dasar
