NINMENI — Framework

NMU (ninmeni meaning unit)

6 followers

NMU (ninmeni meaning unit)

6 followers

Visit website

AI Code Editors

NINMENI — Framework Model Bahasa Native Indonesia NINMENI adalah kerangka riset dan rekayasa untuk membangun model bahasa yang native terhadap bahasa Indonesia, dari lapisan paling dasar

Free

Launch tags:Artificial Intelligence•GitHub

Launch Team

Framer AI AgentsDesign and publish professional sites with AI

Promoted

Be the first to comment

Forum Threads

p/ninmeni-framework

•

3mo ago

Challenging Tokenization: An LLM Experiment Without a Tokenizer

Most LLMs assume language must be broken into tokens (BPE, WordPiece) before computation. The tokenizer is a fundamental component.

While building a new experimental framework called NINMENI, we asked: What if tokenization isn't the only foundation?

A Different Starting Point
NINMENI explores a different primitive: 1 Character = 1 ID.

Character models aren't new, but what happens next is. Instead of treating characters as smaller tokens, the framework treats the character space as a native substrate. Meaning formation emerges from runtime interactions, not a tokenizer.

View all