All activity
With TokScope, you can intuitively understand how the model encodes language, discover potential biases, and evaluate the quality of token embeddings. Start exploring now!
TokScopeInteractive Token Embedding Visualization Tool of LLMs
raysilienceleft a comment
Excited to share TokScope with you all! Ever wondered how LLMs process multiple languages—do they share the same concepts across them? 🤔 TokScope lets you interact with token embeddings to explore this! I found that in the DeepSeek model, numbers across languages form a centralized cluster. What surprising patterns have you discovered?
TokScopeInteractive Token Embedding Visualization Tool of LLMs