Ontological Directed Synthesis Network
Streaming tensor memory optimization for AI models
2 followers
Streaming tensor memory optimization for AI models
2 followers
ODSN is an open-source PyTorch framework designed to eliminate VRAM/RAM bottlenecks. It compresses incoming context tensors on-the-fly using streaming Int8 quantization and 1D pooling, immediately clearing heavy references to prevent memory leaks.
