LoongForge

A high-performance training framework for LLM, VLM, VLA, Wan

2 followers

A high-performance training framework for LLM, VLM, VLA, Wan

2 followers

LoongForge is a modular, scalable, high-performance training framework for LLMs, VLMs, diffusion, and embodied models. Up to ~5× training speedup, native NVIDIA GPU and Kunlun XPU support.

Free

Launch tags:Developer Tools•Artificial Intelligence•GitHub

Launch Team

Customer.ioAutomate Messaging Everywhere — Startups Get 12 Months Free

Promoted

Maker

📌

LoongForge is a unified training framework for LLMs, VLMs, VLAs, and diffusion models, covering pre-training, continued pre-training, and SFT. Built upon Megatron-LM with deep systemic enhancements across model coverage, training performance, and hardware support, it delivers significant speedups over mainstream open-source baselines. Before going open-source, LoongForge was developed as AIAK-Training-LLM, Baidu Baige's training acceleration stack. It has supported production training for enterprise customers across Education, Computer Vision, and Embodied AI, typically delivering 30%~50% speedup over customer baselines, with the largest production runs reaching 5,000+ XPUs.

Report

5mo ago

Reviews