Qwen 1.5 MoE

Qwen 1.5 MoE

Highly efficient mixture-of-expert (MoE) model from Alibaba

5.0•2 reviews•

55 followers

Visit website
•
Qwen1.5-MoE-A2.7B is a small mixture-of-expert (MoE) model with only 2.7 billion activated parameters yet matches the performance of state-of-the-art 7B models like Mistral 7B and Qwen1.5-7B.
Qwen 1.5 MoE gallery image
Qwen 1.5 MoE gallery image
Free
Launch tags:Open Source•Artificial Intelligence•GitHub
Launch Team