PuzzleMoE: Efficient Compression of Large Mixture-of-Experts Models

PuzzleMoE is a project focused on the efficient compression of large mixture-of-experts models. This innovative approach aims to optimize the performance and resource utilization of AI models, making them more accessible and effective for various applications. For more details, visit the project page.