Hugging Face's logo Hugging Face
  • Models
  • Datasets
  • Spaces
  • Buckets new
  • Docs
  • Enterprise
  • Pricing
    • Website
      • Tasks
      • HuggingChat
      • Collections
      • Languages
      • Organizations
    • Community
      • Blog
      • Posts
      • Daily Papers
      • Learn
      • Discord
      • Forum
      • GitHub
    • Solutions
      • Team & Enterprise
      • Hugging Face PRO
      • Enterprise Support
      • Inference Providers
      • Inference Endpoints
      • Storage Buckets

  • Log In
  • Sign Up
moonshotai 's Collections
Kimi K2.5
Kimi-K2
Kimi-Linear-A3B
Kimi-VL-A3B
Kimi-Audio-7B
Moonlight-A3B

Moonlight-A3B

updated Jan 27

Moonshot's Compute-efficient MoE LLM, first Scaling Up of Muon Optimizer

Upvote
12

  • moonshotai/Moonlight-16B-A3B-Instruct

    Text Generation • 16B • Updated Jan 30 • 98.8k • 193

  • moonshotai/Moonlight-16B-A3B

    Text Generation • 16B • Updated Jan 30 • 9.79k • 112

  • Muon is Scalable for LLM Training

    Paper • 2502.16982 • Published Feb 24, 2025 • 12
Upvote
12
  • Collection guide
  • Browse collections
Company
TOS Privacy About Careers
Website
Models Datasets Spaces Pricing Docs