560B MoE model for formal theorem proving in Lean4. Achieved 97.1% pass rate on MiniF2F-Test.

Model Details

Architecture MOE
Parameters 560B
Active params 27B
reasoningmoe

Related