DeepSeek-V2

model paper
DeepSeek
Massive 236B MoE model (21B active) that introduced Multi-head Latent Attention (MLA). Accompanied by a technical report.
GitHubHuggingFacePaper (arXiv)Artificial Analysis

Outputs 2

DeepSeek-V2

model
HuggingFace
Architecture MOE
Parameters 236B
Active params 21B
AA Intelligence 4

DeepSeek-V2 Technical Report

paper

Technical report detailing Multi-head Latent Attention and DeepSeekMoE architecture innovations.

Paper (arXiv)
Citations 102
arXiv HTML
moefrontieropen-weight