Doubao-1.5-Pro

Sparse MoE model (200B total, 20B active, 256 experts with 8 active per token) with a 256k context window. Part of ByteDance's flagship Doubao series.