CodeGen

Family of autoregressive code generation models from 350M to 16.1B parameters. Trained with multi-step paradigm: natural language → multilingual code → monolingual (Python) specialization.

Competitive with OpenAI Codex at release. Introduced the MTPB (Multi-Turn Programming Benchmark). ICLR 2023. By Nijkamp, Pang, Hayashi et al. Apache 2.0.