Main project paper for LLM-jp: a cross-organizational initiative for fully open Japanese LLMs. 81 authors. Covers the design of the v1.0 and v2.0 13B models, the llm-jp-corpus, tokenizer, and fine-tuning methodology. 2,600+ participants from 60+ universities and 200+ companies.

Model Details

Architecture DENSE
Parameters 13B

Paper

arXiv: 2407.03963

open-sourceopen-weightmultilingualresearch

Related