LLM-jp (v1/v2)
modelMain project paper for LLM-jp: a cross-organizational initiative for fully open Japanese LLMs. 81 authors. Covers the design of the v1.0 and v2.0 13B models, the llm-jp-corpus, tokenizer, and fine-tuning methodology. 2,600+ participants from 60+ universities and 200+ companies.
Model Details
Architecture DENSE
Parameters 13B
Paper
arXiv: 2407.03963