LLaMA Pro

model
Tencent
Progressive LLaMA with block expansion, enabling post-pretraining domain knowledge injection without catastrophic forgetting. Published at ACL 2024.
Paper (arXiv)GitHubHuggingFace

Paper

arXiv: 2401.02415

Venue: ACL 2024

Library

GitHub Repository

nlptrainingresearch