Foundational work on parameter-efficient fine-tuning (PEFT), published in Nature 2023. Allows massive models to be updated with minimal data/compute.

Outputs 2

Delta Tuning Paper

paper

Venue: Nature 2023

OpenDelta Toolkit

library

GitHub Repository

trainingefficiencyresearchframework