A Huggingface software package that provides tools for training models varying access to compute capability. This includes multi-gpu setups, TPU setups or constrained GPU setups.
Usage
Accelerate is quite low level software and advises:
You shouldn’t use 🤗 Accelerate if you don’t want to write a training loop yourself. There are plenty of high-level libraries above PyTorch that will offer you that, 🤗 Accelerate is not one of them.
Some of the higher-level frameworks that use accelerate include axolotl.