Large scale finetuning

Tools & Frameworks

• https://huggingface.co/docs/trl/index

References

• https://huggingface.co/blog/peft
• https://medium.com/@sinarya.114/d-p-o-vs-r-l-h-f-a-battle-for-fine-tuning-supremacy-in-language-models-04b273e7a173