⭐️Fine-Tuning GPT-2 from Human Preferences

#OpenAI team fine-tuned 774M parameters model to achieve better scores in #summarization and stylistic text continuation in terms of human understanding.

Article definately worths reading (approx 15 min.) with Challenges and lessons learned section and examples.

Link: https://openai.com/blog/fine-tuning-gpt-2/
Paper: https://arxiv.org/abs/1909.08593
Code: https://github.com/openai/lm-human-preferences

#NLP #NLU #finetuning