The largest publicly available language model: CTRL has 1.6B parameters and can be guided by control codes for style, content, and task-specific behavior.


code: https://github.com/salesforce/ctrl

article: https://einstein.ai/presentations/ctrl.pdf

https://blog.einstein.ai/introducing-a-conditional-transformer-language-model-for-controllable-generation/