The GPT-2 Model in NLP

Things on this page are fragmentary and immature notes/thoughts of the author. Please read with your own judgement!

Code for the paper “Language Models are Unsupervised Multitask Learners”

The project huggingface/transfomer has implementation of transfomer based modles (such as GPT-2 ) .

Fine Tune the GPT-2 Model

References¶

https://openai.com/blog/better-language-models/

https://medium.com/asierarranz/i-have-created-a-website-to-query-the-gpt-2-openai-model-11dd30e1c8b0

https://github.com/openai/gpt-2

TalkToTransformer is an online example of transformer-based sentence completion.

https://www.kdnuggets.com/2019/03/openai-gpt-2-model-hype-controversy.html

https://jaxenter.com/openai-releases-language-model-gpt-2-163881.html

Giant Language model Test Room