The GPT-2 Model in NLP
Things on this page are fragmentary and immature notes/thoughts of the author. Please read with your own judgement!
Code for the paper “Language Models are Unsupervised Multitask Learners”
The project
huggingface/transfomer
has implementation of transformer based models
(such as
GPT-2
)
.
Fine Tune the GPT-2 Model
References¶
https://openai.com/blog/better-language-models/
https://medium.com/@asierarranz/i-have-created-a-website-to-query-the-gpt-2-openai-model-11dd30e1c8b0
https://github.com/openai/gpt-2
TalkToTransformer is an online example of transformer-based sentence completion.
https://www.kdnuggets.com/2019/03/openai-gpt-2-model-hype-controversy.html
https://jaxenter.com/openai-releases-language-model-gpt-2-163881.html
Giant Language model Test Room