Things on this page are fragmentary and immature notes/thoughts of the author. Please read with your own judgement!
Code for the paper "Language Models are Unsupervised Multitask Learners"
The project huggingface/transfomer has implementation of transfomer based modles (such as GPT-2 ) .
References
https://openai.com/blog/better-language-models/
https://medium.com/@asierarranz/i-have-created-a-website-to-query-the-gpt-2-openai-model-11dd30e1c8b0
https://github.com/openai/gpt-2
TalkToTransformer is an online example of transformer-based sentence completion.
https://www.kdnuggets.com/2019/03/openai-gpt-2-model-hype-controversy.html
https://jaxenter.com/openai-releases-language-model-gpt-2-163881.html