OpenAI Codex Research Paper

OpenAI has released a research paper which details OpenAI Codex. Codex is the engine which powers the VS Code writing extension Github Copilot. I encourage you to read the research paper a few times on your own to understand how it works and how it was trained/fine tuned. Compared to most research papers, it’s not that bad of a read with mostly simple language.

Read →