GPyT (Generative Python Transformer)

A GPT-2 model trained from scratch on Python code.

GPyT Model

Line by Line Python code training data

Sample training data for Python code. Actual newline characters are replaced by <N>

Python Code Training Data