Learn language from zero.

A tiny English model trained without a pretrained checkpoint. This first experiment learns which characters tend to follow one another.

Lab model 0.1 · Its output may be repetitive or nonsensical. The next milestone replaces this baseline with a small Transformer trained on Google Colab.