karpathy / karpathy/makemore

Used makemore to build a cursive handwriting model

Open
#27 2 comments 8 reactions 0 assignees View on GitHub
Dominant language
Python
Stars
4.3k
Forks
1.1k
PR merge metrics
No merged PRs in 30d

Description

Hi Andrej,

I wanted to share that, with a few judicious modifications to the Transformer code in makemore.py (in particular, a custom tokenizer as shown in the image + cross attention for ascii characters), I was able to train a rather high-quality pen-stroke cursive generation model.

[Blog post](https://greydanus.github.io/2025/03/30/cursive-transformer/)

Thanks for writing the makemore + mingpt + nanogpt repos; they are wonderful, minimalist starting points for this kind of light exploratory research/hobby project.

Image

Image

Contributor guide

No contributing guide indexed for this repository

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.