tiny-gpt-armenian
khachaturnalbandyan/tiny-gpt-armenian
A 10.8M-parameter GPT written from scratch in PyTorch and trained on Armenian Wikipedia in 8 minutes on a laptop GPU.
Summary
A small character-level GPT trained on Armenian Wikipedia, implemented in PyTorch with data preparation, training, sample outputs, and attention results. It is primarily an educational/demo project for Armenian language modeling.