tiny-gpt-armenian

khachaturnalbandyan/tiny-gpt-armenian

A 10.8M-parameter GPT written from scratch in PyTorch and trained on Armenian Wikipedia in 8 minutes on a laptop GPU.

Python Stars: 0 Forks: 0 License: MIT Language/NLP

Summary

A small character-level GPT trained on Armenian Wikipedia, implemented in PyTorch with data preparation, training, sample outputs, and attention results. It is primarily an educational/demo project for Armenian language modeling.

Similar Projects