armenian-poetry-gpt
TadevosMeliksetyan/armenian-poetry-gpt
Summary
A small GPT model trained from scratch to generate Armenian poetry in the style of poet Paruyr Sevak. The project documents a multi-stage training process (pretraining on Armenian prose, poetry, then fine-tuning on Sevak's work) and includes experiments with tokenizers (BPE) and comparisons to fine-tuned larger models like Gemma.