bpe-tokenization

Browse 1 Armenian open source projects tagged with bpe-tokenization.

armenian-llm-hw1
AlexandrSurzhanskiy/armenian-llm-hw1

Decoder-only Armenian GPT trained from scratch on ArmWeb and Wikipedia corpora, with BPE tokenization, notebooks for ...

Jupyter Notebook Stars: 0