Amharic-Tokenizer

Syllable-aware BPE tokenizer for the Amharic language (አማርኛ) – fast, accurate, trainable.

What is Amharic-Tokenizer?

Syllable-aware BPE tokenizer for the Amharic language (አማርኛ) – fast, accurate, trainable.