#

indic-tokenizer

Here are 2 public repositories matching this topic...

1322Guru / akshara-tokenizer

Akshara-aware tokenizer for six Brahmic scripts, with a trained SentencePiece model

Updated Aug 3, 2026
Python

manjumaigur / kpt

KPT: Kannada Pre-trained Transformer

nlp tokenizer gpt indic-languages gpt2 gpt3 indic-nlp llm indic-ai kannada-llm kannada-large-language-model indic-tokenizer kannada-nlp kannada-ai

Updated Jul 7, 2024
Python

Improve this page

Add a description, image, and links to the indic-tokenizer topic page so that developers can more easily learn about it.

Curate this topic

Add this topic to your repo

To associate your repository with the indic-tokenizer topic, visit your repo's landing page and select "manage topics."