Input text
سنڌ جي تاريخ تمام قديم آهي. اڄ جو ڏينهن سٺو آهي، ۽ اسان ڪمپيوٽر ۽ انٽرنيٽ استعمال ڪريون ٿا.
91 characters, 19 words
Try an example
Quick start
Custom sizes
Without gated
All 18
CustomSindhi_32k
CustomSindhi_64k
CustomSindhi_100k
CustomSindhi_150k
SindhiLM_v1
SindhiLM_v2
SindhiLM_v3
FahadQazi_BPE
mBERT_Sindhi_Kashif786
TinyLlama_Sindhi_jamalimubashirali
hellosindh_SindhiBERT
hellosindh_SindhiBERT_NER
XLM-RoBERTa
mT5
Qwen2.5
BLOOM
Gemma3
Llama3.2
Compare tokenizers
Comparison
Token inspector
Diagnostics
Published benchmark
Methodology
Comparison
Token inspector
Diagnostics
Published benchmark
Methodology
Plot