How to use wikilangs/diq with fastText:
from huggingface_hub import hf_hub_download import fasttext model = fasttext.load_model(hf_hub_download("wikilangs/diq", "model.bin"))
https://huggingface.co/wikilangs/diq/resolve/main/visualizations/tokenizer_total_tokens.png
hf download hf://wikilangs/diq/visualizations/tokenizer_total_tokens.png
curl -L -o tokenizer_total_tokens.png https://huggingface.co/wikilangs/diq/resolve/main/visualizations/tokenizer_total_tokens.png
