Add missing tokenizer files
#2
by Xenova HF Staff - opened
So now we can use AutoTokenizer.from_pretrained('minishlab/M2V_base_output')
Nice, thanks! We're going to add this by default in version 1.0.0, but this is nice as a manual work-around.
stephantulkens changed pull request status to merged