Can not fine-tune the MobileLLM on Wikitext dataset
})
INFO | 2025-01-04 14:03:35 | autotrain.trainers.clm.utils:process_input_data:551 - Valid data: None
You are using the default legacy behaviour of the <class 'transformers.models.llama.tokenization_llama.LlamaTokenizer'>. This is expected, and simply means that the legacy (previous) behavior will be used so nothing changes for you. If you want to use the new behaviour, set legacy=False. This should only be set if you understand what it means, and thoroughly read the reason why this was added as explained in https://github.com/huggingface/transformers/pull/24565 - if you loaded a llama tokenizer from a GGUF file you can ignore this message
You are using the default legacy behaviour of the <class 'transformers.models.llama.tokenization_llama_fast.LlamaTokenizerFast'>. This is expected, and simply means that the legacy (previous) behavior will be used so nothing changes for you. If you want to use the new behaviour, set legacy=False. This should only be set if you understand what it means, and thoroughly read the reason why this was added as explained in https://github.com/huggingface/transformers/pull/24565 - if you loaded a llama tokenizer from a GGUF file you can ignore this message.
ERROR | 2025-01-04 14:03:36 | autotrain.trainers.common:wrapper:215 - train has failed due to an exception: Traceback (most recent call last):
File "/app/env/lib/python3.10/site-packages/autotrain/trainers/common.py", line 212, in wrapper
return func(*args, **kwargs)
File "/app/env/lib/python3.10/site-packages/autotrain/trainers/clm/main.py", line 28, in train
train_sft(config)
File "/app/env/lib/python3.10/site-packages/autotrain/trainers/clm/train_clm_sft.py", line 15, in train
tokenizer = utils.get_tokenizer(config)
File "/app/env/lib/python3.10/site-packages/autotrain/trainers/clm/utils.py", line 595, in get_tokenizer
if tokenizer.chat_template is None:
AttributeError: 'bool' object has no attribute 'chat_template'
ERROR | 2025-01-04 14:03:36 | autotrain.trainers.common:wrapper:216 - 'bool' object has no attribute 'chat_template'
INFO | 2025-01-04 14:03:36 | autotrain.trainers.common:pause_space:156 - Pausing space...