Comments (5)
sanbuphy
commented on July 20, 2024
Using unk_token, but it is not set yet. same question in qwen2 inference:
[33m[2024-06-13 23:21:55,506] [ WARNING]�[0m - if you run ring_flash_attention.py, please ensure you install the paddlenlp_ops by following the instructions provided at https://github.com/PaddlePaddle/PaddleNLP/blob/develop/csrc/README.md�[0m
�[32m[2024-06-13 23:21:56,948] [ INFO]�[0m - We are using <class 'paddlenlp.transformers.qwen2.tokenizer.Qwen2Tokenizer'> to load 'Qwen/Qwen2-7B-Instruct'.�[0m
�[31m[2024-06-13 23:21:57,310] [ ERROR]�[0m - Using unk_token, but it is not set yet.�[0m
�[31m[2024-06-13 23:21:57,310] [ ERROR]�[0m - Using unk_token, but it is not set yet.�[0m
�[31m[2024-06-13 23:21:57,310] [ ERROR]�[0m - Using unk_token, but it is not set yet.�[0m
�[31m[2024-06-13 23:21:57,310] [ ERROR]�[0m - Using unk_token, but it is not set yet.�[0m
�[31m[2024-06-13 23:21:57,310] [ ERROR]�[0m - Using unk_token, but it is not set yet.�[0m
�[31m[2024-06-13 23:21:57,310] [ ERROR]�[0m - Using unk_token, but it is not set yet.�[0m
�[31m[2024-06-13 23:21:57,310] [ ERROR]�[0m - Using unk_token, but it is not set yet.�[0m
�[31m[2024-06-13 23:21:57,310] [ ERROR]�[0m - Using unk_token, but it is not set yet.�[0m
�[32m[2024-06-13 23:21:57,311] [ INFO]�[0m - We are using <class 'paddlenlp.transformers.qwen2.configuration.Qwen2Config'> to load 'Qwen/Qwen2-7B-Instruct'.�[0m
�[32m[2024-06-13 23:21:57,311] [ INFO]�[0m - Loading configuration file /home/aistudio/.paddlenlp/models/Qwen/Qwen2-7B-Instruct/config.json�[0m
�[32m[2024-06-13 23:21:57,312] [ INFO]�[0m - We are using <class 'paddlenlp.transformers.qwen2.modeling.Qwen2ForCausalLM'> to load 'Qwen/Qwen2-7B-Instruct'.�[0m
�[32m[2024-06-13 23:21:57,312] [ INFO]�[0m - Loading configuration file /home/aistudio/.paddlenlp/models/Qwen/Qwen2-7B-Instruct/config.json�[0m
�[32m[2024-06-13 23:21:57,313] [ INFO]�[0m - Loading weights file from cache at /home/aistudio/.paddlenlp/models/Qwen/Qwen2-7B-Instruct/model.safetensors.index.json�[0m
Downloading shards: 100%|██████████████████████| 4/4 [00:00<00:00, 26255.42it/s]
W0613 23:21:57.318940 134458 gpu_resources.cc:119] Please NOTE: device: 0, GPU Compute Capability: 7.0, Driver API Version: 12.0, Runtime API Version: 11.8
W0613 23:21:57.320240 134458 gpu_resources.cc:164] device: 0, cuDNN Version: 8.9.
Loading checkpoint shards: 100%|██████████████████| 4/4 [03:18<00:00, 49.74s/it]
�[32m[2024-06-13 23:25:34,697] [ INFO]�[0m - All model checkpoint weights were used when initializing Qwen2ForCausalLM.
�[0m
�[32m[2024-06-13 23:25:34,697] [ INFO]�[0m - All the weights of Qwen2ForCausalLM were initialized from the model checkpoint at Qwen/Qwen2-7B-Instruct.
If your task is similar to the task the model of the checkpoint was trained on, you can already use Qwen2ForCausalLM for predictions without further training.�[0m
�[32m[2024-06-13 23:25:34,700] [ INFO]�[0m - Loading configuration file /home/aistudio/.paddlenlp/models/Qwen/Qwen2-7B-Instruct/generation_config.json�[0m
�[32m[2024-06-13 23:25:34,700] [ INFO]�[0m - Generation config file not found, using a generation config created from the model config.�[0m
�[32m[2024-06-13 23:25:34,701] [ INFO]�[0m - We are using <class 'paddlenlp.transformers.qwen2.configuration.Qwen2Config'> to load 'Qwen/Qwen2-7B-Instruct'.�[0m
�[32m[2024-06-13 23:25:34,701] [ INFO]�[0m - Loading configuration file /home/aistudio/.paddlenlp/models/Qwen/Qwen2-7B-Instruct/config.json�[0m
�[32m[2024-06-13 23:25:34,701] [ INFO]�[0m - Loading configuration file /home/aistudio/.paddlenlp/models/Qwen/Qwen2-7B-Instruct/generation_config.json�[0m
�[33m[2024-06-13 23:25:34,702] [ WARNING]�[0m - Can't find generation config, so it will not use generation_config field in the model config�[0m
�[32m[2024-06-13 23:25:34,703] [ INFO]�[0m - Start predict�[0m
�[31m[2024-06-13 23:25:48,343] [ ERROR]�[0m - Using unk_token, but it is not set yet.�[0m
�[31m[2024-06-13 23:25:48,343] [ ERROR]�[0m - Using unk_token, but it is not set yet.�[0m
�[31m[2024-06-13 23:25:48,343] [ ERROR]�[0m - Using unk_token, but it is not set yet.�[0m
�[31m[2024-06-13 23:25:48,343] [ ERROR]�[0m - Using unk_token, but it is not set yet.�[0m
�[31m[2024-06-13 23:25:48,343] [ ERROR]�[0m - Using unk_token, but it is not set yet.�[0m
�[31m[2024-06-13 23:25:48,343] [ ERROR]�[0m - Using unk_token, but it is not set yet.�[0m
�[31m[2024-06-13 23:25:48,343] [ ERROR]�[0m - Using unk_token, but it is not set yet.�[0m
�[31m[2024-06-13 23:25:48,344] [ ERROR]�[0m - Using unk_token, but it is not set yet.�[0m
�[31m[2024-06-13 23:25:48,344] [ ERROR]�[0m - Using unk_token, but it is not set yet.�[0m
�[31m[2024-06-13 23:25:48,344] [ ERROR]�[0m - Using unk_token, but it is not set yet.�[0m
�[31m[2024-06-13 23:25:48,344] [ ERROR]�[0m - Using unk_token, but it is not set yet.�[0m
�[31m[2024-06-13 23:25:48,344] [ ERROR]�[0m - Using unk_token, but it is not set yet.�[0m
�[31m[2024-06-13 23:25:48,344] [ ERROR]�[0m - Using unk_token, but it is not set yet.�[0m
�[31m[2024-06-13 23:25:48,344] [ ERROR]�[0m - Using unk_token, but it is not set yet.�[0m
�[31m[2024-06-13 23:25:48,344] [ ERROR]�[0m - Using unk_token, but it is not set yet.�[0m
�[31m[2024-06-13 23:25:48,344] [ ERROR]�[0m - Using unk_token, but it is not set yet.�[0m
�[31m[2024-06-13 23:25:48,344] [ ERROR]�[0m - Using unk_token, but it is not set yet.�[0m
�[31m[2024-06-13 23:25:48,344] [ ERROR]�[0m - Using unk_token, but it is not set yet.�[0m
�[31m[2024-06-13 23:25:48,344] [ ERROR]�[0m - Using unk_token, but it is not set yet.�[0m
�[31m[2024-06-13 23:25:48,344] [ ERROR]�[0m - Using unk_token, but it is not set yet.�[0m
�[31m[2024-06-13 23:25:48,345] [ ERROR]�[0m - Using unk_token, but it is not set yet.�[0m
�[31m[2024-06-13 23:25:48,345] [ ERROR]�[0m - Using unk_token, but it is not set yet.�[0m
�[31m[2024-06-13 23:25:48,345] [ ERROR]�[0m - Using unk_token, but it is not set yet.�[0m
�[31m[2024-06-13 23:25:48,345] [ ERROR]�[0m - Using unk_token, but it is not set yet.�[0m
�[31m[2024-06-13 23:25:48,345] [ ERROR]�[0m - Using unk_token, but it is not set yet.�[0m
�[31m[2024-06-13 23:25:48,345] [ ERROR]�[0m - Using unk_token, but it is not set yet.�[0m
�[31m[2024-06-13 23:25:48,345] [ ERROR]�[0m - Using unk_token, but it is not set yet.�[0m
�[31m[2024-06-13 23:25:48,345] [ ERROR]�[0m - Using unk_token, but it is not set yet.�[0m
�[31m[2024-06-13 23:25:48,345] [ ERROR]�[0m - Using unk_token, but it is not set yet.�[0m
�[31m[2024-06-13 23:25:48,345] [ ERROR]�[0m - Using unk_token, but it is not set yet.�[0m
�[31m[2024-06-13 23:25:48,345] [ ERROR]�[0m - Using unk_token, but it is not set yet.�[0m
�[31m[2024-06-13 23:25:48,345] [ ERROR]�[0m - Using unk_token, but it is not set yet.�[0m
�[31m[2024-06-13 23:25:48,345] [ ERROR]�[0m - Using unk_token, but it is not set yet.�[0m
�[31m[2024-06-13 23:25:48,345] [ ERROR]�[0m - Using unk_token, but it is not set yet.�[0m
�[31m[2024-06-13 23:25:48,346] [ ERROR]�[0m - Using unk_token, but it is not set yet.�[0m
�[31m[2024-06-13 23:25:48,346] [ ERROR]�[0m - Using unk_token, but it is not set yet.�[0m
�[31m[2024-06-13 23:25:48,346] [ ERROR]�[0m - Using unk_token, but it is not set yet.�[0m
�[31m[2024-06-13 23:25:48,346] [ ERROR]�[0m - Using unk_token, but it is not set yet.�[0m
�[31m[2024-06-13 23:25:48,346] [ ERROR]�[0m - Using unk_token, but it is not set yet.�[0m
�[31m[2024-06-13 23:25:48,346] [ ERROR]�[0m - Using unk_token, but it is not set yet.�[0m
�[31m[2024-06-13 23:25:48,346] [ ERROR]�[0m - Using unk_token, but it is not set yet.�[0m
�[31m[2024-06-13 23:25:48,346] [ ERROR]�[0m - Using unk_token, but it is not set yet.�[0m
�[31m[2024-06-13 23:25:48,346] [ ERROR]�[0m - Using unk_token, but it is not set yet.�[0m
�[31m[2024-06-13 23:25:48,346] [ ERROR]�[0m - Using unk_token, but it is not set yet.�[0m
�[31m[2024-06-13 23:25:48,346] [ ERROR]�[0m - Using unk_token, but it is not set yet.�[0m
�[31m[2024-06-13 23:25:48,346] [ ERROR]�[0m - Using unk_token, but it is not set yet.�[0m
�[31m[2024-06-13 23:25:48,346] [ ERROR]�[0m - Using unk_token, but it is not set yet.�[0m
�[31m[2024-06-13 23:25:48,347] [ ERROR]�[0m - Using unk_token, but it is not set yet.�[0m
�[31m[2024-06-13 23:25:48,347] [ ERROR]�[0m - Using unk_token, but it is not set yet.�[0m
�[31m[2024-06-13 23:25:48,347] [ ERROR]�[0m - Using unk_token, but it is not set yet.�[0m
�[31m[2024-06-13 23:25:48,347] [ ERROR]�[0m - Using unk_token, but it is not set yet.�[0m
�[31m[2024-06-13 23:25:48,347] [ ERROR]�[0m - Using unk_token, but it is not set yet.�[0m
�[31m[2024-06-13 23:25:48,347] [ ERROR]�[0m - Using unk_token, but it is not set yet.�[0m
�[31m[2024-06-13 23:25:48,347] [ ERROR]�[0m - Using unk_token, but it is not set yet.�[0m
�[31m[2024-06-13 23:25:48,347] [ ERROR]�[0m - Using unk_token, but it is not set yet.�[0m
�[31m[2024-06-13 23:25:48,347] [ ERROR]�[0m - Using unk_token, but it is not set yet.�[0m
�[31m[2024-06-13 23:25:48,347] [ ERROR]�[0m - Using unk_token, but it is not set yet.�[0m
�[31m[2024-06-13 23:25:48,347] [ ERROR]�[0m - Using unk_token, but it is not set yet.�[0m
�[31m[2024-06-13 23:25:48,347] [ ERROR]�[0m - Using unk_token, but it is not set yet.�[0m
�[31m[2024-06-13 23:25:48,347] [ ERROR]�[0m - Using unk_token, but it is not set yet.�[0m
�[31m[2024-06-13 23:25:48,347] [ ERROR]�[0m - Using unk_token, but it is not set yet.�[0m
�[31m[2024-06-13 23:25:48,347] [ ERROR]�[0m - Using unk_token, but it is not set yet.�[0m
�[31m[2024-06-13 23:25:48,348] [ ERROR]�[0m - Using unk_token, but it is not set yet.�[0m
�[31m[2024-06-13 23:25:48,348] [ ERROR]�[0m - Using unk_token, but it is not set yet.�[0m
�[31m[2024-06-13 23:25:48,348] [ ERROR]�[0m - Using unk_token, but it is not set yet.�[0m
�[31m[2024-06-13 23:25:48,348] [ ERROR]�[0m - Using unk_token, but it is not set yet.�[0m
�[31m[2024-06-13 23:25:48,348] [ ERROR]�[0m - Using unk_token, but it is not set yet.�[0m
�[31m[2024-06-13 23:25:48,348] [ ERROR]�[0m - Using unk_token, but it is not set yet.�[0m
�[31m[2024-06-13 23:25:48,348] [ ERROR]�[0m - Using unk_token, but it is not set yet.�[0m
�[31m[2024-06-13 23:25:48,348] [ ERROR]�[0m - Using unk_token, but it is not set yet.�[0m
�[31m[2024-06-13 23:25:48,348] [ ERROR]�[0m - Using unk_token, but it is not set yet.�[0m
�[31m[2024-06-13 23:25:48,348] [ ERROR]�[0m - Using unk_token, but it is not set yet.�[0m
�[31m[2024-06-13 23:25:48,348] [ ERROR]�[0m - Using unk_token, but it is not set yet.�[0m
�[31m[2024-06-13 23:25:48,348] [ ERROR]�[0m - Using unk_token, but it is not set yet.�[0m
�[31m[2024-06-13 23:25:48,348] [ ERROR]�[0m - Using unk_token, but it is not set yet.�[0m
�[31m[2024-06-13 23:25:48,348] [ ERROR]�[0m - Using unk_token, but it is not set yet.�[0m
�[31m[2024-06-13 23:25:48,349] [ ERROR]�[0m - Using unk_token, but it is not set yet.�[0m
�[31m[2024-06-13 23:25:48,349] [ ERROR]�[0m - Using unk_token, but it is not set yet.�[0m
�[31m[2024-06-13 23:25:48,349] [ ERROR]�[0m - Using unk_token, but it is not set yet.�[0m
�[31m[2024-06-13 23:25:48,349] [ ERROR]�[0m - Using unk_token, but it is not set yet.�[0m
�[31m[2024-06-13 23:25:48,349] [ ERROR]�[0m - Using unk_token, but it is not set yet.�[0m
�[31m[2024-06-13 23:25:48,349] [ ERROR]�[0m - Using unk_token, but it is not set yet.�[0m
�[31m[2024-06-13 23:25:48,349] [ ERROR]�[0m - Using unk_token, but it is not set yet.�[0m
�[31m[2024-06-13 23:25:48,349] [ ERROR]�[0m - Using unk_token, but it is not set yet.�[0m
�[31m[2024-06-13 23:25:48,349] [ ERROR]�[0m - Using unk_token, but it is not set yet.�[0m
�[31m[2024-06-13 23:25:48,349] [ ERROR]�[0m - Using unk_token, but it is not set yet.�[0m
�[31m[2024-06-13 23:25:48,349] [ ERROR]�[0m - Using unk_token, but it is not set yet.�[0m
�[31m[2024-06-13 23:25:48,349] [ ERROR]�[0m - Using unk_token, but it is not set yet.�[0m
�[31m[2024-06-13 23:25:48,349] [ ERROR]�[0m - Using unk_token, but it is not set yet.�[0m
�[31m[2024-06-13 23:25:48,349] [ ERROR]�[0m - Using unk_token, but it is not set yet.�[0m
�[31m[2024-06-13 23:25:48,350] [ ERROR]�[0m - Using unk_token, but it is not set yet.�[0m
�[31m[2024-06-13 23:25:48,350] [ ERROR]�[0m - Using unk_token, but it is not set yet.�[0m
�[31m[2024-06-13 23:25:48,350] [ ERROR]�[0m - Using unk_token, but it is not set yet.�[0m
�[31m[2024-06-13 23:25:48,350] [ ERROR]�[0m - Using unk_token, but it is not set yet.�[0m
�[31m[2024-06-13 23:25:48,350] [ ERROR]�[0m - Using unk_token, but it is not set yet.�[0m
�[31m[2024-06-13 23:25:48,350] [ ERROR]�[0m - Using unk_token, but it is not set yet.�[0m
�[31m[2024-06-13 23:25:48,350] [ ERROR]�[0m - Using unk_token, but it is not set yet.�[0m
�[31m[2024-06-13 23:25:48,350] [ ERROR]�[0m - Using unk_token, but it is not set yet.�[0m
�[31m[2024-06-13 23:25:48,350] [ ERROR]�[0m - Using unk_token, but it is not set yet.�[0m
�[31m[2024-06-13 23:25:48,350] [ ERROR]�[0m - Using unk_token, but it is not set yet.�[0m
�[31m[2024-06-13 23:25:48,350] [ ERROR]�[0m - Using unk_token, but it is not set yet.�[0m
�[31m[2024-06-13 23:25:48,350] [ ERROR]�[0m - Using unk_token, but it is not set yet.�[0m
�[31m[2024-06-13 23:25:48,350] [ ERROR]�[0m - Using unk_token, but it is not set yet.�[0m
�[31m[2024-06-13 23:25:48,350] [ ERROR]�[0m - Using unk_token, but it is not set yet.�[0m
�[31m[2024-06-13 23:25:48,350] [ ERROR]�[0m - Using unk_token, but it is not set yet.�[0m
�[31m[2024-06-13 23:25:48,351] [ ERROR]�[0m - Using unk_token, but it is not set yet.�[0m
�[31m[2024-06-13 23:25:48,351] [ ERROR]�[0m - Using unk_token, but it is not set yet.�[0m
�[31m[2024-06-13 23:25:48,351] [ ERROR]�[0m - Using unk_token, but it is not set yet.�[0m
�[31m[2024-06-13 23:25:48,351] [ ERROR]�[0m - Using unk_token, but it is not set yet.�[0m
�[31m[2024-06-13 23:25:48,351] [ ERROR]�[0m - Using unk_token, but it is not set yet.�[0m
�[31m[2024-06-13 23:25:48,351] [ ERROR]�[0m - Using unk_token, but it is not set yet.�[0m
�[31m[2024-06-13 23:25:48,351] [ ERROR]�[0m - Using unk_token, but it is not set yet.�[0m
�[31m[2024-06-13 23:25:48,351] [ ERROR]�[0m - Using unk_token, but it is not set yet.�[0m
�[31m[2024-06-13 23:25:48,351] [ ERROR]�[0m - Using unk_token, but it is not set yet.�[0m
�[31m[2024-06-13 23:25:48,351] [ ERROR]�[0m - Using unk_token, but it is not set yet.�[0m
�[31m[2024-06-13 23:25:48,351] [ ERROR]�[0m - Using unk_token, but it is not set yet.�[0m
�[31m[2024-06-13 23:25:48,351] [ ERROR]�[0m - Using unk_token, but it is not set yet.�[0m
�[31m[2024-06-13 23:25:48,351] [ ERROR]�[0m - Using unk_token, but it is not set yet.�[0m
�[31m[2024-06-13 23:25:48,351] [ ERROR]�[0m - Using unk_token, but it is not set yet.�[0m
�[31m[2024-06-13 23:25:48,351] [ ERROR]�[0m - Using unk_token, but it is not set yet.�[0m
�[31m[2024-06-13 23:25:48,352] [ ERROR]�[0m - Using unk_token, but it is not set yet.�[0m
�[31m[2024-06-13 23:25:48,352] [ ERROR]�[0m - Using unk_token, but it is not set yet.�[0m
�[31m[2024-06-13 23:25:48,352] [ ERROR]�[0m - Using unk_token, but it is not set yet.�[0m
�[31m[2024-06-13 23:25:48,352] [ ERROR]�[0m - Using unk_token, but it is not set yet.�[0m
�[31m[2024-06-13 23:25:48,352] [ ERROR]�[0m - Using unk_token, but it is not set yet.�[0m
�[31m[2024-06-13 23:25:48,352] [ ERROR]�[0m - Using unk_token, but it is not set yet.�[0m
�[31m[2024-06-13 23:25:48,352] [ ERROR]�[0m - Using unk_token, but it is not set yet.�[0m
�[31m[2024-06-13 23:25:48,352] [ ERROR]�[0m - Using unk_token, but it is not set yet.�[0m
�[31m[2024-06-13 23:25:48,352] [ ERROR]�[0m - Using unk_token, but it is not set yet.�[0m
�[31m[2024-06-13 23:25:48,352] [ ERROR]�[0m - Using unk_token, but it is not set yet.�[0m
�[31m[2024-06-13 23:25:48,352] [ ERROR]�[0m - Using unk_token, but it is not set yet.�[0m
�[31m[2024-06-13 23:25:48,352] [ ERROR]�[0m - Using unk_token, but it is not set yet.�[0m
�[31m[2024-06-13 23:25:48,352] [ ERROR]�[0m - Using unk_token, but it is not set yet.�[0m
�[31m[2024-06-13 23:25:48,352] [ ERROR]�[0m - Using unk_token, but it is not set yet.�[0m
�[31m[2024-06-13 23:25:48,353] [ ERROR]�[0m - Using unk_token, but it is not set yet.�[0m
�[31m[2024-06-13 23:25:48,353] [ ERROR]�[0m - Using unk_token, but it is not set yet.�[0m
�[31m[2024-06-13 23:25:48,353] [ ERROR]�[0m - Using unk_token, but it is not set yet.�[0m
�[31m[2024-06-13 23:25:48,353] [ ERROR]�[0m - Using unk_token, but it is not set yet.�[0m
�[31m[2024-06-13 23:25:48,353] [ ERROR]�[0m - Using unk_token, but it is not set yet.�[0m
�[31m[2024-06-13 23:25:48,353] [ ERROR]�[0m - Using unk_token, but it is not set yet.�[0m
�[31m[2024-06-13 23:25:48,353] [ ERROR]�[0m - Using unk_token, but it is not set yet.�[0m
�[31m[2024-06-13 23:25:48,353] [ ERROR]�[0m - Using unk_token, but it is not set yet.�[0m
�[31m[2024-06-13 23:25:48,353] [ ERROR]�[0m - Using unk_token, but it is not set yet.�[0m
�[31m[2024-06-13 23:25:48,353] [ ERROR]�[0m - Using unk_token, but it is not set yet.�[0m
�[31m[2024-06-13 23:25:48,353] [ ERROR]�[0m - Using unk_token, but it is not set yet.�[0m
�[31m[2024-06-13 23:25:48,353] [ ERROR]�[0m - Using unk_token, but it is not set yet.�[0m
�[31m[2024-06-13 23:25:48,353] [ ERROR]�[0m - Using unk_token, but it is not set yet.�[0m
�[31m[2024-06-13 23:25:48,353] [ ERROR]�[0m - Using unk_token, but it is not set yet.�[0m
�[31m[2024-06-13 23:25:48,353] [ ERROR]�[0m - Using unk_token, but it is not set yet.�[0m
�[31m[2024-06-13 23:25:48,354] [ ERROR]�[0m - Using unk_token, but it is not set yet.�[0m
�[31m[2024-06-13 23:25:48,354] [ ERROR]�[0m - Using unk_token, but it is not set yet.�[0m
�[31m[2024-06-13 23:25:48,354] [ ERROR]�[0m - Using unk_token, but it is not set yet.�[0m
�[31m[2024-06-13 23:25:48,354] [ ERROR]�[0m - Using unk_token, but it is not set yet.�[0m
�[31m[2024-06-13 23:25:48,354] [ ERROR]�[0m - Using unk_token, but it is not set yet.�[0m
�[31m[2024-06-13 23:25:48,354] [ ERROR]�[0m - Using unk_token, but it is not set yet.�[0m
�[31m[2024-06-13 23:25:48,354] [ ERROR]�[0m - Using unk_token, but it is not set yet.�[0m
�[31m[2024-06-13 23:25:48,354] [ ERROR]�[0m - Using unk_token, but it is not set yet.�[0m
�[31m[2024-06-13 23:25:48,354] [ ERROR]�[0m - Using unk_token, but it is not set yet.�[0m
�[31m[2024-06-13 23:25:48,354] [ ERROR]�[0m - Using unk_token, but it is not set yet.�[0m
�[31m[2024-06-13 23:25:48,354] [ ERROR]�[0m - Using unk_token, but it is not set yet.�[0m
�[31m[2024-06-13 23:25:48,354] [ ERROR]�[0m - Using unk_token, but it is not set yet.�[0m
�[31m[2024-06-13 23:25:48,354] [ ERROR]�[0m - Using unk_token, but it is not set yet.�[0m
�[31m[2024-06-13 23:25:48,354] [ ERROR]�[0m - Using unk_token, but it is not set yet.�[0m
�[31m[2024-06-13 23:25:48,354] [ ERROR]�[0m - Using unk_token, but it is not set yet.�[0m
�[31m[2024-06-13 23:25:48,355] [ ERROR]�[0m - Using unk_token, but it is not set yet.�[0m
�[31m[2024-06-13 23:25:48,355] [ ERROR]�[0m - Using unk_token, but it is not set yet.�[0m
�[31m[2024-06-13 23:25:48,355] [ ERROR]�[0m - Using unk_token, but it is not set yet.�[0m
�[31m[2024-06-13 23:25:48,355] [ ERROR]�[0m - Using unk_token, but it is not set yet.�[0m
�[31m[2024-06-13 23:25:48,355] [ ERROR]�[0m - Using unk_token, but it is not set yet.�[0m
�[31m[2024-06-13 23:25:48,355] [ ERROR]�[0m - Using unk_token, but it is not set yet.�[0m
�[31m[2024-06-13 23:25:48,355] [ ERROR]�[0m - Using unk_token, but it is not set yet.�[0m
�[31m[2024-06-13 23:25:48,355] [ ERROR]�[0m - Using unk_token, but it is not set yet.�[0m
�[31m[2024-06-13 23:25:48,355] [ ERROR]�[0m - Using unk_token, but it is not set yet.�[0m
�[31m[2024-06-13 23:25:48,355] [ ERROR]�[0m - Using unk_token, but it is not set yet.�[0m
�[31m[2024-06-13 23:25:48,355] [ ERROR]�[0m - Using unk_token, but it is not set yet.�[0m
�[31m[2024-06-13 23:25:48,355] [ ERROR]�[0m - Using unk_token, but it is not set yet.�[0m
�[31m[2024-06-13 23:25:48,355] [ ERROR]�[0m - Using unk_token, but it is not set yet.�[0m
�[31m[2024-06-13 23:25:48,355] [ ERROR]�[0m - Using unk_token, but it is not set yet.�[0m
�[31m[2024-06-13 23:25:48,356] [ ERROR]�[0m - Using unk_token, but it is not set yet.�[0m
�[31m[2024-06-13 23:25:48,356] [ ERROR]�[0m - Using unk_token, but it is not set yet.�[0m
�[31m[2024-06-13 23:25:48,356] [ ERROR]�[0m - Using unk_token, but it is not set yet.�[0m
�[31m[2024-06-13 23:25:48,356] [ ERROR]�[0m - Using unk_token, but it is not set yet.�[0m
�[31m[2024-06-13 23:25:48,356] [ ERROR]�[0m - Using unk_token, but it is not set yet.�[0m
�[31m[2024-06-13 23:25:48,356] [ ERROR]�[0m - Using unk_token, but it is not set yet.�[0m
�[31m[2024-06-13 23:25:48,356] [ ERROR]�[0m - Using unk_token, but it is not set yet.�[0m
�[31m[2024-06-13 23:25:48,356] [ ERROR]�[0m - Using unk_token, but it is not set yet.�[0m
�[31m[2024-06-13 23:25:48,356] [ ERROR]�[0m - Using unk_token, but it is not set yet.�[0m
�[31m[2024-06-13 23:25:48,356] [ ERROR]�[0m - Using unk_token, but it is not set yet.�[0m
�[31m[2024-06-13 23:25:48,356] [ ERROR]�[0m - Using unk_token, but it is not set yet.�[0m
�[31m[2024-06-13 23:25:48,356] [ ERROR]�[0m - Using unk_token, but it is not set yet.�[0m
�[31m[2024-06-13 23:25:48,356] [ ERROR]�[0m - Using unk_token, but it is not set yet.�[0m
�[31m[2024-06-13 23:25:48,357] [ ERROR]�[0m - Using unk_token, but it is not set yet.�[0m
�[31m[2024-06-13 23:25:48,357] [ ERROR]�[0m - Using unk_token, but it is not set yet.�[0m
�[31m[2024-06-13 23:25:48,357] [ ERROR]�[0m - Using unk_token, but it is not set yet.�[0m
�[31m[2024-06-13 23:25:48,357] [ ERROR]�[0m - Using unk_token, but it is not set yet.�[0m
�[31m[2024-06-13 23:25:48,357] [ ERROR]�[0m - Using unk_token, but it is not set yet.�[0m
�[31m[2024-06-13 23:25:48,357] [ ERROR]�[0m - Using unk_token, but it is not set yet.�[0m
�[31m[2024-06-13 23:25:48,357] [ ERROR]�[0m - Using unk_token, but it is not set yet.�[0m
Traceback (most recent call last):
File "/home/aistudio/work/PaddleNLP/llm/predictor.py", line 1651, in <module>
predict()
File "/home/aistudio/work/PaddleNLP/llm/predictor.py", line 1596, in predict
outputs = predictor.predict(batch_source_text)
File "/home/aistudio/work/PaddleNLP/llm/predictor.py", line 253, in predict
decoded_predictions = self._postprocess(predictions)
File "/home/aistudio/work/PaddleNLP/llm/predictor.py", line 245, in _postprocess
decoded_predictions = self.tokenizer.batch_decode(
File "/opt/conda/envs/python35-paddle120-env/lib/python3.10/site-packages/paddlenlp/transformers/tokenizer_utils_base.py", line 3200, in batch_decode
return [
File "/opt/conda/envs/python35-paddle120-env/lib/python3.10/site-packages/paddlenlp/transformers/tokenizer_utils_base.py", line 3201, in <listcomp>
self.decode(
File "/opt/conda/envs/python35-paddle120-env/lib/python3.10/site-packages/paddlenlp/transformers/tokenizer_utils_base.py", line 3239, in decode
return self._decode(
File "/opt/conda/envs/python35-paddle120-env/lib/python3.10/site-packages/paddlenlp/transformers/qwen2/tokenizer.py", line 294, in _decode
return super()._decode(
File "/opt/conda/envs/python35-paddle120-env/lib/python3.10/site-packages/paddlenlp/transformers/tokenizer_utils.py", line 1842, in _decode
sub_texts.append(self.convert_tokens_to_string(current_sub_text))
File "/opt/conda/envs/python35-paddle120-env/lib/python3.10/site-packages/paddlenlp/transformers/qwen2/tokenizer.py", line 280, in convert_tokens_to_string
text = "".join(tokens)
TypeError: sequence item 196: expected str instance, NoneType found
from paddlenlp.
DrownFish19
commented on July 20, 2024
Qwen修复PR：#8601
LLaMA修复PR：#8630
from paddlenlp.
yuanlehome
commented on July 20, 2024
#8630 并没有修复LLaMA的问题哈，我不知道咋修。
from paddlenlp.
DrownFish19
commented on July 20, 2024
#8630 并没有修复LLaMA的问题哈，我不知道咋修。
LLama3的tokenizer中缺少pad_token，修复代码如下，我看已经加上了
if (isinstance(tokenizer, LlamaTokenizer) or isinstance(tokenizer, Llama3Tokenizer)) and not tokenizer.pad_token:
tokenizer.pad_token = tokenizer.unk_tokenfrom paddlenlp.
yuanlehome
commented on July 20, 2024
#8630 并没有修复LLaMA的问题哈，我不知道咋修。
LLama3的tokenizer中缺少pad_token，修复代码如下，我看已经加上了
if (isinstance(tokenizer, LlamaTokenizer) or isinstance(tokenizer, Llama3Tokenizer)) and not tokenizer.pad_token: tokenizer.pad_token = tokenizer.unk_token
没用的，llama3连unk_token都set不了，这里的代码改动可以先忽略。我们根本上需要同时解决pad_token和unk_token的set问题才行，我猜测，其他token可能也同样无法set。
from paddlenlp.
Related Issues (20)
- [Bug]: 文档提取的pdf地址带签名报错 HOT 1
- [Question]: 求助，chatglm2 单卡sft内存溢出 HOT 1
- [Bug]: 'NoneType' object has no attribute 'from_pretrained' -超长文本分类任务训练报错
- [Question]: 用教程里的数据微调后，调用时无法打开inference.pdiparams HOT 1
- [Docs]: 文档挂了 readthedocs page is 404 HOT 2
- [Docs]: https://github.com/PaddlePaddle/PaddleNLP/blob/develop/applications/sentiment_analysis HOT 1
- [Bug]: PaddleNLP2.8 llama2 lora 微调后导出静态图模型报错 HOT 1
- [Question]: tokenizer转换字符串得到的input_ids列表长度不对 HOT 2
- [Bug]: The file path "examples/text_to_knowledge/nptag/deploy/python/predict.py" may encounter an IndexError. HOT 3
- [Question]: 使用ernie-layout模型推理时对预测结果中的每个entity都漏最后一个字
- [Docs]: 示例里 8010 和 8011 写反了
- [Question]: 如何使用LoRA HOT 1
- [Bug]: UNIMO模型的resize_token_embeddings方法不会修改decoder的vocab_size，导致报错 HOT 1
- [Question]: 张量并行推理内存占用异常？ HOT 5
- [Question]: PaddleNLP 报错OSError: (External) CUBLAS error(1).
- [Question]: Why is PaddleNLP /applications/ not available anymore? HOT 1
- [Question]: Inferencing using finetuned ERNIE-Layout model on Taskflow
- 【LLM】模型支持列表
- [Question]: 对ERNIE模型进行微调时，报错Pointer C should not be null.
- [Question]: 无法安装PaddleNLP HOT 2
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from paddlenlp.