nohup: ignoring input
2025-06-20:18:36:55 INFO     [__main__:440] Selected Tasks: ['triviaqa']
2025-06-20:18:36:55 INFO     [evaluator:189] Setting random seed to 0 | Setting numpy seed to 1234 | Setting torch manual seed to 1234 | Setting fewshot manual seed to 1234
2025-06-20:18:36:55 INFO     [evaluator:227] Initializing hf model, with arguments: {'pretrained': '/root/chenxr/models/Llama-2-7b-hf'}
2025-06-20:18:36:55 INFO     [models.huggingface:137] Using device 'cuda:0'
2025-06-20:18:36:56 INFO     [models.huggingface:382] Model parallel was set to False, max memory was not set, and device map was set to {'': 'cuda:0'}

Loading checkpoint shards:   0%|          | 0/2 [00:00<?, ?it/s]
Loading checkpoint shards:  50%|█████     | 1/2 [00:03<00:03,  3.67s/it]
Loading checkpoint shards: 100%|██████████| 2/2 [00:04<00:00,  2.18s/it]
Loading checkpoint shards: 100%|██████████| 2/2 [00:04<00:00,  2.41s/it]
Using the latest cached version of the dataset since trivia_qa couldn't be found on the Hugging Face Hub
2025-06-20:18:37:16 WARNING  [datasets.load:1377] Using the latest cached version of the dataset since trivia_qa couldn't be found on the Hugging Face Hub
Found the latest cached dataset configuration 'rc.nocontext' at /root/.cache/huggingface/datasets/trivia_qa/rc.nocontext/0.0.0/0f7faf33a3908546c6fd5b73a660e0f8ff173c2f (last modified on Mon Jun 16 17:03:06 2025).
2025-06-20:18:37:16 WARNING  [datasets.packaged_modules.cache.cache:94] Found the latest cached dataset configuration 'rc.nocontext' at /root/.cache/huggingface/datasets/trivia_qa/rc.nocontext/0.0.0/0f7faf33a3908546c6fd5b73a660e0f8ff173c2f (last modified on Mon Jun 16 17:03:06 2025).
2025-06-20:18:37:40 INFO     [evaluator:290] triviaqa: Using gen_kwargs: {'until': ['\n', '.', ','], 'do_sample': False, 'temperature': 0.0}
2025-06-20:18:37:40 INFO     [api.task:434] Building contexts for triviaqa on rank 0...

  0%|          | 0/17944 [00:00<?, ?it/s]
  1%|▏         | 257/17944 [00:00<00:06, 2561.94it/s]
  3%|▎         | 519/17944 [00:00<00:06, 2594.48it/s]
  4%|▍         | 782/17944 [00:00<00:06, 2606.21it/s]
  6%|▌         | 1043/17944 [00:00<00:06, 2602.04it/s]
  7%|▋         | 1311/17944 [00:00<00:06, 2626.92it/s]
  9%|▉         | 1578/17944 [00:00<00:06, 2641.07it/s]
 10%|█         | 1844/17944 [00:00<00:06, 2646.90it/s]
 12%|█▏        | 2112/17944 [00:00<00:05, 2655.63it/s]
 13%|█▎        | 2379/17944 [00:00<00:05, 2659.70it/s]
 15%|█▍        | 2645/17944 [00:01<00:05, 2658.55it/s]
 16%|█▌        | 2911/17944 [00:01<00:05, 2647.14it/s]
 18%|█▊        | 3179/17944 [00:01<00:05, 2655.32it/s]
 19%|█▉        | 3445/17944 [00:01<00:05, 2623.30it/s]
 21%|██        | 3708/17944 [00:01<00:05, 2624.47it/s]
 22%|██▏       | 3976/17944 [00:01<00:05, 2639.40it/s]
 24%|██▎       | 4240/17944 [00:01<00:05, 2638.48it/s]
 25%|██▌       | 4505/17944 [00:01<00:05, 2640.92it/s]
 27%|██▋       | 4770/17944 [00:01<00:04, 2635.75it/s]
 28%|██▊       | 5034/17944 [00:01<00:04, 2631.86it/s]
 30%|██▉       | 5299/17944 [00:02<00:04, 2636.06it/s]
 31%|███       | 5565/17944 [00:02<00:04, 2642.19it/s]
 32%|███▏      | 5830/17944 [00:02<00:04, 2638.58it/s]
 34%|███▍      | 6094/17944 [00:02<00:04, 2632.04it/s]
 35%|███▌      | 6358/17944 [00:02<00:04, 2632.58it/s]
 37%|███▋      | 6622/17944 [00:02<00:04, 2627.35it/s]
 38%|███▊      | 6885/17944 [00:02<00:04, 2624.27it/s]
 40%|███▉      | 7148/17944 [00:02<00:04, 2599.92it/s]
 41%|████▏     | 7418/17944 [00:02<00:04, 2627.02it/s]
 43%|████▎     | 7685/17944 [00:02<00:03, 2637.53it/s]
 44%|████▍     | 7955/17944 [00:03<00:03, 2655.95it/s]
 46%|████▌     | 8224/17944 [00:03<00:03, 2665.66it/s]
 47%|████▋     | 8494/17944 [00:03<00:03, 2673.07it/s]
 49%|████▉     | 8762/17944 [00:03<00:03, 2671.15it/s]
 50%|█████     | 9030/17944 [00:03<00:03, 2672.78it/s]
 52%|█████▏    | 9300/17944 [00:03<00:03, 2678.65it/s]
 53%|█████▎    | 9568/17944 [00:03<00:03, 2677.48it/s]
 55%|█████▍    | 9836/17944 [00:03<00:03, 2678.03it/s]
 56%|█████▋    | 10104/17944 [00:03<00:02, 2677.57it/s]
 58%|█████▊    | 10372/17944 [00:03<00:02, 2654.61it/s]
 59%|█████▉    | 10638/17944 [00:04<00:02, 2644.88it/s]
 61%|██████    | 10905/17944 [00:04<00:02, 2650.46it/s]
 62%|██████▏   | 11173/17944 [00:04<00:02, 2658.31it/s]
 64%|██████▍   | 11440/17944 [00:04<00:02, 2661.06it/s]
 65%|██████▌   | 11707/17944 [00:04<00:02, 2663.11it/s]
 67%|██████▋   | 11974/17944 [00:04<00:02, 2664.07it/s]
 68%|██████▊   | 12242/17944 [00:04<00:02, 2667.59it/s]
 70%|██████▉   | 12510/17944 [00:04<00:02, 2669.42it/s]
 71%|███████   | 12780/17944 [00:04<00:01, 2676.35it/s]
 73%|███████▎  | 13048/17944 [00:04<00:01, 2676.68it/s]
 74%|███████▍  | 13316/17944 [00:05<00:01, 2675.09it/s]
 76%|███████▌  | 13584/17944 [00:05<00:01, 2673.73it/s]
 77%|███████▋  | 13852/17944 [00:05<00:01, 2672.95it/s]
 79%|███████▊  | 14120/17944 [00:05<00:01, 2674.01it/s]
 80%|████████  | 14388/17944 [00:05<00:01, 2670.97it/s]
 82%|████████▏ | 14659/17944 [00:05<00:01, 2680.30it/s]
 83%|████████▎ | 14928/17944 [00:05<00:01, 2656.63it/s]
 85%|████████▍ | 15194/17944 [00:05<00:01, 2656.53it/s]
 86%|████████▌ | 15462/17944 [00:05<00:00, 2661.70it/s]
 88%|████████▊ | 15729/17944 [00:05<00:00, 2650.97it/s]
 89%|████████▉ | 15995/17944 [00:06<00:00, 2643.20it/s]
 91%|█████████ | 16260/17944 [00:06<00:00, 2626.01it/s]
 92%|█████████▏| 16523/17944 [00:06<00:00, 2623.44it/s]
 94%|█████████▎| 16786/17944 [00:08<00:02, 430.68it/s] 
 95%|█████████▌| 17052/17944 [00:08<00:01, 575.87it/s]
 96%|█████████▋| 17291/17944 [00:08<00:00, 730.35it/s]
 98%|█████████▊| 17557/17944 [00:08<00:00, 939.48it/s]
 99%|█████████▉| 17820/17944 [00:08<00:00, 1166.01it/s]
100%|██████████| 17944/17944 [00:08<00:00, 2111.56it/s]
2025-06-20:18:37:51 INFO     [evaluator:559] Running generate_until requests

Running generate_until requests:   0%|          | 0/17944 [00:00<?, ?it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:   0%|          | 1/17944 [00:03<16:39:47,  3.34s/it]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:   0%|          | 9/17944 [00:05<2:38:23,  1.89it/s] The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:   0%|          | 17/17944 [00:14<4:08:07,  1.20it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:   0%|          | 25/17944 [00:14<2:23:52,  2.08it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:   0%|          | 33/17944 [00:14<1:33:40,  3.19it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:   0%|          | 41/17944 [00:15<1:06:51,  4.46it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:   0%|          | 49/17944 [00:15<50:09,  5.95it/s]  The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:   0%|          | 57/17944 [00:16<37:14,  8.01it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:   0%|          | 65/17944 [00:16<29:48, 10.00it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:   0%|          | 73/17944 [00:16<24:05, 12.37it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:   0%|          | 81/17944 [00:17<19:51, 14.99it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:   0%|          | 89/17944 [00:17<18:21, 16.21it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:   1%|          | 97/17944 [00:17<16:36, 17.92it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:   1%|          | 105/17944 [00:19<25:59, 11.44it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:   1%|          | 113/17944 [00:19<21:13, 14.00it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:   1%|          | 121/17944 [00:19<17:35, 16.89it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:   1%|          | 129/17944 [00:20<16:16, 18.25it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:   1%|          | 137/17944 [00:20<14:26, 20.55it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:   1%|          | 145/17944 [00:20<14:10, 20.92it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:   1%|          | 153/17944 [00:22<31:38,  9.37it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:   1%|          | 161/17944 [00:22<26:11, 11.32it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:   1%|          | 169/17944 [00:23<21:36, 13.71it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:   1%|          | 177/17944 [00:25<36:34,  8.10it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:   1%|          | 185/17944 [00:25<28:57, 10.22it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:   1%|          | 193/17944 [00:25<22:47, 12.98it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:   1%|          | 201/17944 [00:27<37:57,  7.79it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:   1%|          | 209/17944 [00:28<35:47,  8.26it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:   1%|          | 217/17944 [00:28<27:57, 10.57it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:   1%|▏         | 225/17944 [00:29<24:16, 12.16it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:   1%|▏         | 233/17944 [00:29<21:32, 13.71it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:   1%|▏         | 241/17944 [00:30<18:51, 15.65it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:   1%|▏         | 249/17944 [00:38<1:44:52,  2.81it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:   1%|▏         | 257/17944 [00:38<1:16:51,  3.84it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:   1%|▏         | 265/17944 [00:38<56:59,  5.17it/s]  The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:   2%|▏         | 273/17944 [00:39<43:10,  6.82it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:   2%|▏         | 281/17944 [00:39<33:23,  8.82it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:   2%|▏         | 289/17944 [00:39<26:50, 10.96it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:   2%|▏         | 297/17944 [00:40<23:23, 12.58it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:   2%|▏         | 305/17944 [00:40<19:52, 14.79it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:   2%|▏         | 313/17944 [00:42<35:55,  8.18it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:   2%|▏         | 321/17944 [00:42<29:24,  9.99it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:   2%|▏         | 329/17944 [00:43<23:50, 12.32it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:   2%|▏         | 337/17944 [00:43<21:43, 13.51it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:   2%|▏         | 345/17944 [00:44<19:46, 14.83it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:   2%|▏         | 353/17944 [00:44<19:31, 15.02it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:   2%|▏         | 361/17944 [00:44<16:47, 17.45it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:   2%|▏         | 369/17944 [00:45<15:11, 19.28it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:   2%|▏         | 377/17944 [00:45<14:04, 20.80it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:   2%|▏         | 385/17944 [00:45<13:28, 21.73it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:   2%|▏         | 393/17944 [00:46<12:53, 22.68it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:   2%|▏         | 401/17944 [00:47<26:44, 10.94it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:   2%|▏         | 409/17944 [00:49<32:26,  9.01it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:   2%|▏         | 417/17944 [00:49<25:25, 11.49it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:   2%|▏         | 425/17944 [00:50<35:34,  8.21it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:   2%|▏         | 433/17944 [00:52<41:51,  6.97it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:   2%|▏         | 441/17944 [00:54<48:07,  6.06it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:   3%|▎         | 449/17944 [00:54<36:46,  7.93it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:   3%|▎         | 457/17944 [00:54<29:06, 10.01it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:   3%|▎         | 465/17944 [00:55<25:20, 11.49it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:   3%|▎         | 473/17944 [00:55<20:32, 14.17it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:   3%|▎         | 481/17944 [00:57<31:32,  9.23it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:   3%|▎         | 489/17944 [00:58<37:57,  7.66it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:   3%|▎         | 497/17944 [00:58<29:26,  9.88it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:   3%|▎         | 505/17944 [00:59<23:42, 12.26it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:   3%|▎         | 513/17944 [00:59<22:13, 13.08it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:   3%|▎         | 521/17944 [01:00<21:12, 13.69it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:   3%|▎         | 529/17944 [01:00<17:37, 16.46it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:   3%|▎         | 537/17944 [01:00<16:26, 17.65it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:   3%|▎         | 545/17944 [01:01<14:56, 19.41it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:   3%|▎         | 553/17944 [01:01<13:52, 20.89it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:   3%|▎         | 561/17944 [01:01<14:44, 19.66it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:   3%|▎         | 569/17944 [01:02<15:16, 18.95it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:   3%|▎         | 577/17944 [01:06<54:01,  5.36it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:   3%|▎         | 585/17944 [01:07<48:20,  5.98it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:   3%|▎         | 593/17944 [01:07<36:35,  7.90it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:   3%|▎         | 601/17944 [01:07<28:40, 10.08it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:   3%|▎         | 609/17944 [01:08<24:42, 11.69it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:   3%|▎         | 617/17944 [01:08<20:20, 14.19it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:   3%|▎         | 625/17944 [01:08<17:19, 16.66it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:   4%|▎         | 633/17944 [01:09<15:10, 19.01it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:   4%|▎         | 641/17944 [01:09<16:29, 17.48it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:   4%|▎         | 649/17944 [01:09<14:38, 19.68it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:   4%|▎         | 657/17944 [01:11<26:00, 11.08it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:   4%|▎         | 665/17944 [01:12<33:07,  8.69it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:   4%|▍         | 673/17944 [01:13<26:31, 10.85it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:   4%|▍         | 681/17944 [01:13<21:36, 13.32it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:   4%|▍         | 689/17944 [01:13<19:25, 14.80it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:   4%|▍         | 697/17944 [01:14<16:56, 16.96it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:   4%|▍         | 705/17944 [01:14<19:19, 14.87it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:   4%|▍         | 713/17944 [01:15<16:52, 17.02it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:   4%|▍         | 721/17944 [01:15<17:36, 16.30it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:   4%|▍         | 729/17944 [01:15<16:27, 17.42it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:   4%|▍         | 737/17944 [01:16<14:14, 20.13it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:   4%|▍         | 745/17944 [01:16<14:32, 19.72it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:   4%|▍         | 753/17944 [01:17<14:54, 19.21it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:   4%|▍         | 761/17944 [01:17<14:22, 19.93it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:   4%|▍         | 769/17944 [01:17<14:37, 19.58it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:   4%|▍         | 777/17944 [01:18<12:57, 22.07it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:   4%|▍         | 785/17944 [01:18<12:42, 22.49it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:   4%|▍         | 793/17944 [01:18<11:56, 23.95it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:   4%|▍         | 801/17944 [01:19<11:42, 24.41it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:   5%|▍         | 809/17944 [01:20<22:10, 12.88it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:   5%|▍         | 817/17944 [01:21<26:17, 10.85it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:   5%|▍         | 825/17944 [01:21<24:42, 11.55it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:   5%|▍         | 833/17944 [01:22<19:47, 14.41it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:   5%|▍         | 841/17944 [01:22<16:59, 16.78it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:   5%|▍         | 849/17944 [01:22<15:02, 18.95it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:   5%|▍         | 857/17944 [01:23<13:03, 21.82it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:   5%|▍         | 865/17944 [01:31<1:37:27,  2.92it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:   5%|▍         | 873/17944 [01:39<2:32:54,  1.86it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:   5%|▍         | 881/17944 [01:39<1:52:55,  2.52it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:   5%|▍         | 889/17944 [01:40<1:22:07,  3.46it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:   5%|▍         | 897/17944 [01:40<1:01:31,  4.62it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:   5%|▌         | 905/17944 [01:42<1:01:05,  4.65it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:   5%|▌         | 913/17944 [01:42<46:29,  6.11it/s]  The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:   5%|▌         | 921/17944 [01:42<35:20,  8.03it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:   5%|▌         | 929/17944 [01:43<31:16,  9.07it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:   5%|▌         | 937/17944 [01:43<24:07, 11.75it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:   5%|▌         | 945/17944 [01:44<23:05, 12.27it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:   5%|▌         | 953/17944 [01:45<25:48, 10.97it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:   5%|▌         | 961/17944 [01:45<21:10, 13.37it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:   5%|▌         | 969/17944 [01:45<19:10, 14.75it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:   5%|▌         | 977/17944 [01:46<21:27, 13.17it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:   5%|▌         | 985/17944 [01:47<24:30, 11.53it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:   6%|▌         | 993/17944 [01:47<21:28, 13.15it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:   6%|▌         | 1001/17944 [01:48<16:53, 16.72it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:   6%|▌         | 1009/17944 [01:48<14:57, 18.87it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:   6%|▌         | 1017/17944 [01:48<14:31, 19.43it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:   6%|▌         | 1025/17944 [01:49<14:31, 19.42it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:   6%|▌         | 1033/17944 [01:49<14:43, 19.15it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:   6%|▌         | 1041/17944 [01:49<13:04, 21.54it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:   6%|▌         | 1049/17944 [01:50<11:56, 23.57it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:   6%|▌         | 1057/17944 [01:50<11:08, 25.25it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:   6%|▌         | 1065/17944 [01:52<30:06,  9.35it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:   6%|▌         | 1073/17944 [01:54<42:42,  6.58it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:   6%|▌         | 1081/17944 [01:54<33:31,  8.38it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:   6%|▌         | 1089/17944 [01:55<30:57,  9.07it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:   6%|▌         | 1097/17944 [01:55<24:23, 11.51it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:   6%|▌         | 1105/17944 [01:56<19:47, 14.18it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:   6%|▌         | 1113/17944 [01:56<17:00, 16.49it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:   6%|▌         | 1121/17944 [01:56<15:31, 18.06it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:   6%|▋         | 1129/17944 [01:57<16:54, 16.58it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:   6%|▋         | 1137/17944 [01:58<24:44, 11.32it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:   6%|▋         | 1145/17944 [02:01<53:13,  5.26it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:   6%|▋         | 1153/17944 [02:05<1:13:06,  3.83it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:   6%|▋         | 1161/17944 [02:05<54:08,  5.17it/s]  The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:   7%|▋         | 1169/17944 [02:05<39:23,  7.10it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:   7%|▋         | 1177/17944 [02:06<30:17,  9.23it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:   7%|▋         | 1185/17944 [02:06<27:42, 10.08it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:   7%|▋         | 1193/17944 [02:07<25:00, 11.16it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:   7%|▋         | 1201/17944 [02:07<20:09, 13.84it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:   7%|▋         | 1209/17944 [02:07<18:53, 14.76it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:   7%|▋         | 1217/17944 [02:08<15:18, 18.22it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:   7%|▋         | 1225/17944 [02:08<13:24, 20.79it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:   7%|▋         | 1233/17944 [02:09<15:56, 17.48it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:   7%|▋         | 1241/17944 [02:09<12:56, 21.51it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:   7%|▋         | 1249/17944 [02:09<12:40, 21.96it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:   7%|▋         | 1257/17944 [02:09<11:51, 23.44it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:   7%|▋         | 1265/17944 [02:10<13:05, 21.24it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:   7%|▋         | 1273/17944 [02:10<11:51, 23.45it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:   7%|▋         | 1281/17944 [02:10<11:53, 23.34it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:   7%|▋         | 1289/17944 [02:11<10:42, 25.93it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:   7%|▋         | 1297/17944 [02:11<11:04, 25.06it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:   7%|▋         | 1305/17944 [02:11<10:23, 26.68it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:   7%|▋         | 1313/17944 [02:14<36:36,  7.57it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:   7%|▋         | 1321/17944 [02:14<29:48,  9.30it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:   7%|▋         | 1329/17944 [02:15<23:13, 11.92it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:   7%|▋         | 1337/17944 [02:16<29:09,  9.49it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:   7%|▋         | 1345/17944 [02:16<23:05, 11.98it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:   8%|▊         | 1353/17944 [02:16<18:31, 14.92it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:   8%|▊         | 1361/17944 [02:17<22:12, 12.44it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:   8%|▊         | 1369/17944 [02:18<25:57, 10.64it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:   8%|▊         | 1377/17944 [02:26<1:39:46,  2.77it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:   8%|▊         | 1385/17944 [02:27<1:14:50,  3.69it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:   8%|▊         | 1393/17944 [02:27<55:03,  5.01it/s]  The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:   8%|▊         | 1401/17944 [02:27<40:57,  6.73it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:   8%|▊         | 1409/17944 [02:28<32:12,  8.55it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:   8%|▊         | 1417/17944 [02:28<31:08,  8.84it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:   8%|▊         | 1425/17944 [02:29<23:51, 11.54it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:   8%|▊         | 1433/17944 [02:29<19:03, 14.43it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:   8%|▊         | 1441/17944 [02:29<17:32, 15.68it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:   8%|▊         | 1449/17944 [02:30<16:25, 16.74it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:   8%|▊         | 1457/17944 [02:30<14:44, 18.63it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:   8%|▊         | 1465/17944 [02:31<24:06, 11.39it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:   8%|▊         | 1473/17944 [02:31<18:56, 14.49it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:   8%|▊         | 1481/17944 [02:32<16:50, 16.30it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:   8%|▊         | 1489/17944 [02:32<14:27, 18.98it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:   8%|▊         | 1497/17944 [02:32<13:40, 20.04it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:   8%|▊         | 1505/17944 [02:33<12:33, 21.83it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:   8%|▊         | 1513/17944 [02:33<13:14, 20.68it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:   8%|▊         | 1521/17944 [02:34<20:34, 13.30it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:   9%|▊         | 1529/17944 [02:35<17:55, 15.26it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:   9%|▊         | 1537/17944 [02:35<15:47, 17.31it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:   9%|▊         | 1545/17944 [02:35<14:01, 19.50it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:   9%|▊         | 1553/17944 [02:38<43:23,  6.30it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:   9%|▊         | 1561/17944 [02:39<32:40,  8.36it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:   9%|▊         | 1569/17944 [02:39<25:10, 10.84it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:   9%|▉         | 1577/17944 [02:47<1:37:37,  2.79it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:   9%|▉         | 1585/17944 [02:47<1:11:10,  3.83it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:   9%|▉         | 1593/17944 [02:47<53:34,  5.09it/s]  The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:   9%|▉         | 1601/17944 [02:48<40:04,  6.80it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:   9%|▉         | 1609/17944 [02:48<32:22,  8.41it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:   9%|▉         | 1617/17944 [02:49<28:42,  9.48it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:   9%|▉         | 1625/17944 [02:49<22:30, 12.08it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:   9%|▉         | 1633/17944 [02:50<28:46,  9.45it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:   9%|▉         | 1641/17944 [02:51<26:43, 10.17it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:   9%|▉         | 1649/17944 [02:51<25:13, 10.77it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:   9%|▉         | 1657/17944 [02:52<21:03, 12.89it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:   9%|▉         | 1665/17944 [02:52<17:17, 15.69it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:   9%|▉         | 1673/17944 [02:52<14:06, 19.23it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:   9%|▉         | 1681/17944 [02:53<12:26, 21.77it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:   9%|▉         | 1689/17944 [02:53<13:34, 19.97it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:   9%|▉         | 1697/17944 [02:54<16:01, 16.89it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  10%|▉         | 1705/17944 [02:55<22:57, 11.79it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  10%|▉         | 1713/17944 [02:57<40:53,  6.62it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  10%|▉         | 1721/17944 [02:58<31:26,  8.60it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  10%|▉         | 1729/17944 [02:58<23:59, 11.26it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  10%|▉         | 1737/17944 [02:58<19:20, 13.97it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  10%|▉         | 1745/17944 [02:58<16:41, 16.17it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  10%|▉         | 1753/17944 [02:58<13:42, 19.69it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  10%|▉         | 1761/17944 [02:59<11:36, 23.25it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  10%|▉         | 1769/17944 [02:59<10:57, 24.59it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  10%|▉         | 1777/17944 [03:00<18:29, 14.57it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  10%|▉         | 1785/17944 [03:01<25:28, 10.57it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  10%|▉         | 1793/17944 [03:02<20:23, 13.20it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  10%|█         | 1801/17944 [03:02<16:32, 16.26it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  10%|█         | 1809/17944 [03:02<13:35, 19.78it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  10%|█         | 1817/17944 [03:02<13:13, 20.31it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  10%|█         | 1825/17944 [03:03<12:58, 20.71it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  10%|█         | 1833/17944 [03:03<11:20, 23.69it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  10%|█         | 1841/17944 [03:03<10:11, 26.35it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  10%|█         | 1849/17944 [03:03<10:29, 25.56it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  10%|█         | 1857/17944 [03:04<12:09, 22.05it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  10%|█         | 1865/17944 [03:04<12:49, 20.89it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  10%|█         | 1873/17944 [03:05<13:14, 20.22it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  10%|█         | 1881/17944 [03:05<11:13, 23.83it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  11%|█         | 1889/17944 [03:05<11:18, 23.67it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  11%|█         | 1897/17944 [03:06<15:22, 17.40it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  11%|█         | 1905/17944 [03:06<12:44, 20.97it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  11%|█         | 1913/17944 [03:07<12:04, 22.13it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  11%|█         | 1921/17944 [03:07<11:37, 22.97it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  11%|█         | 1929/17944 [03:07<11:51, 22.51it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  11%|█         | 1937/17944 [03:08<20:01, 13.32it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  11%|█         | 1945/17944 [03:09<15:58, 16.69it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  11%|█         | 1953/17944 [03:09<14:01, 19.01it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  11%|█         | 1961/17944 [03:09<12:06, 22.01it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  11%|█         | 1969/17944 [03:10<13:08, 20.25it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  11%|█         | 1977/17944 [03:10<12:37, 21.07it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  11%|█         | 1985/17944 [03:10<12:16, 21.67it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  11%|█         | 1993/17944 [03:11<11:42, 22.69it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  11%|█         | 2001/17944 [03:12<16:58, 15.65it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  11%|█         | 2009/17944 [03:12<14:59, 17.71it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  11%|█         | 2017/17944 [03:12<16:01, 16.57it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  11%|█▏        | 2025/17944 [03:13<16:36, 15.97it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  11%|█▏        | 2033/17944 [03:13<14:08, 18.74it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  11%|█▏        | 2041/17944 [03:13<12:43, 20.82it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  11%|█▏        | 2049/17944 [03:14<10:52, 24.37it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  11%|█▏        | 2057/17944 [03:15<18:31, 14.29it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  12%|█▏        | 2065/17944 [03:15<16:53, 15.66it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  12%|█▏        | 2073/17944 [03:15<14:37, 18.09it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  12%|█▏        | 2081/17944 [03:16<12:10, 21.71it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  12%|█▏        | 2089/17944 [03:17<18:39, 14.16it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  12%|█▏        | 2097/17944 [03:17<18:39, 14.16it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  12%|█▏        | 2105/17944 [03:17<15:17, 17.27it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  12%|█▏        | 2113/17944 [03:19<24:25, 10.80it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  12%|█▏        | 2121/17944 [03:20<30:20,  8.69it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  12%|█▏        | 2129/17944 [03:21<30:15,  8.71it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  12%|█▏        | 2137/17944 [03:21<23:23, 11.26it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  12%|█▏        | 2145/17944 [03:22<20:01, 13.15it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  12%|█▏        | 2153/17944 [03:23<24:39, 10.67it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  12%|█▏        | 2161/17944 [03:23<19:14, 13.67it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  12%|█▏        | 2169/17944 [03:24<23:20, 11.27it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  12%|█▏        | 2177/17944 [03:24<19:43, 13.32it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  12%|█▏        | 2185/17944 [03:25<18:38, 14.08it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  12%|█▏        | 2193/17944 [03:25<15:17, 17.17it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  12%|█▏        | 2201/17944 [03:26<15:27, 16.97it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  12%|█▏        | 2209/17944 [03:26<12:29, 21.00it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  12%|█▏        | 2217/17944 [03:26<12:25, 21.09it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  12%|█▏        | 2225/17944 [03:26<11:28, 22.85it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  12%|█▏        | 2233/17944 [03:27<10:48, 24.24it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  12%|█▏        | 2241/17944 [03:27<10:04, 25.96it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  13%|█▎        | 2249/17944 [03:27<08:59, 29.10it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  13%|█▎        | 2257/17944 [03:28<11:16, 23.18it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  13%|█▎        | 2265/17944 [03:29<17:51, 14.64it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  13%|█▎        | 2273/17944 [03:29<18:15, 14.31it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  13%|█▎        | 2281/17944 [03:29<14:59, 17.42it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  13%|█▎        | 2289/17944 [03:30<13:34, 19.21it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  13%|█▎        | 2297/17944 [03:30<12:34, 20.73it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  13%|█▎        | 2305/17944 [03:31<14:26, 18.05it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  13%|█▎        | 2313/17944 [03:32<19:10, 13.59it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  13%|█▎        | 2321/17944 [03:33<22:47, 11.42it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  13%|█▎        | 2329/17944 [03:33<18:10, 14.32it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  13%|█▎        | 2337/17944 [03:33<14:56, 17.42it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  13%|█▎        | 2345/17944 [03:34<18:38, 13.95it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  13%|█▎        | 2353/17944 [03:35<22:50, 11.38it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  13%|█▎        | 2361/17944 [03:35<18:27, 14.07it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  13%|█▎        | 2369/17944 [03:35<15:41, 16.54it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  13%|█▎        | 2377/17944 [03:36<12:53, 20.12it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  13%|█▎        | 2385/17944 [03:36<14:33, 17.81it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  13%|█▎        | 2393/17944 [03:36<12:57, 20.01it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  13%|█▎        | 2401/17944 [03:37<11:52, 21.82it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  13%|█▎        | 2409/17944 [03:37<10:47, 23.98it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  13%|█▎        | 2417/17944 [03:38<12:47, 20.23it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  14%|█▎        | 2425/17944 [03:38<11:56, 21.65it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  14%|█▎        | 2433/17944 [03:38<11:24, 22.67it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  14%|█▎        | 2441/17944 [03:38<10:10, 25.40it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  14%|█▎        | 2449/17944 [03:39<10:08, 25.45it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  14%|█▎        | 2457/17944 [03:39<10:06, 25.53it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  14%|█▎        | 2465/17944 [03:40<18:41, 13.80it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  14%|█▍        | 2473/17944 [03:41<17:06, 15.07it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  14%|█▍        | 2481/17944 [03:41<16:39, 15.47it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  14%|█▍        | 2489/17944 [03:42<18:15, 14.11it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  14%|█▍        | 2497/17944 [03:42<15:13, 16.91it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  14%|█▍        | 2505/17944 [03:42<12:50, 20.03it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  14%|█▍        | 2513/17944 [03:43<11:43, 21.93it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  14%|█▍        | 2521/17944 [03:43<11:45, 21.87it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  14%|█▍        | 2529/17944 [03:43<10:05, 25.46it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  14%|█▍        | 2537/17944 [03:43<09:15, 27.74it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  14%|█▍        | 2545/17944 [03:44<11:25, 22.48it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  14%|█▍        | 2553/17944 [03:45<16:47, 15.28it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  14%|█▍        | 2561/17944 [03:46<26:48,  9.56it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  14%|█▍        | 2569/17944 [03:47<25:18, 10.12it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  14%|█▍        | 2577/17944 [03:47<20:23, 12.56it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  14%|█▍        | 2585/17944 [03:48<23:42, 10.80it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  14%|█▍        | 2593/17944 [03:49<19:00, 13.46it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  14%|█▍        | 2601/17944 [03:49<15:27, 16.54it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  15%|█▍        | 2609/17944 [03:49<16:33, 15.44it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  15%|█▍        | 2617/17944 [03:50<13:59, 18.25it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  15%|█▍        | 2625/17944 [03:50<15:14, 16.74it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  15%|█▍        | 2633/17944 [03:50<13:22, 19.07it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  15%|█▍        | 2641/17944 [03:51<12:03, 21.16it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  15%|█▍        | 2649/17944 [03:51<10:52, 23.45it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  15%|█▍        | 2657/17944 [03:51<10:01, 25.40it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  15%|█▍        | 2665/17944 [03:52<09:26, 26.99it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  15%|█▍        | 2673/17944 [03:52<09:50, 25.85it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  15%|█▍        | 2681/17944 [03:52<09:17, 27.38it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  15%|█▍        | 2689/17944 [03:52<09:01, 28.17it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  15%|█▌        | 2697/17944 [03:53<13:03, 19.45it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  15%|█▌        | 2705/17944 [03:53<12:38, 20.10it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  15%|█▌        | 2713/17944 [03:54<11:47, 21.52it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  15%|█▌        | 2721/17944 [03:55<17:10, 14.77it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  15%|█▌        | 2729/17944 [03:55<18:34, 13.65it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  15%|█▌        | 2737/17944 [03:56<21:45, 11.65it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  15%|█▌        | 2745/17944 [03:57<23:35, 10.74it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  15%|█▌        | 2753/17944 [03:57<18:38, 13.58it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  15%|█▌        | 2761/17944 [03:58<20:19, 12.45it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  15%|█▌        | 2769/17944 [03:58<16:40, 15.17it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  15%|█▌        | 2777/17944 [03:59<14:04, 17.95it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  16%|█▌        | 2785/17944 [03:59<11:44, 21.51it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  16%|█▌        | 2793/17944 [03:59<13:56, 18.11it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  16%|█▌        | 2801/17944 [04:00<12:59, 19.42it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  16%|█▌        | 2809/17944 [04:02<33:29,  7.53it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  16%|█▌        | 2817/17944 [04:07<1:03:15,  3.99it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  16%|█▌        | 2825/17944 [04:07<50:29,  4.99it/s]  The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  16%|█▌        | 2833/17944 [04:08<44:18,  5.68it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  16%|█▌        | 2841/17944 [04:10<43:07,  5.84it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  16%|█▌        | 2849/17944 [04:10<35:36,  7.06it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  16%|█▌        | 2857/17944 [04:10<27:20,  9.20it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  16%|█▌        | 2865/17944 [04:11<25:47,  9.74it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  16%|█▌        | 2873/17944 [04:11<21:16, 11.81it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  16%|█▌        | 2881/17944 [04:12<18:56, 13.26it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  16%|█▌        | 2889/17944 [04:12<16:11, 15.49it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  16%|█▌        | 2897/17944 [04:12<13:44, 18.24it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  16%|█▌        | 2905/17944 [04:13<12:52, 19.47it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  16%|█▌        | 2913/17944 [04:13<11:25, 21.93it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  16%|█▋        | 2921/17944 [04:13<10:40, 23.46it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  16%|█▋        | 2929/17944 [04:14<10:07, 24.72it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  16%|█▋        | 2937/17944 [04:14<09:45, 25.62it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  16%|█▋        | 2945/17944 [04:14<08:24, 29.72it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  16%|█▋        | 2953/17944 [04:16<24:06, 10.36it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  17%|█▋        | 2961/17944 [04:16<19:48, 12.61it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  17%|█▋        | 2969/17944 [04:17<16:13, 15.38it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  17%|█▋        | 2977/17944 [04:17<13:51, 18.00it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  17%|█▋        | 2985/17944 [04:18<18:17, 13.64it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  17%|█▋        | 2993/17944 [04:18<14:52, 16.74it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  17%|█▋        | 3001/17944 [04:21<37:19,  6.67it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  17%|█▋        | 3009/17944 [04:25<1:07:34,  3.68it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  17%|█▋        | 3017/17944 [04:26<52:22,  4.75it/s]  The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  17%|█▋        | 3025/17944 [04:26<38:45,  6.42it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  17%|█▋        | 3033/17944 [04:26<29:46,  8.35it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  17%|█▋        | 3041/17944 [04:27<24:34, 10.11it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  17%|█▋        | 3049/17944 [04:28<25:20,  9.80it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  17%|█▋        | 3057/17944 [04:28<19:49, 12.51it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  17%|█▋        | 3065/17944 [04:28<16:31, 15.01it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  17%|█▋        | 3073/17944 [04:28<14:29, 17.10it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  17%|█▋        | 3081/17944 [04:29<12:31, 19.77it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  17%|█▋        | 3089/17944 [04:29<11:40, 21.20it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  17%|█▋        | 3097/17944 [04:30<14:48, 16.72it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  17%|█▋        | 3105/17944 [04:32<30:08,  8.20it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  17%|█▋        | 3113/17944 [04:32<26:10,  9.44it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  17%|█▋        | 3121/17944 [04:33<20:41, 11.94it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  17%|█▋        | 3129/17944 [04:33<16:51, 14.65it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  17%|█▋        | 3137/17944 [04:34<20:25, 12.08it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  18%|█▊        | 3145/17944 [04:34<16:21, 15.07it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  18%|█▊        | 3153/17944 [04:36<25:27,  9.68it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  18%|█▊        | 3161/17944 [04:36<20:39, 11.93it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  18%|█▊        | 3169/17944 [04:36<18:53, 13.04it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  18%|█▊        | 3177/17944 [04:37<19:28, 12.64it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  18%|█▊        | 3185/17944 [04:38<20:10, 12.19it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  18%|█▊        | 3193/17944 [04:38<16:41, 14.72it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  18%|█▊        | 3201/17944 [04:38<15:05, 16.29it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  18%|█▊        | 3209/17944 [04:39<12:36, 19.49it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  18%|█▊        | 3217/17944 [04:39<10:52, 22.58it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  18%|█▊        | 3225/17944 [04:39<09:40, 25.36it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  18%|█▊        | 3233/17944 [04:39<09:06, 26.94it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  18%|█▊        | 3241/17944 [04:40<09:13, 26.58it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  18%|█▊        | 3249/17944 [04:40<11:55, 20.55it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  18%|█▊        | 3257/17944 [04:40<10:07, 24.18it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  18%|█▊        | 3265/17944 [04:41<09:08, 26.77it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  18%|█▊        | 3273/17944 [04:41<11:20, 21.57it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  18%|█▊        | 3281/17944 [04:42<11:01, 22.17it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  18%|█▊        | 3289/17944 [04:42<12:40, 19.28it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  18%|█▊        | 3297/17944 [04:43<14:34, 16.74it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  18%|█▊        | 3305/17944 [04:43<13:01, 18.73it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  18%|█▊        | 3313/17944 [04:43<11:10, 21.84it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  19%|█▊        | 3321/17944 [04:44<11:56, 20.40it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  19%|█▊        | 3329/17944 [04:44<10:06, 24.09it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  19%|█▊        | 3337/17944 [04:44<09:39, 25.21it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  19%|█▊        | 3345/17944 [04:44<09:03, 26.86it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  19%|█▊        | 3353/17944 [04:45<09:09, 26.56it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  19%|█▊        | 3361/17944 [04:45<08:25, 28.83it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  19%|█▉        | 3369/17944 [04:45<08:42, 27.89it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  19%|█▉        | 3377/17944 [04:46<08:55, 27.21it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  19%|█▉        | 3385/17944 [04:46<09:49, 24.69it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  19%|█▉        | 3393/17944 [04:46<10:27, 23.18it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  19%|█▉        | 3401/17944 [04:47<11:26, 21.17it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  19%|█▉        | 3409/17944 [04:47<10:03, 24.10it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  19%|█▉        | 3417/17944 [04:47<09:37, 25.18it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  19%|█▉        | 3425/17944 [04:48<15:15, 15.86it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  19%|█▉        | 3433/17944 [04:49<12:56, 18.68it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  19%|█▉        | 3441/17944 [04:49<10:49, 22.32it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  19%|█▉        | 3449/17944 [04:49<11:12, 21.56it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  19%|█▉        | 3457/17944 [04:50<13:12, 18.27it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  19%|█▉        | 3465/17944 [04:51<17:16, 13.97it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  19%|█▉        | 3473/17944 [04:51<13:34, 17.76it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  19%|█▉        | 3481/17944 [04:51<14:44, 16.35it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  19%|█▉        | 3489/17944 [04:52<13:38, 17.66it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  19%|█▉        | 3497/17944 [04:52<12:05, 19.91it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  20%|█▉        | 3505/17944 [04:52<10:29, 22.93it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  20%|█▉        | 3513/17944 [04:52<09:23, 25.62it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  20%|█▉        | 3521/17944 [04:53<10:09, 23.66it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  20%|█▉        | 3529/17944 [04:53<09:07, 26.32it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  20%|█▉        | 3537/17944 [04:54<13:23, 17.92it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  20%|█▉        | 3545/17944 [04:54<11:55, 20.12it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  20%|█▉        | 3553/17944 [04:54<10:07, 23.69it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  20%|█▉        | 3561/17944 [04:55<10:57, 21.88it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  20%|█▉        | 3569/17944 [04:57<29:58,  7.99it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  20%|█▉        | 3577/17944 [04:57<22:59, 10.41it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  20%|█▉        | 3585/17944 [04:58<18:06, 13.21it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  20%|██        | 3593/17944 [04:58<16:01, 14.92it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  20%|██        | 3601/17944 [04:58<13:31, 17.69it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  20%|██        | 3609/17944 [04:59<11:43, 20.38it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  20%|██        | 3617/17944 [04:59<15:42, 15.21it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  20%|██        | 3625/17944 [05:07<1:22:25,  2.90it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  20%|██        | 3633/17944 [05:08<59:40,  4.00it/s]  The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  20%|██        | 3641/17944 [05:09<52:07,  4.57it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  20%|██        | 3649/17944 [05:09<40:45,  5.85it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  20%|██        | 3657/17944 [05:11<44:53,  5.30it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  20%|██        | 3665/17944 [05:12<35:52,  6.63it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  20%|██        | 3673/17944 [05:12<32:51,  7.24it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  21%|██        | 3681/17944 [05:13<30:50,  7.71it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  21%|██        | 3689/17944 [05:14<24:31,  9.69it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  21%|██        | 3697/17944 [05:14<18:47, 12.63it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  21%|██        | 3705/17944 [05:14<17:24, 13.63it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  21%|██        | 3713/17944 [05:15<17:24, 13.62it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  21%|██        | 3721/17944 [05:16<25:32,  9.28it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  21%|██        | 3729/17944 [05:17<21:32, 11.00it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  21%|██        | 3737/17944 [05:17<17:47, 13.31it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  21%|██        | 3745/17944 [05:17<15:08, 15.64it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  21%|██        | 3753/17944 [05:18<16:39, 14.20it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  21%|██        | 3761/17944 [05:18<13:17, 17.78it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  21%|██        | 3769/17944 [05:19<16:20, 14.45it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  21%|██        | 3777/17944 [05:20<14:52, 15.87it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  21%|██        | 3785/17944 [05:20<13:04, 18.05it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  21%|██        | 3793/17944 [05:21<19:37, 12.02it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  21%|██        | 3801/17944 [05:21<15:50, 14.88it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  21%|██        | 3809/17944 [05:21<12:58, 18.16it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  21%|██▏       | 3817/17944 [05:22<11:44, 20.04it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  21%|██▏       | 3825/17944 [05:22<10:22, 22.69it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  21%|██▏       | 3833/17944 [05:22<09:39, 24.37it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  21%|██▏       | 3841/17944 [05:23<10:12, 23.03it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  21%|██▏       | 3849/17944 [05:23<09:00, 26.06it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  21%|██▏       | 3857/17944 [05:23<10:46, 21.79it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  22%|██▏       | 3865/17944 [05:24<15:24, 15.22it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  22%|██▏       | 3873/17944 [05:25<16:33, 14.17it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  22%|██▏       | 3881/17944 [05:25<13:27, 17.41it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  22%|██▏       | 3889/17944 [05:26<18:26, 12.70it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  22%|██▏       | 3897/17944 [05:27<20:07, 11.63it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  22%|██▏       | 3905/17944 [05:28<19:16, 12.14it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  22%|██▏       | 3913/17944 [05:28<14:51, 15.75it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  22%|██▏       | 3921/17944 [05:28<13:29, 17.33it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  22%|██▏       | 3929/17944 [05:28<12:20, 18.93it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  22%|██▏       | 3937/17944 [05:29<11:31, 20.26it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  22%|██▏       | 3945/17944 [05:29<10:56, 21.33it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  22%|██▏       | 3953/17944 [05:29<10:16, 22.71it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  22%|██▏       | 3961/17944 [05:30<09:32, 24.40it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  22%|██▏       | 3969/17944 [05:30<11:33, 20.15it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  22%|██▏       | 3977/17944 [05:31<11:11, 20.79it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  22%|██▏       | 3985/17944 [05:31<09:26, 24.63it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  22%|██▏       | 3993/17944 [05:31<08:58, 25.88it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  22%|██▏       | 4001/17944 [05:31<10:21, 22.44it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  22%|██▏       | 4009/17944 [05:39<1:14:43,  3.11it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  22%|██▏       | 4017/17944 [05:40<58:35,  3.96it/s]  The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  22%|██▏       | 4025/17944 [05:40<43:03,  5.39it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  22%|██▏       | 4033/17944 [05:41<34:27,  6.73it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  23%|██▎       | 4041/17944 [05:41<26:10,  8.85it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  23%|██▎       | 4049/17944 [05:41<20:23, 11.36it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  23%|██▎       | 4057/17944 [05:41<16:08, 14.34it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  23%|██▎       | 4065/17944 [05:42<13:52, 16.66it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  23%|██▎       | 4073/17944 [05:42<13:45, 16.81it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  23%|██▎       | 4081/17944 [05:42<12:10, 18.97it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  23%|██▎       | 4089/17944 [05:43<10:21, 22.31it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  23%|██▎       | 4097/17944 [05:43<09:03, 25.45it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  23%|██▎       | 4105/17944 [05:43<07:39, 30.09it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  23%|██▎       | 4113/17944 [05:44<09:54, 23.25it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  23%|██▎       | 4121/17944 [05:44<11:33, 19.93it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  23%|██▎       | 4129/17944 [05:44<10:10, 22.64it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  23%|██▎       | 4137/17944 [05:45<09:12, 25.01it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  23%|██▎       | 4145/17944 [05:45<08:16, 27.80it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  23%|██▎       | 4153/17944 [05:45<07:52, 29.17it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  23%|██▎       | 4161/17944 [05:45<09:20, 24.58it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  23%|██▎       | 4169/17944 [05:46<14:40, 15.64it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  23%|██▎       | 4177/17944 [05:47<12:05, 18.99it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  23%|██▎       | 4185/17944 [05:47<11:17, 20.30it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  23%|██▎       | 4193/17944 [05:47<10:14, 22.40it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  23%|██▎       | 4201/17944 [05:48<14:11, 16.14it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  23%|██▎       | 4209/17944 [05:49<14:13, 16.08it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  24%|██▎       | 4217/17944 [05:49<11:16, 20.29it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  24%|██▎       | 4225/17944 [05:50<15:26, 14.81it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  24%|██▎       | 4233/17944 [05:50<18:17, 12.50it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  24%|██▎       | 4241/17944 [05:51<14:36, 15.64it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  24%|██▎       | 4249/17944 [05:51<12:02, 18.97it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  24%|██▎       | 4257/17944 [05:52<15:10, 15.04it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  24%|██▍       | 4265/17944 [05:52<13:12, 17.27it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  24%|██▍       | 4273/17944 [05:52<11:49, 19.26it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  24%|██▍       | 4281/17944 [05:56<37:51,  6.02it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  24%|██▍       | 4289/17944 [05:56<29:04,  7.83it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  24%|██▍       | 4297/17944 [05:57<26:54,  8.45it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  24%|██▍       | 4305/17944 [05:57<20:53, 10.88it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  24%|██▍       | 4313/17944 [05:57<16:26, 13.82it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  24%|██▍       | 4321/17944 [05:58<18:32, 12.25it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  24%|██▍       | 4329/17944 [05:58<14:47, 15.34it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  24%|██▍       | 4337/17944 [05:59<11:54, 19.04it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  24%|██▍       | 4345/17944 [05:59<09:53, 22.90it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  24%|██▍       | 4353/17944 [05:59<08:44, 25.91it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  24%|██▍       | 4361/17944 [05:59<09:09, 24.72it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  24%|██▍       | 4369/17944 [06:00<08:26, 26.79it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  24%|██▍       | 4377/17944 [06:00<09:21, 24.17it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  24%|██▍       | 4385/17944 [06:01<12:28, 18.12it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  24%|██▍       | 4393/17944 [06:02<16:23, 13.78it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  25%|██▍       | 4401/17944 [06:02<16:32, 13.64it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  25%|██▍       | 4409/17944 [06:02<13:51, 16.27it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  25%|██▍       | 4417/17944 [06:03<15:13, 14.81it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  25%|██▍       | 4425/17944 [06:04<17:09, 13.13it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  25%|██▍       | 4433/17944 [06:04<13:50, 16.27it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  25%|██▍       | 4441/17944 [06:04<11:46, 19.11it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  25%|██▍       | 4449/17944 [06:05<11:47, 19.07it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  25%|██▍       | 4457/17944 [06:05<10:48, 20.81it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  25%|██▍       | 4465/17944 [06:05<10:21, 21.68it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  25%|██▍       | 4473/17944 [06:06<14:27, 15.53it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  25%|██▍       | 4481/17944 [06:06<12:40, 17.71it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  25%|██▌       | 4489/17944 [06:07<14:16, 15.71it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  25%|██▌       | 4497/17944 [06:07<11:59, 18.69it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  25%|██▌       | 4505/17944 [06:08<10:11, 21.98it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  25%|██▌       | 4513/17944 [06:08<10:02, 22.29it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  25%|██▌       | 4521/17944 [06:08<08:18, 26.92it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  25%|██▌       | 4529/17944 [06:08<07:50, 28.49it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  25%|██▌       | 4537/17944 [06:09<08:26, 26.46it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  25%|██▌       | 4545/17944 [06:09<09:35, 23.28it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  25%|██▌       | 4553/17944 [06:10<12:06, 18.44it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  25%|██▌       | 4561/17944 [06:10<12:52, 17.33it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  25%|██▌       | 4569/17944 [06:11<10:59, 20.27it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  26%|██▌       | 4577/17944 [06:11<11:22, 19.59it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  26%|██▌       | 4585/17944 [06:11<10:12, 21.83it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  26%|██▌       | 4593/17944 [06:11<09:08, 24.34it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  26%|██▌       | 4601/17944 [06:12<08:25, 26.37it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  26%|██▌       | 4609/17944 [06:14<26:01,  8.54it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  26%|██▌       | 4617/17944 [06:15<26:57,  8.24it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  26%|██▌       | 4625/17944 [06:16<27:46,  7.99it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  26%|██▌       | 4633/17944 [06:17<27:08,  8.17it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  26%|██▌       | 4641/17944 [06:18<21:34, 10.27it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  26%|██▌       | 4649/17944 [06:18<22:28,  9.86it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  26%|██▌       | 4657/17944 [06:19<18:03, 12.26it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  26%|██▌       | 4665/17944 [06:20<19:54, 11.12it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  26%|██▌       | 4673/17944 [06:20<15:13, 14.53it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  26%|██▌       | 4681/17944 [06:21<17:51, 12.37it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  26%|██▌       | 4689/17944 [06:21<13:47, 16.02it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  26%|██▌       | 4697/17944 [06:21<11:10, 19.75it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  26%|██▌       | 4705/17944 [06:21<11:31, 19.13it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  26%|██▋       | 4713/17944 [06:22<13:37, 16.18it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  26%|██▋       | 4721/17944 [06:22<11:45, 18.74it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  26%|██▋       | 4729/17944 [06:23<18:05, 12.18it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  26%|██▋       | 4737/17944 [06:24<14:52, 14.80it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  26%|██▋       | 4745/17944 [06:24<11:54, 18.47it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  26%|██▋       | 4753/17944 [06:24<10:05, 21.79it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  27%|██▋       | 4761/17944 [06:24<08:19, 26.38it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  27%|██▋       | 4769/17944 [06:24<07:06, 30.91it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  27%|██▋       | 4777/17944 [06:25<07:12, 30.41it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  27%|██▋       | 4785/17944 [06:25<06:47, 32.31it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  27%|██▋       | 4793/17944 [06:25<06:44, 32.54it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  27%|██▋       | 4801/17944 [06:25<06:41, 32.75it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  27%|██▋       | 4809/17944 [06:26<06:39, 32.91it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  27%|██▋       | 4817/17944 [06:26<07:08, 30.66it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  27%|██▋       | 4825/17944 [06:27<12:25, 17.61it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  27%|██▋       | 4833/17944 [06:27<10:25, 20.97it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  27%|██▋       | 4841/17944 [06:27<09:15, 23.60it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  27%|██▋       | 4849/17944 [06:28<08:11, 26.62it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  27%|██▋       | 4857/17944 [06:28<08:54, 24.48it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  27%|██▋       | 4865/17944 [06:29<13:51, 15.73it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  27%|██▋       | 4873/17944 [06:29<11:39, 18.68it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  27%|██▋       | 4881/17944 [06:30<13:26, 16.19it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  27%|██▋       | 4889/17944 [06:31<15:49, 13.75it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  27%|██▋       | 4897/17944 [06:31<17:01, 12.78it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  27%|██▋       | 4905/17944 [06:32<15:00, 14.48it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  27%|██▋       | 4913/17944 [06:32<12:11, 17.81it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  27%|██▋       | 4921/17944 [06:33<14:41, 14.77it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  27%|██▋       | 4929/17944 [06:33<11:45, 18.45it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  28%|██▊       | 4937/17944 [06:34<14:26, 15.02it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  28%|██▊       | 4945/17944 [06:34<12:16, 17.65it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  28%|██▊       | 4953/17944 [06:35<22:04,  9.81it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  28%|██▊       | 4961/17944 [06:36<17:23, 12.44it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  28%|██▊       | 4969/17944 [06:36<18:21, 11.78it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  28%|██▊       | 4977/17944 [06:37<14:18, 15.10it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  28%|██▊       | 4985/17944 [06:37<12:52, 16.77it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  28%|██▊       | 4993/17944 [06:37<11:53, 18.16it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  28%|██▊       | 5001/17944 [06:38<17:03, 12.64it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  28%|██▊       | 5009/17944 [06:39<17:35, 12.25it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  28%|██▊       | 5017/17944 [06:39<14:29, 14.86it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  28%|██▊       | 5025/17944 [06:41<19:17, 11.16it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  28%|██▊       | 5033/17944 [06:41<16:38, 12.94it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  28%|██▊       | 5041/17944 [06:41<14:02, 15.32it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  28%|██▊       | 5049/17944 [06:42<12:14, 17.56it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  28%|██▊       | 5057/17944 [06:42<10:01, 21.41it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  28%|██▊       | 5065/17944 [06:42<08:58, 23.93it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  28%|██▊       | 5073/17944 [06:42<08:12, 26.13it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  28%|██▊       | 5081/17944 [06:43<08:23, 25.56it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  28%|██▊       | 5089/17944 [06:43<07:47, 27.48it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  28%|██▊       | 5097/17944 [06:43<08:19, 25.72it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  28%|██▊       | 5105/17944 [06:43<07:46, 27.52it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  28%|██▊       | 5113/17944 [06:44<08:05, 26.45it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  29%|██▊       | 5121/17944 [06:44<07:08, 29.96it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  29%|██▊       | 5129/17944 [06:44<07:09, 29.82it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  29%|██▊       | 5137/17944 [06:45<11:33, 18.47it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  29%|██▊       | 5145/17944 [06:45<11:09, 19.11it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  29%|██▊       | 5153/17944 [06:46<13:54, 15.33it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  29%|██▉       | 5161/17944 [06:47<15:46, 13.50it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  29%|██▉       | 5169/17944 [06:48<17:13, 12.36it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  29%|██▉       | 5177/17944 [06:48<15:33, 13.68it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  29%|██▉       | 5185/17944 [06:49<16:43, 12.71it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  29%|██▉       | 5193/17944 [06:49<13:23, 15.87it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  29%|██▉       | 5201/17944 [06:50<17:55, 11.85it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  29%|██▉       | 5209/17944 [06:50<14:28, 14.66it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  29%|██▉       | 5217/17944 [06:51<12:05, 17.55it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  29%|██▉       | 5225/17944 [06:51<10:08, 20.91it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  29%|██▉       | 5233/17944 [06:51<09:00, 23.52it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  29%|██▉       | 5241/17944 [06:51<07:31, 28.14it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  29%|██▉       | 5249/17944 [06:51<06:55, 30.56it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  29%|██▉       | 5257/17944 [06:52<08:31, 24.80it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  29%|██▉       | 5265/17944 [06:53<11:01, 19.17it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  29%|██▉       | 5273/17944 [06:53<10:04, 20.96it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  29%|██▉       | 5281/17944 [06:53<09:25, 22.40it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  29%|██▉       | 5289/17944 [06:54<15:44, 13.40it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  30%|██▉       | 5297/17944 [06:55<13:14, 15.92it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  30%|██▉       | 5305/17944 [06:55<11:11, 18.81it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  30%|██▉       | 5313/17944 [06:55<09:32, 22.07it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  30%|██▉       | 5321/17944 [06:55<08:35, 24.48it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  30%|██▉       | 5329/17944 [06:56<07:55, 26.56it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  30%|██▉       | 5337/17944 [06:56<10:14, 20.51it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  30%|██▉       | 5345/17944 [06:56<09:05, 23.09it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  30%|██▉       | 5353/17944 [06:57<12:52, 16.29it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  30%|██▉       | 5361/17944 [06:57<10:41, 19.61it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  30%|██▉       | 5369/17944 [06:58<08:54, 23.51it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  30%|██▉       | 5377/17944 [07:05<1:07:15,  3.11it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  30%|███       | 5385/17944 [07:06<48:45,  4.29it/s]  The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  30%|███       | 5393/17944 [07:06<35:47,  5.85it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  30%|███       | 5401/17944 [07:06<26:14,  7.97it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  30%|███       | 5409/17944 [07:06<22:00,  9.49it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  30%|███       | 5417/17944 [07:07<18:12, 11.47it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  30%|███       | 5425/17944 [07:07<14:23, 14.50it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  30%|███       | 5433/17944 [07:08<21:07,  9.87it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  30%|███       | 5441/17944 [07:09<16:30, 12.63it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  30%|███       | 5449/17944 [07:09<13:23, 15.55it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  30%|███       | 5457/17944 [07:10<17:05, 12.18it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  30%|███       | 5465/17944 [07:10<14:01, 14.83it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  31%|███       | 5473/17944 [07:10<12:40, 16.39it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  31%|███       | 5481/17944 [07:18<1:11:12,  2.92it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  31%|███       | 5489/17944 [07:19<52:05,  3.98it/s]  The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  31%|███       | 5497/17944 [07:20<47:27,  4.37it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  31%|███       | 5505/17944 [07:21<41:18,  5.02it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  31%|███       | 5513/17944 [07:22<34:24,  6.02it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  31%|███       | 5521/17944 [07:22<25:27,  8.13it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  31%|███       | 5529/17944 [07:23<24:11,  8.55it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  31%|███       | 5537/17944 [07:24<22:01,  9.39it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  31%|███       | 5545/17944 [07:24<18:47, 11.00it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  31%|███       | 5553/17944 [07:24<14:44, 14.00it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  31%|███       | 5561/17944 [07:24<11:29, 17.96it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  31%|███       | 5569/17944 [07:25<09:25, 21.88it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  31%|███       | 5577/17944 [07:26<16:42, 12.34it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  31%|███       | 5585/17944 [07:26<13:04, 15.76it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  31%|███       | 5593/17944 [07:26<10:44, 19.16it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  31%|███       | 5601/17944 [07:26<08:54, 23.10it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  31%|███▏      | 5609/17944 [07:27<10:42, 19.21it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  31%|███▏      | 5617/17944 [07:27<09:18, 22.05it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  31%|███▏      | 5625/17944 [07:28<11:50, 17.34it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  31%|███▏      | 5633/17944 [07:28<10:06, 20.31it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  31%|███▏      | 5641/17944 [07:29<12:48, 16.01it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  31%|███▏      | 5649/17944 [07:30<14:39, 13.98it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  32%|███▏      | 5657/17944 [07:30<11:38, 17.59it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  32%|███▏      | 5665/17944 [07:30<09:57, 20.54it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  32%|███▏      | 5673/17944 [07:30<08:47, 23.26it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  32%|███▏      | 5681/17944 [07:31<07:32, 27.10it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  32%|███▏      | 5689/17944 [07:31<09:34, 21.32it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  32%|███▏      | 5697/17944 [07:31<08:18, 24.58it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  32%|███▏      | 5705/17944 [07:32<13:04, 15.60it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  32%|███▏      | 5713/17944 [07:33<15:19, 13.30it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  32%|███▏      | 5721/17944 [07:34<14:43, 13.83it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  32%|███▏      | 5729/17944 [07:34<12:32, 16.22it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  32%|███▏      | 5737/17944 [07:34<11:01, 18.46it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  32%|███▏      | 5745/17944 [07:35<14:46, 13.77it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  32%|███▏      | 5753/17944 [07:35<12:09, 16.71it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  32%|███▏      | 5761/17944 [07:36<10:20, 19.63it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  32%|███▏      | 5769/17944 [07:36<09:32, 21.27it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  32%|███▏      | 5777/17944 [07:36<10:12, 19.86it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  32%|███▏      | 5785/17944 [07:37<08:57, 22.63it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  32%|███▏      | 5793/17944 [07:37<08:42, 23.25it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  32%|███▏      | 5801/17944 [07:37<08:33, 23.66it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  32%|███▏      | 5809/17944 [07:38<10:49, 18.67it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  32%|███▏      | 5817/17944 [07:38<08:56, 22.58it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  32%|███▏      | 5825/17944 [07:46<1:04:39,  3.12it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  33%|███▎      | 5833/17944 [07:46<48:08,  4.19it/s]  The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  33%|███▎      | 5841/17944 [07:46<35:41,  5.65it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  33%|███▎      | 5849/17944 [07:47<30:13,  6.67it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  33%|███▎      | 5857/17944 [07:47<23:09,  8.70it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  33%|███▎      | 5865/17944 [07:48<17:33, 11.47it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  33%|███▎      | 5873/17944 [07:48<13:52, 14.49it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  33%|███▎      | 5881/17944 [07:48<11:32, 17.42it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  33%|███▎      | 5889/17944 [07:48<09:53, 20.31it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  33%|███▎      | 5897/17944 [07:49<11:05, 18.11it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  33%|███▎      | 5905/17944 [07:49<09:32, 21.01it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  33%|███▎      | 5913/17944 [07:49<08:41, 23.08it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  33%|███▎      | 5921/17944 [07:50<09:07, 21.95it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  33%|███▎      | 5929/17944 [07:50<10:44, 18.63it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  33%|███▎      | 5937/17944 [07:50<08:39, 23.11it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  33%|███▎      | 5945/17944 [07:51<07:37, 26.22it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  33%|███▎      | 5953/17944 [07:51<06:40, 29.94it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  33%|███▎      | 5961/17944 [07:51<06:14, 31.96it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  33%|███▎      | 5969/17944 [07:51<06:15, 31.91it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  33%|███▎      | 5977/17944 [07:52<06:11, 32.19it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  33%|███▎      | 5985/17944 [07:52<08:58, 22.20it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  33%|███▎      | 5993/17944 [07:53<09:49, 20.27it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  33%|███▎      | 6001/17944 [07:53<08:13, 24.19it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  33%|███▎      | 6009/17944 [07:53<07:21, 27.04it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  34%|███▎      | 6017/17944 [08:01<1:03:25,  3.13it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  34%|███▎      | 6025/17944 [08:01<46:38,  4.26it/s]  The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  34%|███▎      | 6033/17944 [08:01<34:40,  5.73it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  34%|███▎      | 6041/17944 [08:02<26:17,  7.54it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  34%|███▎      | 6049/17944 [08:02<20:11,  9.82it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  34%|███▍      | 6057/17944 [08:03<19:50,  9.98it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  34%|███▍      | 6065/17944 [08:04<21:30,  9.20it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  34%|███▍      | 6073/17944 [08:04<16:37, 11.89it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  34%|███▍      | 6081/17944 [08:04<13:13, 14.95it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  34%|███▍      | 6089/17944 [08:05<11:55, 16.58it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  34%|███▍      | 6097/17944 [08:05<10:07, 19.49it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  34%|███▍      | 6105/17944 [08:05<09:46, 20.19it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  34%|███▍      | 6113/17944 [08:05<09:28, 20.80it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  34%|███▍      | 6121/17944 [08:06<09:03, 21.74it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  34%|███▍      | 6129/17944 [08:07<12:05, 16.29it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  34%|███▍      | 6137/17944 [08:15<1:07:09,  2.93it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  34%|███▍      | 6145/17944 [08:15<48:57,  4.02it/s]  The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  34%|███▍      | 6153/17944 [08:15<37:43,  5.21it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  34%|███▍      | 6161/17944 [08:16<31:12,  6.29it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  34%|███▍      | 6169/17944 [08:17<30:06,  6.52it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  34%|███▍      | 6177/17944 [08:17<22:52,  8.57it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  34%|███▍      | 6185/17944 [08:18<18:39, 10.50it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  35%|███▍      | 6193/17944 [08:18<15:04, 13.00it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  35%|███▍      | 6201/17944 [08:18<14:17, 13.70it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  35%|███▍      | 6209/17944 [08:19<11:33, 16.91it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  35%|███▍      | 6217/17944 [08:19<09:44, 20.06it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  35%|███▍      | 6225/17944 [08:19<08:55, 21.89it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  35%|███▍      | 6233/17944 [08:19<08:14, 23.67it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  35%|███▍      | 6241/17944 [08:22<27:20,  7.13it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  35%|███▍      | 6249/17944 [08:23<21:06,  9.24it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  35%|███▍      | 6257/17944 [08:23<16:43, 11.64it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  35%|███▍      | 6265/17944 [08:23<13:55, 13.98it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  35%|███▍      | 6273/17944 [08:24<11:58, 16.25it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  35%|███▌      | 6281/17944 [08:26<28:03,  6.93it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  35%|███▌      | 6289/17944 [08:29<38:33,  5.04it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  35%|███▌      | 6297/17944 [08:29<30:14,  6.42it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  35%|███▌      | 6305/17944 [08:30<22:41,  8.55it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  35%|███▌      | 6313/17944 [08:30<21:11,  9.15it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  35%|███▌      | 6321/17944 [08:31<16:34, 11.69it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  35%|███▌      | 6329/17944 [08:31<13:38, 14.20it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  35%|███▌      | 6337/17944 [08:31<12:32, 15.43it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  35%|███▌      | 6345/17944 [08:32<13:28, 14.35it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  35%|███▌      | 6353/17944 [08:32<11:23, 16.95it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  35%|███▌      | 6361/17944 [08:32<09:43, 19.84it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  35%|███▌      | 6369/17944 [08:33<10:27, 18.44it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  36%|███▌      | 6377/17944 [08:34<12:26, 15.50it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  36%|███▌      | 6385/17944 [08:34<13:22, 14.41it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  36%|███▌      | 6393/17944 [08:34<10:41, 18.02it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  36%|███▌      | 6401/17944 [08:35<12:36, 15.26it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  36%|███▌      | 6409/17944 [08:35<11:25, 16.83it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  36%|███▌      | 6417/17944 [08:36<13:42, 14.02it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  36%|███▌      | 6425/17944 [08:36<10:54, 17.61it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  36%|███▌      | 6433/17944 [08:37<09:46, 19.62it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  36%|███▌      | 6441/17944 [08:37<08:34, 22.35it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  36%|███▌      | 6449/17944 [08:37<07:19, 26.15it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  36%|███▌      | 6457/17944 [08:38<07:29, 25.57it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  36%|███▌      | 6465/17944 [08:38<07:23, 25.89it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  36%|███▌      | 6473/17944 [08:38<06:53, 27.75it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  36%|███▌      | 6481/17944 [08:38<06:07, 31.17it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  36%|███▌      | 6489/17944 [08:39<07:05, 26.95it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  36%|███▌      | 6497/17944 [08:40<11:25, 16.69it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  36%|███▋      | 6505/17944 [08:40<14:16, 13.36it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  36%|███▋      | 6513/17944 [08:41<11:17, 16.88it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  36%|███▋      | 6521/17944 [08:41<09:36, 19.80it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  36%|███▋      | 6529/17944 [08:41<11:17, 16.85it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  36%|███▋      | 6537/17944 [08:42<10:13, 18.58it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  36%|███▋      | 6545/17944 [08:42<11:43, 16.19it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  37%|███▋      | 6553/17944 [08:43<10:44, 17.67it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  37%|███▋      | 6561/17944 [08:44<15:00, 12.64it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  37%|███▋      | 6569/17944 [08:45<15:18, 12.38it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  37%|███▋      | 6577/17944 [08:45<12:00, 15.78it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  37%|███▋      | 6585/17944 [08:45<11:09, 16.97it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  37%|███▋      | 6593/17944 [08:45<09:06, 20.78it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  37%|███▋      | 6601/17944 [08:45<07:40, 24.65it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  37%|███▋      | 6609/17944 [08:46<07:17, 25.91it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  37%|███▋      | 6617/17944 [08:46<07:13, 26.15it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  37%|███▋      | 6625/17944 [08:46<06:33, 28.74it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  37%|███▋      | 6633/17944 [08:46<05:43, 32.91it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  37%|███▋      | 6641/17944 [08:47<06:20, 29.74it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  37%|███▋      | 6649/17944 [08:47<06:55, 27.18it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  37%|███▋      | 6657/17944 [08:47<06:33, 28.65it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  37%|███▋      | 6665/17944 [08:48<06:06, 30.81it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  37%|███▋      | 6673/17944 [08:48<05:34, 33.75it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  37%|███▋      | 6681/17944 [08:49<10:31, 17.84it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  37%|███▋      | 6689/17944 [08:49<12:42, 14.77it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  37%|███▋      | 6697/17944 [08:50<10:59, 17.06it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  37%|███▋      | 6705/17944 [08:50<10:01, 18.67it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  37%|███▋      | 6713/17944 [08:51<11:35, 16.14it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  37%|███▋      | 6721/17944 [08:55<41:02,  4.56it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  38%|███▊      | 6729/17944 [08:56<30:37,  6.10it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  38%|███▊      | 6737/17944 [08:56<23:20,  8.00it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  38%|███▊      | 6745/17944 [08:56<17:49, 10.47it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  38%|███▊      | 6753/17944 [08:57<17:25, 10.70it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  38%|███▊      | 6761/17944 [08:57<14:29, 12.86it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  38%|███▊      | 6769/17944 [08:58<12:56, 14.39it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  38%|███▊      | 6777/17944 [08:58<11:22, 16.37it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  38%|███▊      | 6785/17944 [08:58<09:13, 20.15it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  38%|███▊      | 6793/17944 [08:58<08:08, 22.80it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  38%|███▊      | 6801/17944 [08:59<09:27, 19.62it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  38%|███▊      | 6809/17944 [08:59<08:43, 21.28it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  38%|███▊      | 6817/17944 [09:07<59:47,  3.10it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  38%|███▊      | 6825/17944 [09:08<46:31,  3.98it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  38%|███▊      | 6833/17944 [09:08<36:00,  5.14it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  38%|███▊      | 6841/17944 [09:08<26:27,  6.99it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  38%|███▊      | 6849/17944 [09:09<19:58,  9.26it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  38%|███▊      | 6857/17944 [09:09<15:42, 11.76it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  38%|███▊      | 6865/17944 [09:09<13:03, 14.14it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  38%|███▊      | 6873/17944 [09:09<10:47, 17.10it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  38%|███▊      | 6881/17944 [09:10<09:23, 19.62it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  38%|███▊      | 6889/17944 [09:10<08:01, 22.97it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  38%|███▊      | 6897/17944 [09:10<09:13, 19.95it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  38%|███▊      | 6905/17944 [09:11<09:39, 19.04it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  39%|███▊      | 6913/17944 [09:11<08:24, 21.85it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  39%|███▊      | 6921/17944 [09:11<07:19, 25.10it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  39%|███▊      | 6929/17944 [09:11<06:56, 26.43it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  39%|███▊      | 6937/17944 [09:12<08:04, 22.71it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  39%|███▊      | 6945/17944 [09:12<07:16, 25.18it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  39%|███▊      | 6953/17944 [09:13<09:38, 19.01it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  39%|███▉      | 6961/17944 [09:14<11:19, 16.17it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  39%|███▉      | 6969/17944 [09:14<13:05, 13.97it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  39%|███▉      | 6977/17944 [09:15<13:20, 13.69it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  39%|███▉      | 6985/17944 [09:16<14:12, 12.85it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  39%|███▉      | 6993/17944 [09:16<13:10, 13.85it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  39%|███▉      | 7001/17944 [09:17<13:58, 13.05it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  39%|███▉      | 7009/17944 [09:17<11:36, 15.70it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  39%|███▉      | 7017/17944 [09:18<12:40, 14.37it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  39%|███▉      | 7025/17944 [09:18<13:13, 13.76it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  39%|███▉      | 7033/17944 [09:19<15:41, 11.59it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  39%|███▉      | 7041/17944 [09:20<15:53, 11.44it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  39%|███▉      | 7049/17944 [09:21<16:15, 11.17it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  39%|███▉      | 7057/17944 [09:21<13:40, 13.27it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  39%|███▉      | 7065/17944 [09:21<11:23, 15.91it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  39%|███▉      | 7073/17944 [09:22<10:44, 16.85it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  39%|███▉      | 7081/17944 [09:23<14:11, 12.76it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  40%|███▉      | 7089/17944 [09:23<11:55, 15.17it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  40%|███▉      | 7097/17944 [09:24<13:58, 12.93it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  40%|███▉      | 7105/17944 [09:24<11:11, 16.14it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  40%|███▉      | 7113/17944 [09:24<09:26, 19.13it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  40%|███▉      | 7121/17944 [09:25<08:00, 22.54it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  40%|███▉      | 7129/17944 [09:25<07:45, 23.22it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  40%|███▉      | 7137/17944 [09:25<08:45, 20.57it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  40%|███▉      | 7145/17944 [09:26<07:20, 24.50it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  40%|███▉      | 7153/17944 [09:26<06:44, 26.68it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  40%|███▉      | 7161/17944 [09:26<09:12, 19.50it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  40%|███▉      | 7169/17944 [09:27<10:35, 16.95it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  40%|███▉      | 7177/17944 [09:28<11:50, 15.15it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  40%|████      | 7185/17944 [09:28<10:25, 17.20it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  40%|████      | 7193/17944 [09:28<09:15, 19.37it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  40%|████      | 7201/17944 [09:29<08:32, 20.96it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  40%|████      | 7209/17944 [09:29<07:55, 22.57it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  40%|████      | 7217/17944 [09:29<07:07, 25.07it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  40%|████      | 7225/17944 [09:29<06:56, 25.72it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  40%|████      | 7233/17944 [09:30<06:37, 26.95it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  40%|████      | 7241/17944 [09:30<06:12, 28.75it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  40%|████      | 7249/17944 [09:30<05:55, 30.11it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  40%|████      | 7257/17944 [09:30<05:54, 30.12it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  40%|████      | 7265/17944 [09:31<05:21, 33.20it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  41%|████      | 7273/17944 [09:31<05:10, 34.42it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  41%|████      | 7281/17944 [09:31<05:44, 30.99it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  41%|████      | 7289/17944 [09:31<05:34, 31.87it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  41%|████      | 7297/17944 [09:32<05:39, 31.40it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  41%|████      | 7305/17944 [09:32<05:19, 33.30it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  41%|████      | 7313/17944 [09:33<09:23, 18.86it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  41%|████      | 7321/17944 [09:33<07:35, 23.33it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  41%|████      | 7329/17944 [09:34<15:51, 11.16it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  41%|████      | 7337/17944 [09:35<12:05, 14.61it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  41%|████      | 7345/17944 [09:35<12:27, 14.18it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  41%|████      | 7353/17944 [09:36<10:50, 16.27it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  41%|████      | 7361/17944 [09:36<09:31, 18.52it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  41%|████      | 7369/17944 [09:36<08:01, 21.95it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  41%|████      | 7377/17944 [09:36<06:59, 25.19it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  41%|████      | 7385/17944 [09:37<06:37, 26.55it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  41%|████      | 7393/17944 [09:37<10:32, 16.68it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  41%|████      | 7401/17944 [09:38<13:09, 13.35it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  41%|████▏     | 7409/17944 [09:39<11:40, 15.05it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  41%|████▏     | 7417/17944 [09:39<09:31, 18.43it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  41%|████▏     | 7425/17944 [09:39<08:23, 20.89it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  41%|████▏     | 7433/17944 [09:40<09:52, 17.75it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  41%|████▏     | 7441/17944 [09:40<11:29, 15.23it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  42%|████▏     | 7449/17944 [09:45<40:51,  4.28it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  42%|████▏     | 7457/17944 [09:46<32:53,  5.31it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  42%|████▏     | 7465/17944 [09:48<33:12,  5.26it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  42%|████▏     | 7473/17944 [09:55<1:13:49,  2.36it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  42%|████▏     | 7481/17944 [09:56<56:29,  3.09it/s]  The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  42%|████▏     | 7489/17944 [09:56<41:36,  4.19it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  42%|████▏     | 7497/17944 [09:57<31:21,  5.55it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  42%|████▏     | 7505/17944 [09:57<25:07,  6.93it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  42%|████▏     | 7513/17944 [09:57<18:33,  9.37it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  42%|████▏     | 7521/17944 [09:58<14:31, 11.96it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  42%|████▏     | 7529/17944 [09:58<11:08, 15.58it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  42%|████▏     | 7537/17944 [09:58<09:20, 18.57it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  42%|████▏     | 7545/17944 [09:58<08:04, 21.45it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  42%|████▏     | 7553/17944 [09:58<06:49, 25.36it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  42%|████▏     | 7561/17944 [09:59<06:53, 25.10it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  42%|████▏     | 7569/17944 [09:59<06:22, 27.14it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  42%|████▏     | 7577/17944 [09:59<05:26, 31.72it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  42%|████▏     | 7585/17944 [10:01<12:41, 13.61it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  42%|████▏     | 7593/17944 [10:01<12:26, 13.86it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  42%|████▏     | 7601/17944 [10:01<10:25, 16.54it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  42%|████▏     | 7609/17944 [10:02<08:38, 19.94it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  42%|████▏     | 7617/17944 [10:02<09:01, 19.08it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  42%|████▏     | 7625/17944 [10:02<08:00, 21.48it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  43%|████▎     | 7633/17944 [10:03<07:06, 24.16it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  43%|████▎     | 7641/17944 [10:03<08:07, 21.12it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  43%|████▎     | 7649/17944 [10:03<07:03, 24.33it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  43%|████▎     | 7657/17944 [10:03<06:15, 27.38it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  43%|████▎     | 7665/17944 [10:04<05:42, 29.99it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  43%|████▎     | 7673/17944 [10:04<05:30, 31.08it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  43%|████▎     | 7681/17944 [10:05<09:23, 18.21it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  43%|████▎     | 7689/17944 [10:05<08:04, 21.18it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  43%|████▎     | 7697/17944 [10:05<06:57, 24.53it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  43%|████▎     | 7705/17944 [10:05<06:11, 27.53it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  43%|████▎     | 7713/17944 [10:06<05:39, 30.15it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  43%|████▎     | 7721/17944 [10:06<05:26, 31.26it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  43%|████▎     | 7729/17944 [10:06<05:18, 32.12it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  43%|████▎     | 7737/17944 [10:08<17:36,  9.66it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  43%|████▎     | 7745/17944 [10:08<13:40, 12.43it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  43%|████▎     | 7753/17944 [10:09<10:54, 15.57it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  43%|████▎     | 7761/17944 [10:09<12:11, 13.92it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  43%|████▎     | 7769/17944 [10:10<13:13, 12.83it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  43%|████▎     | 7777/17944 [10:11<13:17, 12.76it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  43%|████▎     | 7785/17944 [10:11<13:43, 12.34it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  43%|████▎     | 7793/17944 [10:12<11:05, 15.26it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  43%|████▎     | 7801/17944 [10:12<08:53, 19.01it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  44%|████▎     | 7809/17944 [10:12<07:54, 21.37it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  44%|████▎     | 7817/17944 [10:13<08:38, 19.53it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  44%|████▎     | 7825/17944 [10:13<07:22, 22.88it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  44%|████▎     | 7833/17944 [10:13<07:23, 22.80it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  44%|████▎     | 7841/17944 [10:14<09:10, 18.35it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  44%|████▎     | 7849/17944 [10:14<10:04, 16.70it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  44%|████▍     | 7857/17944 [10:15<11:04, 15.18it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  44%|████▍     | 7865/17944 [10:15<08:53, 18.91it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  44%|████▍     | 7873/17944 [10:16<10:46, 15.57it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  44%|████▍     | 7881/17944 [10:16<09:44, 17.22it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  44%|████▍     | 7889/17944 [10:17<11:09, 15.02it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  44%|████▍     | 7897/17944 [10:17<08:45, 19.12it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  44%|████▍     | 7905/17944 [10:17<08:09, 20.52it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  44%|████▍     | 7913/17944 [10:18<09:22, 17.82it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  44%|████▍     | 7921/17944 [10:18<07:42, 21.66it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  44%|████▍     | 7929/17944 [10:19<07:04, 23.59it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  44%|████▍     | 7937/17944 [10:19<10:11, 16.37it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  44%|████▍     | 7945/17944 [10:20<08:15, 20.19it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  44%|████▍     | 7953/17944 [10:20<06:53, 24.15it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  44%|████▍     | 7961/17944 [10:20<05:57, 27.94it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  44%|████▍     | 7969/17944 [10:20<06:10, 26.90it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  44%|████▍     | 7977/17944 [10:20<05:37, 29.56it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  44%|████▍     | 7985/17944 [10:21<07:00, 23.66it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  45%|████▍     | 7993/17944 [10:22<08:50, 18.74it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  45%|████▍     | 8001/17944 [10:22<07:29, 22.12it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  45%|████▍     | 8009/17944 [10:22<06:22, 25.98it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  45%|████▍     | 8017/17944 [10:22<05:56, 27.81it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  45%|████▍     | 8025/17944 [10:23<07:54, 20.89it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  45%|████▍     | 8033/17944 [10:24<11:01, 14.98it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  45%|████▍     | 8041/17944 [10:24<09:11, 17.97it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  45%|████▍     | 8049/17944 [10:24<07:44, 21.32it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  45%|████▍     | 8057/17944 [10:25<11:16, 14.61it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  45%|████▍     | 8065/17944 [10:25<09:11, 17.92it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  45%|████▍     | 8073/17944 [10:26<08:14, 19.94it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  45%|████▌     | 8081/17944 [10:26<07:26, 22.09it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  45%|████▌     | 8089/17944 [10:26<06:40, 24.62it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  45%|████▌     | 8097/17944 [10:26<06:09, 26.67it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  45%|████▌     | 8105/17944 [10:27<05:56, 27.57it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  45%|████▌     | 8113/17944 [10:28<10:21, 15.81it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  45%|████▌     | 8121/17944 [10:28<11:14, 14.56it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  45%|████▌     | 8129/17944 [10:29<09:43, 16.81it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  45%|████▌     | 8137/17944 [10:30<12:29, 13.09it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  45%|████▌     | 8145/17944 [10:30<11:24, 14.32it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  45%|████▌     | 8153/17944 [10:30<09:16, 17.61it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  45%|████▌     | 8161/17944 [10:30<07:25, 21.96it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  46%|████▌     | 8169/17944 [10:31<06:30, 25.05it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  46%|████▌     | 8177/17944 [10:31<05:54, 27.59it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  46%|████▌     | 8185/17944 [10:31<05:14, 31.02it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  46%|████▌     | 8193/17944 [10:31<06:51, 23.70it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  46%|████▌     | 8201/17944 [10:33<14:13, 11.42it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  46%|████▌     | 8209/17944 [10:33<10:53, 14.90it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  46%|████▌     | 8217/17944 [10:38<35:46,  4.53it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  46%|████▌     | 8225/17944 [10:38<28:36,  5.66it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  46%|████▌     | 8233/17944 [10:39<25:43,  6.29it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  46%|████▌     | 8241/17944 [10:43<40:03,  4.04it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  46%|████▌     | 8249/17944 [10:44<31:36,  5.11it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  46%|████▌     | 8257/17944 [10:44<24:15,  6.65it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  46%|████▌     | 8265/17944 [10:44<18:26,  8.75it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  46%|████▌     | 8273/17944 [10:45<16:26,  9.80it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  46%|████▌     | 8281/17944 [10:45<15:03, 10.69it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  46%|████▌     | 8289/17944 [10:46<11:37, 13.84it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  46%|████▌     | 8297/17944 [10:46<10:25, 15.41it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  46%|████▋     | 8305/17944 [10:46<08:54, 18.03it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  46%|████▋     | 8313/17944 [10:47<08:52, 18.10it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  46%|████▋     | 8321/17944 [10:48<15:08, 10.59it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  46%|████▋     | 8329/17944 [10:48<11:41, 13.71it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  46%|████▋     | 8337/17944 [10:48<09:05, 17.61it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  47%|████▋     | 8345/17944 [10:49<09:09, 17.46it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  47%|████▋     | 8353/17944 [10:49<07:29, 21.34it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  47%|████▋     | 8361/17944 [10:51<14:32, 10.99it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  47%|████▋     | 8369/17944 [10:51<14:10, 11.25it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  47%|████▋     | 8377/17944 [10:52<13:11, 12.08it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  47%|████▋     | 8385/17944 [10:52<12:31, 12.72it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  47%|████▋     | 8393/17944 [10:53<10:10, 15.64it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  47%|████▋     | 8401/17944 [10:53<08:52, 17.92it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  47%|████▋     | 8409/17944 [10:54<10:40, 14.88it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  47%|████▋     | 8417/17944 [10:54<08:32, 18.57it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  47%|████▋     | 8425/17944 [10:54<08:36, 18.42it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  47%|████▋     | 8433/17944 [10:55<08:58, 17.67it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  47%|████▋     | 8441/17944 [10:55<08:53, 17.80it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  47%|████▋     | 8449/17944 [10:56<07:58, 19.84it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  47%|████▋     | 8457/17944 [10:56<07:09, 22.10it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  47%|████▋     | 8465/17944 [10:56<06:14, 25.31it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  47%|████▋     | 8473/17944 [10:56<06:17, 25.10it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  47%|████▋     | 8481/17944 [10:57<06:59, 22.56it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  47%|████▋     | 8489/17944 [10:57<06:37, 23.78it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  47%|████▋     | 8497/17944 [10:57<06:01, 26.10it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  47%|████▋     | 8505/17944 [10:58<05:37, 27.93it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  47%|████▋     | 8513/17944 [10:58<07:01, 22.37it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  47%|████▋     | 8521/17944 [10:58<06:09, 25.51it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  48%|████▊     | 8529/17944 [10:59<05:42, 27.49it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  48%|████▊     | 8537/17944 [10:59<07:13, 21.69it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  48%|████▊     | 8545/17944 [11:00<09:28, 16.53it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  48%|████▊     | 8553/17944 [11:01<11:02, 14.17it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  48%|████▊     | 8561/17944 [11:01<08:37, 18.12it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  48%|████▊     | 8569/17944 [11:01<07:27, 20.96it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  48%|████▊     | 8577/17944 [11:02<08:49, 17.69it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  48%|████▊     | 8585/17944 [11:02<07:14, 21.55it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  48%|████▊     | 8593/17944 [11:02<08:39, 18.01it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  48%|████▊     | 8601/17944 [11:03<08:48, 17.69it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  48%|████▊     | 8609/17944 [11:03<07:02, 22.07it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  48%|████▊     | 8617/17944 [11:03<06:00, 25.85it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  48%|████▊     | 8625/17944 [11:04<07:47, 19.94it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  48%|████▊     | 8633/17944 [11:04<06:40, 23.24it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  48%|████▊     | 8641/17944 [11:04<06:04, 25.52it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  48%|████▊     | 8649/17944 [11:04<05:39, 27.39it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  48%|████▊     | 8657/17944 [11:05<06:23, 24.22it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  48%|████▊     | 8665/17944 [11:07<14:01, 11.02it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  48%|████▊     | 8673/17944 [11:07<12:32, 12.32it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  48%|████▊     | 8681/17944 [11:07<10:49, 14.27it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  48%|████▊     | 8689/17944 [11:15<52:32,  2.94it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  48%|████▊     | 8697/17944 [11:16<41:00,  3.76it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  49%|████▊     | 8705/17944 [11:17<32:24,  4.75it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  49%|████▊     | 8713/17944 [11:17<25:12,  6.10it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  49%|████▊     | 8721/17944 [11:17<19:13,  8.00it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  49%|████▊     | 8729/17944 [11:18<17:21,  8.85it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  49%|████▊     | 8737/17944 [11:19<16:02,  9.57it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  49%|████▊     | 8745/17944 [11:19<12:46, 12.01it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  49%|████▉     | 8753/17944 [11:19<10:58, 13.95it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  49%|████▉     | 8761/17944 [11:21<15:16, 10.02it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  49%|████▉     | 8769/17944 [11:21<11:43, 13.05it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  49%|████▉     | 8777/17944 [11:22<14:13, 10.75it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  49%|████▉     | 8785/17944 [11:22<11:09, 13.68it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  49%|████▉     | 8793/17944 [11:22<09:52, 15.44it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  49%|████▉     | 8801/17944 [11:23<08:56, 17.03it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  49%|████▉     | 8809/17944 [11:23<07:58, 19.09it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  49%|████▉     | 8817/17944 [11:24<09:28, 16.06it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  49%|████▉     | 8825/17944 [11:25<11:10, 13.60it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  49%|████▉     | 8833/17944 [11:26<13:50, 10.98it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  49%|████▉     | 8841/17944 [11:26<11:12, 13.54it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  49%|████▉     | 8849/17944 [11:26<11:19, 13.38it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  49%|████▉     | 8857/17944 [11:27<09:45, 15.51it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  49%|████▉     | 8865/17944 [11:27<08:40, 17.46it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  49%|████▉     | 8873/17944 [11:28<08:54, 16.98it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  49%|████▉     | 8881/17944 [11:28<07:25, 20.34it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  50%|████▉     | 8889/17944 [11:28<06:23, 23.60it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  50%|████▉     | 8897/17944 [11:28<05:30, 27.34it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  50%|████▉     | 8905/17944 [11:28<05:14, 28.78it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  50%|████▉     | 8913/17944 [11:29<04:51, 30.99it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  50%|████▉     | 8921/17944 [11:29<04:25, 34.01it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  50%|████▉     | 8929/17944 [11:29<05:54, 25.41it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  50%|████▉     | 8937/17944 [11:30<06:46, 22.16it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  50%|████▉     | 8945/17944 [11:30<06:43, 22.30it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  50%|████▉     | 8953/17944 [11:31<08:10, 18.34it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  50%|████▉     | 8961/17944 [11:31<07:04, 21.19it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  50%|████▉     | 8969/17944 [11:31<06:17, 23.78it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  50%|█████     | 8977/17944 [11:32<05:44, 26.00it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  50%|█████     | 8985/17944 [11:32<07:08, 20.93it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  50%|█████     | 8993/17944 [11:33<08:08, 18.33it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  50%|█████     | 9001/17944 [11:33<07:05, 21.04it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  50%|█████     | 9009/17944 [11:35<17:39,  8.43it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  50%|█████     | 9017/17944 [11:35<13:51, 10.74it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  50%|█████     | 9025/17944 [11:36<11:58, 12.41it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  50%|█████     | 9033/17944 [11:36<09:35, 15.49it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  50%|█████     | 9041/17944 [11:37<09:20, 15.90it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  50%|█████     | 9049/17944 [11:37<08:01, 18.48it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  50%|█████     | 9057/17944 [11:37<07:06, 20.82it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  51%|█████     | 9065/17944 [11:38<10:08, 14.59it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  51%|█████     | 9073/17944 [11:38<08:25, 17.56it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  51%|█████     | 9081/17944 [11:38<07:12, 20.49it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  51%|█████     | 9089/17944 [11:39<07:46, 19.00it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  51%|█████     | 9097/17944 [11:40<09:25, 15.64it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  51%|█████     | 9105/17944 [11:40<09:57, 14.81it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  51%|█████     | 9113/17944 [11:41<09:02, 16.27it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  51%|█████     | 9121/17944 [11:42<14:23, 10.22it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  51%|█████     | 9129/17944 [11:44<18:06,  8.11it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  51%|█████     | 9137/17944 [11:44<16:17,  9.01it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  51%|█████     | 9145/17944 [11:45<12:52, 11.39it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  51%|█████     | 9153/17944 [11:45<12:11, 12.02it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  51%|█████     | 9161/17944 [11:46<10:55, 13.40it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  51%|█████     | 9169/17944 [11:46<10:48, 13.53it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  51%|█████     | 9177/17944 [11:46<09:28, 15.41it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  51%|█████     | 9185/17944 [11:47<08:42, 16.77it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  51%|█████     | 9193/17944 [11:47<07:59, 18.24it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  51%|█████▏    | 9201/17944 [11:47<06:44, 21.63it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  51%|█████▏    | 9209/17944 [11:48<07:44, 18.80it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  51%|█████▏    | 9217/17944 [11:48<07:19, 19.84it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  51%|█████▏    | 9225/17944 [11:49<09:39, 15.03it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  51%|█████▏    | 9233/17944 [11:49<08:03, 18.02it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  51%|█████▏    | 9241/17944 [11:50<07:23, 19.64it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  52%|█████▏    | 9249/17944 [11:50<06:55, 20.95it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  52%|█████▏    | 9257/17944 [11:52<14:42,  9.85it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  52%|█████▏    | 9265/17944 [11:52<13:47, 10.49it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  52%|█████▏    | 9273/17944 [11:53<12:28, 11.58it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  52%|█████▏    | 9281/17944 [11:53<09:51, 14.65it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  52%|█████▏    | 9289/17944 [11:54<12:43, 11.33it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  52%|█████▏    | 9297/17944 [11:55<11:26, 12.59it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  52%|█████▏    | 9305/17944 [11:55<09:17, 15.49it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  52%|█████▏    | 9313/17944 [11:55<07:47, 18.46it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  52%|█████▏    | 9321/17944 [11:56<07:21, 19.51it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  52%|█████▏    | 9329/17944 [11:56<06:17, 22.82it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  52%|█████▏    | 9337/17944 [11:57<09:08, 15.69it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  52%|█████▏    | 9345/17944 [11:57<07:40, 18.68it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  52%|█████▏    | 9353/17944 [11:58<11:05, 12.92it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  52%|█████▏    | 9361/17944 [11:58<09:02, 15.81it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  52%|█████▏    | 9369/17944 [11:58<07:29, 19.09it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  52%|█████▏    | 9377/17944 [11:59<08:42, 16.39it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  52%|█████▏    | 9385/17944 [11:59<07:04, 20.14it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  52%|█████▏    | 9393/17944 [12:00<06:05, 23.38it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  52%|█████▏    | 9401/17944 [12:00<07:53, 18.05it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  52%|█████▏    | 9409/17944 [12:00<06:38, 21.42it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  52%|█████▏    | 9417/17944 [12:01<05:37, 25.28it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  53%|█████▎    | 9425/17944 [12:02<08:54, 15.94it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  53%|█████▎    | 9433/17944 [12:04<20:48,  6.81it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  53%|█████▎    | 9441/17944 [12:04<15:33,  9.11it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  53%|█████▎    | 9449/17944 [12:05<13:52, 10.20it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  53%|█████▎    | 9457/17944 [12:05<11:08, 12.69it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  53%|█████▎    | 9465/17944 [12:06<10:55, 12.94it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  53%|█████▎    | 9473/17944 [12:06<08:45, 16.12it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  53%|█████▎    | 9481/17944 [12:07<10:19, 13.67it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  53%|█████▎    | 9489/17944 [12:07<08:10, 17.23it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  53%|█████▎    | 9497/17944 [12:08<08:05, 17.40it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  53%|█████▎    | 9505/17944 [12:08<10:07, 13.88it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  53%|█████▎    | 9513/17944 [12:09<10:12, 13.75it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  53%|█████▎    | 9521/17944 [12:09<08:33, 16.40it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  53%|█████▎    | 9529/17944 [12:09<06:47, 20.67it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  53%|█████▎    | 9537/17944 [12:10<07:52, 17.80it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  53%|█████▎    | 9545/17944 [12:10<07:50, 17.85it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  53%|█████▎    | 9553/17944 [12:11<07:50, 17.84it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  53%|█████▎    | 9561/17944 [12:11<07:21, 19.00it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  53%|█████▎    | 9569/17944 [12:12<09:56, 14.03it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  53%|█████▎    | 9577/17944 [12:13<10:38, 13.11it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  53%|█████▎    | 9585/17944 [12:13<08:41, 16.02it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  53%|█████▎    | 9593/17944 [12:14<09:21, 14.87it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  54%|█████▎    | 9601/17944 [12:14<07:56, 17.49it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  54%|█████▎    | 9609/17944 [12:15<08:46, 15.83it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  54%|█████▎    | 9617/17944 [12:15<09:57, 13.93it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  54%|█████▎    | 9625/17944 [12:16<10:48, 12.83it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  54%|█████▎    | 9633/17944 [12:17<09:52, 14.04it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  54%|█████▎    | 9641/17944 [12:17<10:16, 13.46it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  54%|█████▍    | 9649/17944 [12:18<10:16, 13.46it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  54%|█████▍    | 9657/17944 [12:18<09:56, 13.90it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  54%|█████▍    | 9665/17944 [12:19<08:37, 15.99it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  54%|█████▍    | 9673/17944 [12:19<07:48, 17.65it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  54%|█████▍    | 9681/17944 [12:19<06:51, 20.09it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  54%|█████▍    | 9689/17944 [12:24<29:24,  4.68it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  54%|█████▍    | 9697/17944 [12:24<21:39,  6.35it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  54%|█████▍    | 9705/17944 [12:25<18:58,  7.24it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  54%|█████▍    | 9713/17944 [12:25<14:22,  9.54it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  54%|█████▍    | 9721/17944 [12:25<11:17, 12.13it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  54%|█████▍    | 9729/17944 [12:26<09:16, 14.75it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  54%|█████▍    | 9737/17944 [12:26<07:43, 17.70it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  54%|█████▍    | 9745/17944 [12:26<06:28, 21.10it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  54%|█████▍    | 9753/17944 [12:26<05:45, 23.72it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  54%|█████▍    | 9761/17944 [12:27<06:30, 20.95it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  54%|█████▍    | 9769/17944 [12:28<10:19, 13.20it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  54%|█████▍    | 9777/17944 [12:28<08:26, 16.11it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  55%|█████▍    | 9785/17944 [12:28<06:59, 19.46it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  55%|█████▍    | 9793/17944 [12:29<06:24, 21.20it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  55%|█████▍    | 9801/17944 [12:29<05:42, 23.74it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  55%|█████▍    | 9809/17944 [12:30<09:57, 13.62it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  55%|█████▍    | 9817/17944 [12:30<08:02, 16.84it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  55%|█████▍    | 9825/17944 [12:31<06:40, 20.27it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  55%|█████▍    | 9833/17944 [12:31<05:44, 23.57it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  55%|█████▍    | 9841/17944 [12:32<11:07, 12.13it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  55%|█████▍    | 9849/17944 [12:32<09:09, 14.74it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  55%|█████▍    | 9857/17944 [12:33<10:48, 12.47it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  55%|█████▍    | 9865/17944 [12:34<10:37, 12.67it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  55%|█████▌    | 9873/17944 [12:35<14:49,  9.08it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  55%|█████▌    | 9881/17944 [12:36<11:25, 11.77it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  55%|█████▌    | 9889/17944 [12:36<09:28, 14.16it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  55%|█████▌    | 9897/17944 [12:36<07:32, 17.79it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  55%|█████▌    | 9905/17944 [12:36<07:02, 19.03it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  55%|█████▌    | 9913/17944 [12:37<05:49, 22.98it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  55%|█████▌    | 9921/17944 [12:37<04:59, 26.83it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  55%|█████▌    | 9929/17944 [12:37<04:57, 26.92it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  55%|█████▌    | 9937/17944 [12:37<04:39, 28.69it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  55%|█████▌    | 9945/17944 [12:38<06:50, 19.47it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  55%|█████▌    | 9953/17944 [12:38<05:41, 23.40it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  56%|█████▌    | 9961/17944 [12:39<05:28, 24.33it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  56%|█████▌    | 9969/17944 [12:39<05:00, 26.51it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  56%|█████▌    | 9977/17944 [12:41<14:39,  9.06it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  56%|█████▌    | 9985/17944 [12:42<13:15, 10.00it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  56%|█████▌    | 9993/17944 [12:44<19:46,  6.70it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  56%|█████▌    | 10001/17944 [12:44<14:52,  8.90it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  56%|█████▌    | 10009/17944 [12:46<22:20,  5.92it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  56%|█████▌    | 10017/17944 [12:47<21:13,  6.22it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  56%|█████▌    | 10025/17944 [12:48<18:08,  7.27it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  56%|█████▌    | 10033/17944 [12:49<15:59,  8.24it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  56%|█████▌    | 10041/17944 [12:49<12:30, 10.53it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  56%|█████▌    | 10049/17944 [12:50<12:27, 10.56it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  56%|█████▌    | 10057/17944 [12:50<10:17, 12.77it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  56%|█████▌    | 10065/17944 [12:50<08:04, 16.26it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  56%|█████▌    | 10073/17944 [12:52<14:44,  8.90it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  56%|█████▌    | 10081/17944 [12:55<26:27,  4.95it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  56%|█████▌    | 10089/17944 [12:56<21:46,  6.01it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  56%|█████▋    | 10097/17944 [12:57<18:03,  7.24it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  56%|█████▋    | 10105/17944 [12:57<16:08,  8.10it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  56%|█████▋    | 10113/17944 [12:58<12:42, 10.27it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  56%|█████▋    | 10121/17944 [12:58<11:09, 11.68it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  56%|█████▋    | 10129/17944 [12:59<10:20, 12.60it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  56%|█████▋    | 10137/17944 [13:00<11:16, 11.54it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  57%|█████▋    | 10145/17944 [13:00<09:27, 13.75it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  57%|█████▋    | 10153/17944 [13:01<10:28, 12.40it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  57%|█████▋    | 10161/17944 [13:01<10:16, 12.63it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  57%|█████▋    | 10169/17944 [13:02<09:37, 13.46it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  57%|█████▋    | 10177/17944 [13:02<08:26, 15.34it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  57%|█████▋    | 10185/17944 [13:03<07:53, 16.40it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  57%|█████▋    | 10193/17944 [13:03<07:22, 17.52it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  57%|█████▋    | 10201/17944 [13:04<08:06, 15.92it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  57%|█████▋    | 10209/17944 [13:04<07:34, 17.01it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  57%|█████▋    | 10217/17944 [13:04<06:12, 20.75it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  57%|█████▋    | 10225/17944 [13:04<05:23, 23.87it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  57%|█████▋    | 10233/17944 [13:05<05:06, 25.12it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  57%|█████▋    | 10241/17944 [13:05<06:14, 20.59it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  57%|█████▋    | 10249/17944 [13:05<05:31, 23.19it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  57%|█████▋    | 10257/17944 [13:06<05:01, 25.49it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  57%|█████▋    | 10265/17944 [13:06<05:14, 24.38it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  57%|█████▋    | 10273/17944 [13:06<04:41, 27.27it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  57%|█████▋    | 10281/17944 [13:07<08:11, 15.59it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  57%|█████▋    | 10289/17944 [13:08<09:14, 13.81it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  57%|█████▋    | 10297/17944 [13:09<09:57, 12.79it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  57%|█████▋    | 10305/17944 [13:09<07:58, 15.95it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  57%|█████▋    | 10313/17944 [13:09<06:43, 18.89it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  58%|█████▊    | 10321/17944 [13:10<06:32, 19.40it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  58%|█████▊    | 10329/17944 [13:10<07:45, 16.37it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  58%|█████▊    | 10337/17944 [13:10<06:34, 19.26it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  58%|█████▊    | 10345/17944 [13:11<05:19, 23.77it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  58%|█████▊    | 10353/17944 [13:11<06:23, 19.79it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  58%|█████▊    | 10361/17944 [13:11<05:20, 23.63it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  58%|█████▊    | 10369/17944 [13:12<06:23, 19.74it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  58%|█████▊    | 10377/17944 [13:12<07:07, 17.70it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  58%|█████▊    | 10385/17944 [13:13<07:28, 16.86it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  58%|█████▊    | 10393/17944 [13:13<06:46, 18.57it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  58%|█████▊    | 10401/17944 [13:14<05:35, 22.47it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  58%|█████▊    | 10409/17944 [13:14<07:14, 17.35it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  58%|█████▊    | 10417/17944 [13:15<06:45, 18.58it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  58%|█████▊    | 10425/17944 [13:15<05:51, 21.39it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  58%|█████▊    | 10433/17944 [13:15<07:08, 17.52it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  58%|█████▊    | 10441/17944 [13:16<06:15, 19.98it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  58%|█████▊    | 10449/17944 [13:16<05:05, 24.51it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  58%|█████▊    | 10457/17944 [13:16<06:18, 19.78it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  58%|█████▊    | 10465/17944 [13:17<05:15, 23.70it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  58%|█████▊    | 10473/17944 [13:18<08:09, 15.26it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  58%|█████▊    | 10481/17944 [13:18<07:05, 17.56it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  58%|█████▊    | 10489/17944 [13:18<06:37, 18.78it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  58%|█████▊    | 10497/17944 [13:19<05:52, 21.13it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  59%|█████▊    | 10505/17944 [13:19<06:51, 18.10it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  59%|█████▊    | 10513/17944 [13:20<07:31, 16.44it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  59%|█████▊    | 10521/17944 [13:20<06:30, 18.99it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  59%|█████▊    | 10529/17944 [13:20<05:48, 21.28it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  59%|█████▊    | 10537/17944 [13:21<05:18, 23.28it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  59%|█████▉    | 10545/17944 [13:21<06:17, 19.61it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  59%|█████▉    | 10553/17944 [13:21<05:30, 22.36it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  59%|█████▉    | 10561/17944 [13:22<06:41, 18.40it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  59%|█████▉    | 10569/17944 [13:22<05:31, 22.28it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  59%|█████▉    | 10577/17944 [13:22<04:33, 26.90it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  59%|█████▉    | 10585/17944 [13:23<04:17, 28.53it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  59%|█████▉    | 10593/17944 [13:23<04:13, 28.97it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  59%|█████▉    | 10601/17944 [13:23<04:11, 29.24it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  59%|█████▉    | 10609/17944 [13:23<04:09, 29.43it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  59%|█████▉    | 10617/17944 [13:24<03:52, 31.56it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  59%|█████▉    | 10625/17944 [13:24<03:40, 33.24it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  59%|█████▉    | 10633/17944 [13:24<05:13, 23.33it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  59%|█████▉    | 10641/17944 [13:24<04:20, 28.01it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  59%|█████▉    | 10649/17944 [13:25<03:51, 31.47it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  59%|█████▉    | 10657/17944 [13:25<03:47, 32.10it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  59%|█████▉    | 10665/17944 [13:25<04:53, 24.77it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  59%|█████▉    | 10673/17944 [13:33<38:18,  3.16it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  60%|█████▉    | 10681/17944 [13:34<30:36,  3.96it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  60%|█████▉    | 10689/17944 [13:35<25:11,  4.80it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  60%|█████▉    | 10697/17944 [13:35<18:49,  6.42it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  60%|█████▉    | 10705/17944 [13:35<13:51,  8.71it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  60%|█████▉    | 10713/17944 [13:36<12:02, 10.00it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  60%|█████▉    | 10721/17944 [13:36<09:30, 12.67it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  60%|█████▉    | 10729/17944 [13:37<09:53, 12.15it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  60%|█████▉    | 10737/17944 [13:37<08:14, 14.57it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  60%|█████▉    | 10745/17944 [13:38<08:58, 13.36it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  60%|█████▉    | 10753/17944 [13:38<07:50, 15.29it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  60%|█████▉    | 10761/17944 [13:39<10:58, 10.90it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  60%|██████    | 10769/17944 [13:40<10:47, 11.09it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  60%|██████    | 10777/17944 [13:40<08:43, 13.68it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  60%|██████    | 10785/17944 [13:41<08:34, 13.92it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  60%|██████    | 10793/17944 [13:42<13:12,  9.02it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  60%|██████    | 10801/17944 [13:43<10:56, 10.88it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  60%|██████    | 10809/17944 [13:43<08:35, 13.84it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  60%|██████    | 10817/17944 [13:43<06:48, 17.45it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  60%|██████    | 10825/17944 [13:44<08:07, 14.61it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  60%|██████    | 10833/17944 [13:44<06:43, 17.60it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  60%|██████    | 10841/17944 [13:45<09:04, 13.05it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  60%|██████    | 10849/17944 [13:47<15:21,  7.70it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  61%|██████    | 10857/17944 [13:47<11:39, 10.13it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  61%|██████    | 10865/17944 [13:48<10:20, 11.40it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  61%|██████    | 10873/17944 [13:48<08:39, 13.61it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  61%|██████    | 10881/17944 [13:49<08:09, 14.44it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  61%|██████    | 10889/17944 [13:49<07:52, 14.94it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  61%|██████    | 10897/17944 [13:50<07:49, 15.01it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  61%|██████    | 10905/17944 [13:57<39:28,  2.97it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  61%|██████    | 10913/17944 [13:58<30:24,  3.85it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  61%|██████    | 10921/17944 [13:58<22:10,  5.28it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  61%|██████    | 10929/17944 [13:59<17:55,  6.52it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  61%|██████    | 10937/17944 [14:00<16:50,  6.94it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  61%|██████    | 10945/17944 [14:01<16:03,  7.26it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  61%|██████    | 10953/17944 [14:02<14:45,  7.89it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  61%|██████    | 10961/17944 [14:02<11:21, 10.25it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  61%|██████    | 10969/17944 [14:03<11:13, 10.36it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  61%|██████    | 10977/17944 [14:03<10:07, 11.47it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  61%|██████    | 10985/17944 [14:03<07:59, 14.52it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  61%|██████▏   | 10993/17944 [14:03<06:21, 18.20it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  61%|██████▏   | 11001/17944 [14:04<05:28, 21.13it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  61%|██████▏   | 11009/17944 [14:04<04:51, 23.77it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  61%|██████▏   | 11017/17944 [14:04<05:47, 19.91it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  61%|██████▏   | 11025/17944 [14:05<04:49, 23.88it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  61%|██████▏   | 11033/17944 [14:05<05:59, 19.23it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  62%|██████▏   | 11041/17944 [14:06<06:48, 16.91it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  62%|██████▏   | 11049/17944 [14:06<06:08, 18.70it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  62%|██████▏   | 11057/17944 [14:07<06:03, 18.97it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  62%|██████▏   | 11065/17944 [14:07<07:22, 15.55it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  62%|██████▏   | 11073/17944 [14:08<08:18, 13.79it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  62%|██████▏   | 11081/17944 [14:08<06:51, 16.70it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  62%|██████▏   | 11089/17944 [14:09<07:52, 14.51it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  62%|██████▏   | 11097/17944 [14:10<08:16, 13.79it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  62%|██████▏   | 11105/17944 [14:10<08:02, 14.17it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  62%|██████▏   | 11113/17944 [14:13<17:12,  6.62it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  62%|██████▏   | 11121/17944 [14:13<14:17,  7.96it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  62%|██████▏   | 11129/17944 [14:14<11:00, 10.31it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  62%|██████▏   | 11137/17944 [14:14<09:12, 12.31it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  62%|██████▏   | 11145/17944 [14:15<08:26, 13.41it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  62%|██████▏   | 11153/17944 [14:15<07:10, 15.77it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  62%|██████▏   | 11161/17944 [14:15<05:47, 19.52it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  62%|██████▏   | 11169/17944 [14:15<04:48, 23.45it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  62%|██████▏   | 11177/17944 [14:16<07:59, 14.12it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  62%|██████▏   | 11185/17944 [14:16<06:28, 17.42it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  62%|██████▏   | 11193/17944 [14:17<05:45, 19.56it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  62%|██████▏   | 11201/17944 [14:17<04:53, 22.94it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  62%|██████▏   | 11209/17944 [14:17<05:15, 21.33it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  63%|██████▎   | 11217/17944 [14:18<05:29, 20.39it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  63%|██████▎   | 11225/17944 [14:18<04:35, 24.37it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  63%|██████▎   | 11233/17944 [14:18<04:27, 25.13it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  63%|██████▎   | 11241/17944 [14:19<06:56, 16.08it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  63%|██████▎   | 11249/17944 [14:20<08:40, 12.86it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  63%|██████▎   | 11257/17944 [14:20<07:10, 15.54it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  63%|██████▎   | 11265/17944 [14:25<22:14,  5.00it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  63%|██████▎   | 11273/17944 [14:25<16:10,  6.87it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  63%|██████▎   | 11281/17944 [14:25<12:03,  9.21it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  63%|██████▎   | 11289/17944 [14:25<10:21, 10.71it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  63%|██████▎   | 11297/17944 [14:26<08:54, 12.43it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  63%|██████▎   | 11305/17944 [14:26<08:29, 13.04it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  63%|██████▎   | 11313/17944 [14:28<12:14,  9.03it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  63%|██████▎   | 11321/17944 [14:28<09:25, 11.72it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  63%|██████▎   | 11329/17944 [14:28<08:02, 13.71it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  63%|██████▎   | 11337/17944 [14:29<07:39, 14.39it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  63%|██████▎   | 11345/17944 [14:30<11:27,  9.60it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  63%|██████▎   | 11353/17944 [14:31<10:08, 10.83it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  63%|██████▎   | 11361/17944 [14:31<09:13, 11.88it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  63%|██████▎   | 11369/17944 [14:32<07:11, 15.23it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  63%|██████▎   | 11377/17944 [14:32<07:52, 13.91it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  63%|██████▎   | 11385/17944 [14:40<37:15,  2.93it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  63%|██████▎   | 11393/17944 [14:40<28:06,  3.89it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  64%|██████▎   | 11401/17944 [14:41<22:26,  4.86it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  64%|██████▎   | 11409/17944 [14:42<17:21,  6.27it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  64%|██████▎   | 11417/17944 [14:42<14:29,  7.50it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  64%|██████▎   | 11425/17944 [14:43<13:11,  8.23it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  64%|██████▎   | 11433/17944 [14:43<10:27, 10.37it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  64%|██████▍   | 11441/17944 [14:44<08:30, 12.73it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  64%|██████▍   | 11449/17944 [14:44<08:18, 13.04it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  64%|██████▍   | 11457/17944 [14:44<06:53, 15.71it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  64%|██████▍   | 11465/17944 [14:45<07:23, 14.61it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  64%|██████▍   | 11473/17944 [14:45<06:15, 17.24it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  64%|██████▍   | 11481/17944 [14:46<05:47, 18.61it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  64%|██████▍   | 11489/17944 [14:46<06:15, 17.21it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  64%|██████▍   | 11497/17944 [14:48<09:48, 10.96it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  64%|██████▍   | 11505/17944 [14:48<07:21, 14.59it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  64%|██████▍   | 11513/17944 [14:49<08:46, 12.22it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  64%|██████▍   | 11521/17944 [14:49<09:34, 11.18it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  64%|██████▍   | 11529/17944 [14:50<07:25, 14.40it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  64%|██████▍   | 11537/17944 [14:52<14:29,  7.37it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  64%|██████▍   | 11545/17944 [14:53<14:24,  7.40it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  64%|██████▍   | 11553/17944 [14:53<12:04,  8.83it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  64%|██████▍   | 11561/17944 [14:54<09:02, 11.76it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  64%|██████▍   | 11569/17944 [14:54<08:39, 12.28it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  65%|██████▍   | 11577/17944 [14:55<07:47, 13.62it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  65%|██████▍   | 11585/17944 [14:55<07:04, 14.97it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  65%|██████▍   | 11593/17944 [14:56<07:42, 13.72it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  65%|██████▍   | 11601/17944 [14:56<06:20, 16.68it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  65%|██████▍   | 11609/17944 [14:57<07:18, 14.43it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  65%|██████▍   | 11617/17944 [14:57<06:10, 17.08it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  65%|██████▍   | 11625/17944 [14:57<05:08, 20.49it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  65%|██████▍   | 11633/17944 [14:58<07:02, 14.95it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  65%|██████▍   | 11641/17944 [14:58<05:48, 18.07it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  65%|██████▍   | 11649/17944 [14:59<04:59, 21.01it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  65%|██████▍   | 11657/17944 [14:59<06:06, 17.13it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  65%|██████▌   | 11665/17944 [15:00<07:59, 13.08it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  65%|██████▌   | 11673/17944 [15:01<07:12, 14.49it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  65%|██████▌   | 11681/17944 [15:01<06:58, 14.96it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  65%|██████▌   | 11689/17944 [15:02<06:48, 15.30it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  65%|██████▌   | 11697/17944 [15:02<06:41, 15.54it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  65%|██████▌   | 11705/17944 [15:03<06:36, 15.72it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  65%|██████▌   | 11713/17944 [15:03<05:59, 17.31it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  65%|██████▌   | 11721/17944 [15:04<07:08, 14.52it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  65%|██████▌   | 11729/17944 [15:04<05:41, 18.19it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  65%|██████▌   | 11737/17944 [15:04<05:33, 18.59it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  65%|██████▌   | 11745/17944 [15:05<07:09, 14.42it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  65%|██████▌   | 11753/17944 [15:05<05:49, 17.74it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  66%|██████▌   | 11761/17944 [15:06<04:53, 21.07it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  66%|██████▌   | 11769/17944 [15:06<06:00, 17.14it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  66%|██████▌   | 11777/17944 [15:07<06:43, 15.28it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  66%|██████▌   | 11785/17944 [15:08<09:50, 10.43it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  66%|██████▌   | 11793/17944 [15:08<07:41, 13.34it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  66%|██████▌   | 11801/17944 [15:09<09:41, 10.56it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  66%|██████▌   | 11809/17944 [15:10<07:34, 13.49it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  66%|██████▌   | 11817/17944 [15:10<07:36, 13.42it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  66%|██████▌   | 11825/17944 [15:11<07:57, 12.80it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  66%|██████▌   | 11833/17944 [15:12<08:03, 12.63it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  66%|██████▌   | 11841/17944 [15:12<07:29, 13.58it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  66%|██████▌   | 11849/17944 [15:12<05:49, 17.42it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  66%|██████▌   | 11857/17944 [15:14<09:09, 11.08it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  66%|██████▌   | 11865/17944 [15:14<08:46, 11.55it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  66%|██████▌   | 11873/17944 [15:15<07:39, 13.22it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  66%|██████▌   | 11881/17944 [15:15<06:39, 15.17it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  66%|██████▋   | 11889/17944 [15:16<07:15, 13.91it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  66%|██████▋   | 11897/17944 [15:17<08:17, 12.17it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  66%|██████▋   | 11905/17944 [15:17<06:27, 15.59it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  66%|██████▋   | 11913/17944 [15:17<06:14, 16.11it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  66%|██████▋   | 11921/17944 [15:18<06:04, 16.50it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  66%|██████▋   | 11929/17944 [15:18<05:39, 17.73it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  67%|██████▋   | 11937/17944 [15:19<05:53, 17.01it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  67%|██████▋   | 11945/17944 [15:20<08:27, 11.81it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  67%|██████▋   | 11953/17944 [15:20<06:53, 14.49it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  67%|██████▋   | 11961/17944 [15:20<06:19, 15.78it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  67%|██████▋   | 11969/17944 [15:20<04:58, 20.04it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  67%|██████▋   | 11977/17944 [15:21<05:17, 18.77it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  67%|██████▋   | 11985/17944 [15:21<04:46, 20.78it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  67%|██████▋   | 11993/17944 [15:29<32:03,  3.09it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  67%|██████▋   | 12001/17944 [15:29<22:58,  4.31it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  67%|██████▋   | 12009/17944 [15:30<18:06,  5.46it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  67%|██████▋   | 12017/17944 [15:30<14:50,  6.66it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  67%|██████▋   | 12025/17944 [15:31<14:00,  7.04it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  67%|██████▋   | 12033/17944 [15:31<10:27,  9.41it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  67%|██████▋   | 12041/17944 [15:32<07:59, 12.30it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  67%|██████▋   | 12049/17944 [15:32<06:29, 15.13it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  67%|██████▋   | 12057/17944 [15:32<06:28, 15.16it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  67%|██████▋   | 12065/17944 [15:33<05:49, 16.84it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  67%|██████▋   | 12073/17944 [15:33<05:21, 18.28it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  67%|██████▋   | 12081/17944 [15:34<05:32, 17.64it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  67%|██████▋   | 12089/17944 [15:34<04:46, 20.45it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  67%|██████▋   | 12097/17944 [15:34<04:12, 23.17it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  67%|██████▋   | 12105/17944 [15:34<03:48, 25.58it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  68%|██████▊   | 12113/17944 [15:35<05:55, 16.38it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  68%|██████▊   | 12121/17944 [15:36<05:25, 17.88it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  68%|██████▊   | 12129/17944 [15:36<04:39, 20.82it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  68%|██████▊   | 12137/17944 [15:36<03:48, 25.45it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  68%|██████▊   | 12145/17944 [15:36<04:32, 21.27it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  68%|██████▊   | 12153/17944 [15:37<04:45, 20.29it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  68%|██████▊   | 12161/17944 [15:37<05:06, 18.89it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  68%|██████▊   | 12169/17944 [15:38<05:20, 18.01it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  68%|██████▊   | 12177/17944 [15:38<04:23, 21.90it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  68%|██████▊   | 12185/17944 [15:38<03:42, 25.84it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  68%|██████▊   | 12193/17944 [15:39<03:39, 26.26it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  68%|██████▊   | 12201/17944 [15:39<04:19, 22.09it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  68%|██████▊   | 12209/17944 [15:39<03:40, 26.05it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  68%|██████▊   | 12217/17944 [15:40<04:20, 22.01it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  68%|██████▊   | 12225/17944 [15:43<14:53,  6.40it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  68%|██████▊   | 12233/17944 [15:43<10:56,  8.69it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  68%|██████▊   | 12241/17944 [15:43<08:24, 11.31it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  68%|██████▊   | 12249/17944 [15:44<06:36, 14.35it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  68%|██████▊   | 12257/17944 [15:44<07:35, 12.48it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  68%|██████▊   | 12265/17944 [15:45<08:16, 11.43it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  68%|██████▊   | 12273/17944 [15:46<07:40, 12.31it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  68%|██████▊   | 12281/17944 [15:46<06:12, 15.19it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  68%|██████▊   | 12289/17944 [15:46<05:10, 18.22it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  69%|██████▊   | 12297/17944 [15:46<04:14, 22.16it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  69%|██████▊   | 12305/17944 [15:47<03:35, 26.14it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  69%|██████▊   | 12313/17944 [15:47<05:02, 18.59it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  69%|██████▊   | 12321/17944 [15:48<06:10, 15.17it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  69%|██████▊   | 12329/17944 [15:48<05:27, 17.13it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  69%|██████▉   | 12337/17944 [15:49<04:58, 18.80it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  69%|██████▉   | 12345/17944 [15:49<05:31, 16.90it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  69%|██████▉   | 12353/17944 [15:50<05:23, 17.29it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  69%|██████▉   | 12361/17944 [15:50<05:40, 16.37it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  69%|██████▉   | 12369/17944 [15:51<05:53, 15.77it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  69%|██████▉   | 12377/17944 [15:51<04:39, 19.93it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  69%|██████▉   | 12385/17944 [15:51<04:47, 19.34it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  69%|██████▉   | 12393/17944 [15:54<11:01,  8.39it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  69%|██████▉   | 12401/17944 [15:54<09:37,  9.59it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  69%|██████▉   | 12409/17944 [15:55<08:37, 10.69it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  69%|██████▉   | 12417/17944 [15:55<06:44, 13.66it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  69%|██████▉   | 12425/17944 [15:55<05:20, 17.20it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  69%|██████▉   | 12433/17944 [15:56<05:50, 15.71it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  69%|██████▉   | 12441/17944 [15:57<06:27, 14.20it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  69%|██████▉   | 12449/17944 [15:57<07:51, 11.65it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  69%|██████▉   | 12457/17944 [15:58<06:35, 13.88it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  69%|██████▉   | 12465/17944 [15:58<06:30, 14.04it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  70%|██████▉   | 12473/17944 [15:59<05:20, 17.05it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  70%|██████▉   | 12481/17944 [15:59<05:08, 17.73it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  70%|██████▉   | 12489/17944 [15:59<05:04, 17.93it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  70%|██████▉   | 12497/17944 [16:00<04:37, 19.61it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  70%|██████▉   | 12505/17944 [16:01<05:58, 15.16it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  70%|██████▉   | 12513/17944 [16:01<04:46, 18.95it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  70%|██████▉   | 12521/17944 [16:01<04:14, 21.32it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  70%|██████▉   | 12529/17944 [16:01<03:46, 23.89it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  70%|██████▉   | 12537/17944 [16:01<03:15, 27.70it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  70%|██████▉   | 12545/17944 [16:02<02:52, 31.25it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  70%|██████▉   | 12553/17944 [16:02<02:36, 34.36it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  70%|███████   | 12561/17944 [16:02<02:20, 38.37it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  70%|███████   | 12569/17944 [16:02<02:19, 38.53it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  70%|███████   | 12577/17944 [16:02<02:19, 38.49it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  70%|███████   | 12585/17944 [16:03<02:29, 35.73it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  70%|███████   | 12593/17944 [16:03<03:22, 26.40it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  70%|███████   | 12601/17944 [16:04<04:55, 18.06it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  70%|███████   | 12609/17944 [16:04<04:41, 18.93it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  70%|███████   | 12617/17944 [16:04<03:57, 22.39it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  70%|███████   | 12625/17944 [16:05<03:27, 25.63it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  70%|███████   | 12633/17944 [16:05<04:25, 20.03it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  70%|███████   | 12641/17944 [16:06<04:58, 17.74it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  70%|███████   | 12649/17944 [16:07<06:01, 14.63it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  71%|███████   | 12657/17944 [16:07<04:58, 17.69it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  71%|███████   | 12665/17944 [16:07<05:38, 15.58it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  71%|███████   | 12673/17944 [16:08<04:26, 19.81it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  71%|███████   | 12681/17944 [16:08<04:58, 17.63it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  71%|███████   | 12689/17944 [16:09<04:48, 18.24it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  71%|███████   | 12697/17944 [16:10<08:11, 10.68it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  71%|███████   | 12705/17944 [16:11<07:23, 11.81it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  71%|███████   | 12713/17944 [16:11<07:27, 11.68it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  71%|███████   | 12721/17944 [16:12<06:03, 14.37it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  71%|███████   | 12729/17944 [16:12<04:42, 18.46it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  71%|███████   | 12737/17944 [16:12<05:50, 14.85it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  71%|███████   | 12745/17944 [16:13<06:49, 12.71it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  71%|███████   | 12753/17944 [16:14<05:25, 15.96it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  71%|███████   | 12761/17944 [16:14<04:26, 19.44it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  71%|███████   | 12769/17944 [16:15<06:23, 13.50it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  71%|███████   | 12777/17944 [16:16<07:11, 11.96it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  71%|███████   | 12785/17944 [16:16<05:40, 15.14it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  71%|███████▏  | 12793/17944 [16:19<14:08,  6.07it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  71%|███████▏  | 12801/17944 [16:19<10:32,  8.13it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  71%|███████▏  | 12809/17944 [16:19<08:07, 10.54it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  71%|███████▏  | 12817/17944 [16:20<08:40,  9.85it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  71%|███████▏  | 12825/17944 [16:21<06:43, 12.70it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  72%|███████▏  | 12833/17944 [16:21<05:22, 15.84it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  72%|███████▏  | 12841/17944 [16:22<06:34, 12.93it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  72%|███████▏  | 12849/17944 [16:22<07:23, 11.49it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  72%|███████▏  | 12857/17944 [16:23<06:48, 12.45it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  72%|███████▏  | 12865/17944 [16:23<05:58, 14.16it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  72%|███████▏  | 12873/17944 [16:24<05:22, 15.73it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  72%|███████▏  | 12881/17944 [16:24<05:06, 16.50it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  72%|███████▏  | 12889/17944 [16:25<04:55, 17.08it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  72%|███████▏  | 12897/17944 [16:25<04:48, 17.50it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  72%|███████▏  | 12905/17944 [16:26<04:49, 17.41it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  72%|███████▏  | 12913/17944 [16:26<05:05, 16.48it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  72%|███████▏  | 12921/17944 [16:26<04:18, 19.41it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  72%|███████▏  | 12929/17944 [16:26<03:32, 23.57it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  72%|███████▏  | 12937/17944 [16:27<03:31, 23.71it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  72%|███████▏  | 12945/17944 [16:27<03:29, 23.83it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  72%|███████▏  | 12953/17944 [16:28<04:43, 17.59it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  72%|███████▏  | 12961/17944 [16:29<05:21, 15.51it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  72%|███████▏  | 12969/17944 [16:30<06:44, 12.30it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  72%|███████▏  | 12977/17944 [16:30<06:26, 12.85it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  72%|███████▏  | 12985/17944 [16:30<05:19, 15.53it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  72%|███████▏  | 12993/17944 [16:31<05:09, 16.01it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  72%|███████▏  | 13001/17944 [16:31<04:51, 16.97it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  72%|███████▏  | 13009/17944 [16:31<04:18, 19.10it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  73%|███████▎  | 13017/17944 [16:32<04:16, 19.20it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  73%|███████▎  | 13025/17944 [16:32<04:08, 19.76it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  73%|███████▎  | 13033/17944 [16:33<03:57, 20.66it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  73%|███████▎  | 13041/17944 [16:33<03:55, 20.80it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  73%|███████▎  | 13049/17944 [16:33<03:12, 25.44it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  73%|███████▎  | 13057/17944 [16:33<02:52, 28.30it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  73%|███████▎  | 13065/17944 [16:34<03:37, 22.48it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  73%|███████▎  | 13073/17944 [16:34<04:08, 19.61it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  73%|███████▎  | 13081/17944 [16:35<04:49, 16.77it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  73%|███████▎  | 13089/17944 [16:35<03:54, 20.67it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  73%|███████▎  | 13097/17944 [16:41<20:22,  3.97it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  73%|███████▎  | 13105/17944 [16:42<18:29,  4.36it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  73%|███████▎  | 13113/17944 [16:43<14:20,  5.61it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  73%|███████▎  | 13121/17944 [16:43<11:15,  7.14it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  73%|███████▎  | 13129/17944 [16:44<09:16,  8.66it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  73%|███████▎  | 13137/17944 [16:44<07:05, 11.29it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  73%|███████▎  | 13145/17944 [16:45<06:47, 11.77it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  73%|███████▎  | 13153/17944 [16:45<05:22, 14.86it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  73%|███████▎  | 13161/17944 [16:45<04:17, 18.55it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  73%|███████▎  | 13169/17944 [16:45<04:24, 18.07it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  73%|███████▎  | 13177/17944 [16:46<03:47, 20.99it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  73%|███████▎  | 13185/17944 [16:46<04:16, 18.53it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  74%|███████▎  | 13193/17944 [16:46<03:36, 21.98it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  74%|███████▎  | 13201/17944 [16:47<03:43, 21.21it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  74%|███████▎  | 13209/17944 [16:47<03:12, 24.56it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  74%|███████▎  | 13217/17944 [16:47<02:56, 26.77it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  74%|███████▎  | 13225/17944 [16:47<02:29, 31.51it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  74%|███████▎  | 13233/17944 [16:48<03:25, 22.98it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  74%|███████▍  | 13241/17944 [16:49<03:59, 19.62it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  74%|███████▍  | 13249/17944 [16:49<03:34, 21.90it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  74%|███████▍  | 13257/17944 [16:50<04:28, 17.45it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  74%|███████▍  | 13265/17944 [16:50<04:26, 17.55it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  74%|███████▍  | 13273/17944 [16:50<03:37, 21.47it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  74%|███████▍  | 13281/17944 [16:51<03:38, 21.38it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  74%|███████▍  | 13289/17944 [16:58<24:57,  3.11it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  74%|███████▍  | 13297/17944 [16:59<18:37,  4.16it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  74%|███████▍  | 13305/17944 [16:59<14:11,  5.45it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  74%|███████▍  | 13313/17944 [17:00<11:49,  6.53it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  74%|███████▍  | 13321/17944 [17:00<09:35,  8.03it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  74%|███████▍  | 13329/17944 [17:01<08:01,  9.59it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  74%|███████▍  | 13337/17944 [17:01<07:14, 10.61it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  74%|███████▍  | 13345/17944 [17:01<05:47, 13.22it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  74%|███████▍  | 13353/17944 [17:02<05:16, 14.50it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  74%|███████▍  | 13361/17944 [17:03<05:35, 13.67it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  75%|███████▍  | 13369/17944 [17:03<05:54, 12.92it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  75%|███████▍  | 13377/17944 [17:03<04:47, 15.87it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  75%|███████▍  | 13385/17944 [17:04<03:51, 19.68it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  75%|███████▍  | 13393/17944 [17:04<04:20, 17.44it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  75%|███████▍  | 13401/17944 [17:08<12:32,  6.03it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  75%|███████▍  | 13409/17944 [17:08<09:59,  7.57it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  75%|███████▍  | 13417/17944 [17:09<08:35,  8.78it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  75%|███████▍  | 13425/17944 [17:12<14:31,  5.18it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  75%|███████▍  | 13433/17944 [17:12<10:53,  6.90it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  75%|███████▍  | 13441/17944 [17:12<09:20,  8.04it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  75%|███████▍  | 13449/17944 [17:13<08:18,  9.01it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  75%|███████▍  | 13457/17944 [17:14<07:12, 10.38it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  75%|███████▌  | 13465/17944 [17:18<18:20,  4.07it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  75%|███████▌  | 13473/17944 [17:23<26:02,  2.86it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  75%|███████▌  | 13481/17944 [17:23<18:52,  3.94it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  75%|███████▌  | 13489/17944 [17:24<13:56,  5.33it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  75%|███████▌  | 13497/17944 [17:24<10:16,  7.21it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  75%|███████▌  | 13505/17944 [17:24<07:50,  9.43it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  75%|███████▌  | 13513/17944 [17:24<06:08, 12.04it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  75%|███████▌  | 13521/17944 [17:25<05:05, 14.46it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  75%|███████▌  | 13529/17944 [17:25<05:05, 14.45it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  75%|███████▌  | 13537/17944 [17:26<04:47, 15.31it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  75%|███████▌  | 13545/17944 [17:26<04:21, 16.84it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  76%|███████▌  | 13553/17944 [17:26<03:41, 19.79it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  76%|███████▌  | 13561/17944 [17:26<02:59, 24.38it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  76%|███████▌  | 13569/17944 [17:27<02:40, 27.32it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  76%|███████▌  | 13577/17944 [17:27<02:25, 29.98it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  76%|███████▌  | 13585/17944 [17:27<02:24, 30.09it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  76%|███████▌  | 13593/17944 [17:28<03:15, 22.31it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  76%|███████▌  | 13601/17944 [17:28<02:44, 26.32it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  76%|███████▌  | 13609/17944 [17:28<02:52, 25.18it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  76%|███████▌  | 13617/17944 [17:28<02:39, 27.21it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  76%|███████▌  | 13625/17944 [17:29<02:19, 30.88it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  76%|███████▌  | 13633/17944 [17:29<02:06, 34.03it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  76%|███████▌  | 13641/17944 [17:29<02:34, 27.83it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  76%|███████▌  | 13649/17944 [17:29<02:25, 29.45it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  76%|███████▌  | 13657/17944 [17:30<02:42, 26.35it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  76%|███████▌  | 13665/17944 [17:30<02:54, 24.51it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  76%|███████▌  | 13673/17944 [17:31<05:31, 12.88it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  76%|███████▌  | 13681/17944 [17:32<04:43, 15.05it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  76%|███████▋  | 13689/17944 [17:32<03:50, 18.42it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  76%|███████▋  | 13697/17944 [17:32<03:09, 22.35it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  76%|███████▋  | 13705/17944 [17:32<02:41, 26.31it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  76%|███████▋  | 13713/17944 [17:33<04:01, 17.54it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  76%|███████▋  | 13721/17944 [17:33<03:26, 20.45it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  77%|███████▋  | 13729/17944 [17:34<04:55, 14.26it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  77%|███████▋  | 13737/17944 [17:35<04:03, 17.27it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  77%|███████▋  | 13745/17944 [17:35<03:27, 20.27it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  77%|███████▋  | 13753/17944 [17:35<02:48, 24.88it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  77%|███████▋  | 13761/17944 [17:35<02:34, 27.00it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  77%|███████▋  | 13769/17944 [17:36<03:41, 18.84it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  77%|███████▋  | 13777/17944 [17:36<03:56, 17.64it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  77%|███████▋  | 13785/17944 [17:37<03:39, 18.95it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  77%|███████▋  | 13793/17944 [17:37<03:26, 20.05it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  77%|███████▋  | 13801/17944 [17:37<03:00, 22.89it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  77%|███████▋  | 13809/17944 [17:38<02:29, 27.65it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  77%|███████▋  | 13817/17944 [17:38<03:04, 22.35it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  77%|███████▋  | 13825/17944 [17:38<03:11, 21.48it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  77%|███████▋  | 13833/17944 [17:39<02:49, 24.19it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  77%|███████▋  | 13841/17944 [17:39<03:10, 21.57it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  77%|███████▋  | 13849/17944 [17:41<07:48,  8.74it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  77%|███████▋  | 13857/17944 [17:42<05:59, 11.38it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  77%|███████▋  | 13865/17944 [17:42<05:08, 13.20it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  77%|███████▋  | 13873/17944 [17:45<11:21,  5.97it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  77%|███████▋  | 13881/17944 [17:45<08:31,  7.94it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  77%|███████▋  | 13889/17944 [17:46<07:12,  9.39it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  77%|███████▋  | 13897/17944 [17:46<06:25, 10.50it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  77%|███████▋  | 13905/17944 [17:47<06:01, 11.19it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  78%|███████▊  | 13913/17944 [17:47<05:22, 12.50it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  78%|███████▊  | 13921/17944 [17:48<04:20, 15.45it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  78%|███████▊  | 13929/17944 [17:48<03:28, 19.24it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  78%|███████▊  | 13937/17944 [17:48<03:39, 18.29it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  78%|███████▊  | 13945/17944 [17:48<02:55, 22.81it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  78%|███████▊  | 13953/17944 [17:49<02:33, 26.03it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  78%|███████▊  | 13961/17944 [17:49<02:17, 28.92it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  78%|███████▊  | 13969/17944 [17:49<02:14, 29.48it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  78%|███████▊  | 13977/17944 [17:49<02:17, 28.86it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  78%|███████▊  | 13985/17944 [17:50<02:52, 22.95it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  78%|███████▊  | 13993/17944 [17:50<02:34, 25.52it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  78%|███████▊  | 14001/17944 [17:51<04:10, 15.75it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  78%|███████▊  | 14009/17944 [17:51<03:28, 18.85it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  78%|███████▊  | 14017/17944 [17:52<03:29, 18.78it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  78%|███████▊  | 14025/17944 [17:52<02:55, 22.29it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  78%|███████▊  | 14033/17944 [17:52<03:05, 21.05it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  78%|███████▊  | 14041/17944 [17:53<03:20, 19.46it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  78%|███████▊  | 14049/17944 [17:53<02:58, 21.87it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  78%|███████▊  | 14057/17944 [17:53<02:50, 22.77it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  78%|███████▊  | 14065/17944 [17:54<02:53, 22.29it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  78%|███████▊  | 14073/17944 [17:54<02:39, 24.30it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  78%|███████▊  | 14081/17944 [17:54<02:16, 28.24it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  79%|███████▊  | 14089/17944 [17:55<02:37, 24.42it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  79%|███████▊  | 14097/17944 [17:55<02:23, 26.76it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  79%|███████▊  | 14105/17944 [17:55<02:50, 22.52it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  79%|███████▊  | 14113/17944 [17:56<03:04, 20.72it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  79%|███████▊  | 14121/17944 [17:56<02:54, 21.96it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  79%|███████▊  | 14129/17944 [17:57<02:58, 21.36it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  79%|███████▉  | 14137/17944 [17:57<02:25, 26.13it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  79%|███████▉  | 14145/17944 [17:57<03:02, 20.81it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  79%|███████▉  | 14153/17944 [17:57<02:24, 26.26it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  79%|███████▉  | 14161/17944 [17:57<02:01, 31.05it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  79%|███████▉  | 14169/17944 [17:58<02:25, 25.86it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  79%|███████▉  | 14177/17944 [17:58<02:14, 27.91it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  79%|███████▉  | 14185/17944 [17:59<02:51, 21.98it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  79%|███████▉  | 14193/17944 [17:59<02:20, 26.75it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  79%|███████▉  | 14201/17944 [17:59<02:46, 22.49it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  79%|███████▉  | 14209/17944 [18:00<02:40, 23.23it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  79%|███████▉  | 14217/17944 [18:00<02:44, 22.62it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  79%|███████▉  | 14225/17944 [18:00<02:27, 25.22it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  79%|███████▉  | 14233/17944 [18:02<04:44, 13.03it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  79%|███████▉  | 14241/17944 [18:02<04:15, 14.52it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  79%|███████▉  | 14249/17944 [18:02<03:50, 16.04it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  79%|███████▉  | 14257/17944 [18:03<03:05, 19.89it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  79%|███████▉  | 14265/17944 [18:03<03:09, 19.46it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  80%|███████▉  | 14273/17944 [18:03<03:00, 20.33it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  80%|███████▉  | 14281/17944 [18:04<03:33, 17.17it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  80%|███████▉  | 14289/17944 [18:05<03:56, 15.44it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  80%|███████▉  | 14297/17944 [18:05<03:48, 15.97it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  80%|███████▉  | 14305/17944 [18:05<03:42, 16.35it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  80%|███████▉  | 14313/17944 [18:06<03:46, 16.05it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  80%|███████▉  | 14321/17944 [18:06<03:02, 19.91it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  80%|███████▉  | 14329/17944 [18:07<03:26, 17.47it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  80%|███████▉  | 14337/17944 [18:08<04:09, 14.46it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  80%|███████▉  | 14345/17944 [18:09<06:45,  8.88it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  80%|███████▉  | 14353/17944 [18:10<06:10,  9.70it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  80%|████████  | 14361/17944 [18:11<06:45,  8.85it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  80%|████████  | 14369/17944 [18:11<05:26, 10.96it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  80%|████████  | 14377/17944 [18:12<04:42, 12.61it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  80%|████████  | 14385/17944 [18:12<04:08, 14.32it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  80%|████████  | 14393/17944 [18:13<03:44, 15.83it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  80%|████████  | 14401/17944 [18:13<04:12, 14.03it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  80%|████████  | 14409/17944 [18:13<03:20, 17.67it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  80%|████████  | 14417/17944 [18:16<08:24,  7.00it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  80%|████████  | 14425/17944 [18:16<06:30,  9.01it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  80%|████████  | 14433/17944 [18:17<05:22, 10.90it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  80%|████████  | 14441/17944 [18:17<04:15, 13.70it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  81%|████████  | 14449/17944 [18:19<06:57,  8.37it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  81%|████████  | 14457/17944 [18:19<06:03,  9.59it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  81%|████████  | 14465/17944 [18:20<05:10, 11.20it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  81%|████████  | 14473/17944 [18:20<03:56, 14.69it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  81%|████████  | 14481/17944 [18:20<03:12, 18.03it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  81%|████████  | 14489/17944 [18:20<02:48, 20.50it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  81%|████████  | 14497/17944 [18:21<02:32, 22.61it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  81%|████████  | 14505/17944 [18:21<02:35, 22.12it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  81%|████████  | 14513/17944 [18:22<03:46, 15.18it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  81%|████████  | 14521/17944 [18:23<03:41, 15.46it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  81%|████████  | 14529/17944 [18:23<03:04, 18.48it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  81%|████████  | 14537/17944 [18:23<02:28, 22.98it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  81%|████████  | 14545/17944 [18:23<02:02, 27.67it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  81%|████████  | 14553/17944 [18:24<02:40, 21.14it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  81%|████████  | 14561/17944 [18:24<02:18, 24.47it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  81%|████████  | 14569/17944 [18:24<02:46, 20.25it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  81%|████████  | 14577/17944 [18:25<02:47, 20.07it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  81%|████████▏ | 14585/17944 [18:25<02:59, 18.71it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  81%|████████▏ | 14593/17944 [18:26<03:07, 17.84it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  81%|████████▏ | 14601/17944 [18:27<05:40,  9.83it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  81%|████████▏ | 14609/17944 [18:28<05:20, 10.39it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  81%|████████▏ | 14617/17944 [18:29<04:38, 11.94it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  82%|████████▏ | 14625/17944 [18:29<03:40, 15.08it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  82%|████████▏ | 14633/17944 [18:37<18:39,  2.96it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  82%|████████▏ | 14641/17944 [18:37<13:31,  4.07it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  82%|████████▏ | 14649/17944 [18:37<09:55,  5.53it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  82%|████████▏ | 14657/17944 [18:37<07:25,  7.39it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  82%|████████▏ | 14665/17944 [18:38<05:36,  9.75it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  82%|████████▏ | 14673/17944 [18:39<06:03,  9.00it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  82%|████████▏ | 14681/17944 [18:39<04:35, 11.83it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  82%|████████▏ | 14689/17944 [18:40<06:05,  8.90it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  82%|████████▏ | 14697/17944 [18:42<07:30,  7.21it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  82%|████████▏ | 14705/17944 [18:42<05:39,  9.53it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  82%|████████▏ | 14713/17944 [18:42<04:22, 12.30it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  82%|████████▏ | 14721/17944 [18:43<04:12, 12.78it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  82%|████████▏ | 14729/17944 [18:44<04:47, 11.19it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  82%|████████▏ | 14737/17944 [18:44<03:59, 13.40it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  82%|████████▏ | 14745/17944 [18:44<03:15, 16.38it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  82%|████████▏ | 14753/17944 [18:44<02:47, 19.03it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  82%|████████▏ | 14761/17944 [18:45<02:49, 18.81it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  82%|████████▏ | 14769/17944 [18:46<04:32, 11.64it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  82%|████████▏ | 14777/17944 [18:47<03:54, 13.49it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  82%|████████▏ | 14785/17944 [18:47<03:38, 14.48it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  82%|████████▏ | 14793/17944 [18:48<03:26, 15.23it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  82%|████████▏ | 14801/17944 [18:48<02:51, 18.28it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  83%|████████▎ | 14809/17944 [18:48<02:43, 19.22it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  83%|████████▎ | 14817/17944 [18:49<03:02, 17.16it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  83%|████████▎ | 14825/17944 [18:49<03:25, 15.20it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  83%|████████▎ | 14833/17944 [18:50<03:10, 16.32it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  83%|████████▎ | 14841/17944 [18:50<03:07, 16.57it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  83%|████████▎ | 14849/17944 [18:51<03:01, 17.08it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  83%|████████▎ | 14857/17944 [18:51<02:53, 17.79it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  83%|████████▎ | 14865/17944 [18:52<03:21, 15.32it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  83%|████████▎ | 14873/17944 [18:52<02:44, 18.72it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  83%|████████▎ | 14881/17944 [18:52<02:11, 23.29it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  83%|████████▎ | 14889/17944 [18:53<02:18, 22.08it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  83%|████████▎ | 14897/17944 [18:53<02:17, 22.22it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  83%|████████▎ | 14905/17944 [18:53<01:59, 25.42it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  83%|████████▎ | 14913/17944 [18:54<03:53, 12.96it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  83%|████████▎ | 14921/17944 [18:55<03:29, 14.46it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  83%|████████▎ | 14929/17944 [18:55<03:15, 15.40it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  83%|████████▎ | 14937/17944 [18:56<03:09, 15.88it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  83%|████████▎ | 14945/17944 [18:56<02:28, 20.14it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  83%|████████▎ | 14953/17944 [18:57<02:56, 16.92it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  83%|████████▎ | 14961/17944 [18:57<02:49, 17.61it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  83%|████████▎ | 14969/17944 [18:57<02:15, 22.01it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  83%|████████▎ | 14977/17944 [18:57<02:16, 21.71it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  84%|████████▎ | 14985/17944 [18:58<02:10, 22.61it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  84%|████████▎ | 14993/17944 [18:58<01:57, 25.20it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  84%|████████▎ | 15001/17944 [18:58<01:44, 28.18it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  84%|████████▎ | 15009/17944 [18:58<01:35, 30.75it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  84%|████████▎ | 15017/17944 [18:59<01:45, 27.84it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  84%|████████▎ | 15025/17944 [19:00<02:44, 17.74it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  84%|████████▍ | 15033/17944 [19:00<02:51, 16.97it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  84%|████████▍ | 15041/17944 [19:01<03:29, 13.85it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  84%|████████▍ | 15049/17944 [19:02<03:28, 13.87it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  84%|████████▍ | 15057/17944 [19:02<02:38, 18.18it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  84%|████████▍ | 15065/17944 [19:02<02:36, 18.42it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  84%|████████▍ | 15073/17944 [19:03<02:38, 18.09it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  84%|████████▍ | 15081/17944 [19:03<02:40, 17.85it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  84%|████████▍ | 15089/17944 [19:03<02:16, 20.86it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  84%|████████▍ | 15097/17944 [19:04<02:22, 19.99it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  84%|████████▍ | 15105/17944 [19:04<02:23, 19.81it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  84%|████████▍ | 15113/17944 [19:04<01:59, 23.78it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  84%|████████▍ | 15121/17944 [19:04<01:48, 26.13it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  84%|████████▍ | 15129/17944 [19:05<01:54, 24.49it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  84%|████████▍ | 15137/17944 [19:05<02:14, 20.83it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  84%|████████▍ | 15145/17944 [19:06<01:52, 24.88it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  84%|████████▍ | 15153/17944 [19:06<02:11, 21.26it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  84%|████████▍ | 15161/17944 [19:07<02:54, 15.98it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  85%|████████▍ | 15169/17944 [19:07<02:55, 15.77it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  85%|████████▍ | 15177/17944 [19:08<02:21, 19.58it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  85%|████████▍ | 15185/17944 [19:08<03:02, 15.12it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  85%|████████▍ | 15193/17944 [19:09<02:46, 16.51it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  85%|████████▍ | 15201/17944 [19:09<02:17, 19.92it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  85%|████████▍ | 15209/17944 [19:09<02:21, 19.34it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  85%|████████▍ | 15217/17944 [19:10<01:56, 23.35it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  85%|████████▍ | 15225/17944 [19:10<01:42, 26.47it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  85%|████████▍ | 15233/17944 [19:10<02:05, 21.64it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  85%|████████▍ | 15241/17944 [19:11<02:34, 17.47it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  85%|████████▍ | 15249/17944 [19:11<02:26, 18.44it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  85%|████████▌ | 15257/17944 [19:12<02:20, 19.17it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  85%|████████▌ | 15265/17944 [19:12<02:21, 18.93it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  85%|████████▌ | 15273/17944 [19:13<02:22, 18.77it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  85%|████████▌ | 15281/17944 [19:13<02:19, 19.04it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  85%|████████▌ | 15289/17944 [19:14<02:43, 16.22it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  85%|████████▌ | 15297/17944 [19:14<02:59, 14.75it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  85%|████████▌ | 15305/17944 [19:16<04:03, 10.82it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  85%|████████▌ | 15313/17944 [19:16<03:47, 11.58it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  85%|████████▌ | 15321/17944 [19:17<03:21, 13.02it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  85%|████████▌ | 15329/17944 [19:17<02:35, 16.85it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  85%|████████▌ | 15337/17944 [19:17<02:14, 19.40it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  86%|████████▌ | 15345/17944 [19:18<02:28, 17.46it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  86%|████████▌ | 15353/17944 [19:18<02:34, 16.82it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  86%|████████▌ | 15361/17944 [19:19<02:38, 16.35it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  86%|████████▌ | 15369/17944 [19:19<02:40, 16.09it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  86%|████████▌ | 15377/17944 [19:19<02:08, 19.93it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  86%|████████▌ | 15385/17944 [19:20<01:58, 21.67it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  86%|████████▌ | 15393/17944 [19:20<02:09, 19.68it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  86%|████████▌ | 15401/17944 [19:20<02:09, 19.66it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  86%|████████▌ | 15409/17944 [19:21<02:06, 20.09it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  86%|████████▌ | 15417/17944 [19:21<02:07, 19.81it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  86%|████████▌ | 15425/17944 [19:22<02:02, 20.52it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  86%|████████▌ | 15433/17944 [19:22<02:09, 19.37it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  86%|████████▌ | 15441/17944 [19:23<02:32, 16.40it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  86%|████████▌ | 15449/17944 [19:23<02:16, 18.28it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  86%|████████▌ | 15457/17944 [19:23<02:13, 18.64it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  86%|████████▌ | 15465/17944 [19:24<02:26, 16.88it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  86%|████████▌ | 15473/17944 [19:25<02:51, 14.37it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  86%|████████▋ | 15481/17944 [19:25<02:21, 17.40it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  86%|████████▋ | 15489/17944 [19:26<02:52, 14.20it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  86%|████████▋ | 15497/17944 [19:26<02:40, 15.27it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  86%|████████▋ | 15505/17944 [19:27<02:18, 17.61it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  86%|████████▋ | 15513/17944 [19:27<01:55, 21.10it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  86%|████████▋ | 15521/17944 [19:27<01:33, 25.81it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  87%|████████▋ | 15529/17944 [19:28<02:13, 18.06it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  87%|████████▋ | 15537/17944 [19:28<01:56, 20.59it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  87%|████████▋ | 15545/17944 [19:28<01:45, 22.83it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  87%|████████▋ | 15553/17944 [19:30<03:42, 10.74it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  87%|████████▋ | 15561/17944 [19:30<02:51, 13.92it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  87%|████████▋ | 15569/17944 [19:30<02:15, 17.58it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  87%|████████▋ | 15577/17944 [19:31<02:18, 17.10it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  87%|████████▋ | 15585/17944 [19:31<02:05, 18.80it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  87%|████████▋ | 15593/17944 [19:32<02:17, 17.09it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  87%|████████▋ | 15601/17944 [19:32<01:58, 19.69it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  87%|████████▋ | 15609/17944 [19:32<02:06, 18.49it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  87%|████████▋ | 15617/17944 [19:33<02:13, 17.43it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  87%|████████▋ | 15625/17944 [19:33<02:15, 17.13it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  87%|████████▋ | 15633/17944 [19:34<02:11, 17.53it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  87%|████████▋ | 15641/17944 [19:34<02:14, 17.09it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  87%|████████▋ | 15649/17944 [19:34<01:48, 21.08it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  87%|████████▋ | 15657/17944 [19:35<02:44, 13.91it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  87%|████████▋ | 15665/17944 [19:36<02:40, 14.20it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  87%|████████▋ | 15673/17944 [19:36<02:11, 17.24it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  87%|████████▋ | 15681/17944 [19:36<01:51, 20.28it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  87%|████████▋ | 15689/17944 [19:37<01:34, 23.77it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  87%|████████▋ | 15697/17944 [19:37<01:25, 26.21it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  88%|████████▊ | 15705/17944 [19:38<02:01, 18.50it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  88%|████████▊ | 15713/17944 [19:39<02:38, 14.08it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  88%|████████▊ | 15721/17944 [19:41<04:41,  7.90it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  88%|████████▊ | 15729/17944 [19:41<03:42,  9.96it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  88%|████████▊ | 15737/17944 [19:41<02:51, 12.85it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  88%|████████▊ | 15745/17944 [19:42<02:55, 12.54it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  88%|████████▊ | 15753/17944 [19:42<02:27, 14.81it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  88%|████████▊ | 15761/17944 [19:43<02:20, 15.57it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  88%|████████▊ | 15769/17944 [19:43<02:14, 16.13it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  88%|████████▊ | 15777/17944 [19:43<01:50, 19.63it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  88%|████████▊ | 15785/17944 [19:43<01:33, 23.09it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  88%|████████▊ | 15793/17944 [19:44<02:06, 17.01it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  88%|████████▊ | 15801/17944 [19:45<01:57, 18.28it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  88%|████████▊ | 15809/17944 [19:45<02:00, 17.70it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  88%|████████▊ | 15817/17944 [19:46<02:10, 16.29it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  88%|████████▊ | 15825/17944 [19:46<02:37, 13.45it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  88%|████████▊ | 15833/17944 [19:47<02:11, 16.05it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  88%|████████▊ | 15841/17944 [19:47<01:57, 17.86it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  88%|████████▊ | 15849/17944 [19:47<01:48, 19.38it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  88%|████████▊ | 15857/17944 [19:48<01:32, 22.57it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  88%|████████▊ | 15865/17944 [19:48<01:59, 17.41it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  88%|████████▊ | 15873/17944 [19:49<01:59, 17.32it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  89%|████████▊ | 15881/17944 [19:49<01:53, 18.11it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  89%|████████▊ | 15889/17944 [19:50<01:50, 18.53it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  89%|████████▊ | 15897/17944 [19:50<01:58, 17.31it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  89%|████████▊ | 15905/17944 [19:51<01:56, 17.53it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  89%|████████▊ | 15913/17944 [19:51<01:39, 20.51it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  89%|████████▊ | 15921/17944 [19:51<01:26, 23.27it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  89%|████████▉ | 15929/17944 [19:51<01:30, 22.32it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  89%|████████▉ | 15937/17944 [19:52<01:15, 26.42it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  89%|████████▉ | 15945/17944 [19:52<01:07, 29.43it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  89%|████████▉ | 15953/17944 [19:52<01:15, 26.36it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  89%|████████▉ | 15961/17944 [19:52<01:09, 28.49it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  89%|████████▉ | 15969/17944 [19:53<01:20, 24.61it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  89%|████████▉ | 15977/17944 [19:53<01:12, 27.02it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  89%|████████▉ | 15985/17944 [19:53<01:21, 24.02it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  89%|████████▉ | 15993/17944 [19:54<01:53, 17.15it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  89%|████████▉ | 16001/17944 [19:55<02:15, 14.32it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  89%|████████▉ | 16009/17944 [19:55<01:46, 18.08it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  89%|████████▉ | 16017/17944 [19:56<01:39, 19.41it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  89%|████████▉ | 16025/17944 [19:56<01:24, 22.82it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  89%|████████▉ | 16033/17944 [19:56<01:24, 22.51it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  89%|████████▉ | 16041/17944 [19:56<01:23, 22.81it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  89%|████████▉ | 16049/17944 [19:57<01:28, 21.30it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  89%|████████▉ | 16057/17944 [19:57<01:39, 19.03it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  90%|████████▉ | 16065/17944 [19:58<01:39, 18.96it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  90%|████████▉ | 16073/17944 [19:58<01:30, 20.66it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  90%|████████▉ | 16081/17944 [19:58<01:28, 21.02it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  90%|████████▉ | 16089/17944 [19:59<01:11, 25.98it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  90%|████████▉ | 16097/17944 [19:59<01:23, 22.19it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  90%|████████▉ | 16105/17944 [20:00<01:27, 21.00it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  90%|████████▉ | 16113/17944 [20:00<01:34, 19.39it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  90%|████████▉ | 16121/17944 [20:01<01:43, 17.65it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  90%|████████▉ | 16129/17944 [20:01<01:35, 19.00it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  90%|████████▉ | 16137/17944 [20:01<01:20, 22.53it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  90%|████████▉ | 16145/17944 [20:01<01:18, 22.89it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  90%|█████████ | 16153/17944 [20:02<01:25, 20.91it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  90%|█████████ | 16161/17944 [20:03<01:42, 17.43it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  90%|█████████ | 16169/17944 [20:03<01:53, 15.57it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  90%|█████████ | 16177/17944 [20:04<02:09, 13.66it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  90%|█████████ | 16185/17944 [20:04<01:59, 14.73it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  90%|█████████ | 16193/17944 [20:05<01:52, 15.61it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  90%|█████████ | 16201/17944 [20:05<01:46, 16.37it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  90%|█████████ | 16209/17944 [20:06<01:49, 15.82it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  90%|█████████ | 16217/17944 [20:06<01:43, 16.62it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  90%|█████████ | 16225/17944 [20:07<01:44, 16.51it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  90%|█████████ | 16233/17944 [20:07<01:29, 19.18it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  91%|█████████ | 16241/17944 [20:07<01:31, 18.52it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  91%|█████████ | 16249/17944 [20:08<01:45, 16.05it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  91%|█████████ | 16257/17944 [20:09<01:41, 16.57it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  91%|█████████ | 16265/17944 [20:09<01:19, 21.01it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  91%|█████████ | 16273/17944 [20:09<01:25, 19.50it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  91%|█████████ | 16281/17944 [20:10<01:21, 20.40it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  91%|█████████ | 16289/17944 [20:10<01:38, 16.82it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  91%|█████████ | 16297/17944 [20:11<01:30, 18.22it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  91%|█████████ | 16305/17944 [20:11<01:33, 17.53it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  91%|█████████ | 16313/17944 [20:12<01:41, 16.01it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  91%|█████████ | 16321/17944 [20:13<02:18, 11.75it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  91%|█████████ | 16329/17944 [20:13<02:08, 12.61it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  91%|█████████ | 16337/17944 [20:14<02:39, 10.08it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  91%|█████████ | 16345/17944 [20:15<02:36, 10.23it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  91%|█████████ | 16353/17944 [20:16<02:20, 11.33it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  91%|█████████ | 16361/17944 [20:16<01:59, 13.20it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  91%|█████████ | 16369/17944 [20:16<01:42, 15.41it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  91%|█████████▏| 16377/17944 [20:17<01:32, 16.86it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  91%|█████████▏| 16385/17944 [20:17<01:11, 21.89it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  91%|█████████▏| 16393/17944 [20:17<01:14, 20.74it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  91%|█████████▏| 16401/17944 [20:18<01:05, 23.67it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  91%|█████████▏| 16409/17944 [20:19<02:17, 11.17it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  91%|█████████▏| 16417/17944 [20:20<02:05, 12.13it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  92%|█████████▏| 16425/17944 [20:20<01:37, 15.62it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  92%|█████████▏| 16433/17944 [20:20<01:20, 18.75it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  92%|█████████▏| 16441/17944 [20:20<01:20, 18.66it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  92%|█████████▏| 16449/17944 [20:21<01:15, 19.81it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  92%|█████████▏| 16457/17944 [20:21<01:18, 18.97it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  92%|█████████▏| 16465/17944 [20:22<01:16, 19.24it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  92%|█████████▏| 16473/17944 [20:24<03:17,  7.46it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  92%|█████████▏| 16481/17944 [20:25<02:44,  8.92it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  92%|█████████▏| 16489/17944 [20:25<02:06, 11.51it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  92%|█████████▏| 16497/17944 [20:25<01:38, 14.67it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  92%|█████████▏| 16505/17944 [20:26<01:28, 16.20it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  92%|█████████▏| 16513/17944 [20:26<01:10, 20.20it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  92%|█████████▏| 16521/17944 [20:26<01:01, 23.24it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  92%|█████████▏| 16529/17944 [20:26<00:54, 25.93it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  92%|█████████▏| 16537/17944 [20:27<00:58, 23.93it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  92%|█████████▏| 16545/17944 [20:27<00:51, 27.25it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  92%|█████████▏| 16553/17944 [20:27<00:46, 30.22it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  92%|█████████▏| 16561/17944 [20:27<00:42, 32.61it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  92%|█████████▏| 16569/17944 [20:28<00:50, 27.46it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  92%|█████████▏| 16577/17944 [20:28<00:46, 29.38it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  92%|█████████▏| 16585/17944 [20:28<00:44, 30.86it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  92%|█████████▏| 16593/17944 [20:28<00:43, 31.34it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  93%|█████████▎| 16601/17944 [20:29<00:51, 26.12it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  93%|█████████▎| 16609/17944 [20:29<00:56, 23.50it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  93%|█████████▎| 16617/17944 [20:30<01:07, 19.62it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  93%|█████████▎| 16625/17944 [20:30<01:06, 19.84it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  93%|█████████▎| 16633/17944 [20:30<01:02, 20.88it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  93%|█████████▎| 16641/17944 [20:31<00:59, 21.73it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  93%|█████████▎| 16649/17944 [20:31<00:59, 21.84it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  93%|█████████▎| 16657/17944 [20:33<01:53, 11.36it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  93%|█████████▎| 16665/17944 [20:33<01:33, 13.67it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  93%|█████████▎| 16673/17944 [20:34<01:55, 11.05it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  93%|█████████▎| 16681/17944 [20:34<01:37, 12.91it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  93%|█████████▎| 16689/17944 [20:35<01:24, 14.87it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  93%|█████████▎| 16697/17944 [20:35<01:13, 16.97it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  93%|█████████▎| 16705/17944 [20:36<01:14, 16.58it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  93%|█████████▎| 16713/17944 [20:36<00:58, 21.08it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  93%|█████████▎| 16721/17944 [20:36<00:51, 23.95it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  93%|█████████▎| 16729/17944 [20:36<00:55, 22.04it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  93%|█████████▎| 16737/17944 [20:37<00:58, 20.51it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  93%|█████████▎| 16745/17944 [20:37<01:00, 19.98it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  93%|█████████▎| 16753/17944 [20:37<00:51, 22.99it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  93%|█████████▎| 16761/17944 [20:38<00:47, 24.96it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  93%|█████████▎| 16769/17944 [20:38<00:51, 22.81it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  93%|█████████▎| 16777/17944 [20:39<00:54, 21.46it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  94%|█████████▎| 16785/17944 [20:39<00:58, 19.83it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  94%|█████████▎| 16793/17944 [20:39<01:00, 19.13it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  94%|█████████▎| 16801/17944 [20:40<00:51, 22.24it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  94%|█████████▎| 16809/17944 [20:40<00:54, 20.72it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  94%|█████████▎| 16817/17944 [20:41<00:55, 20.17it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  94%|█████████▍| 16825/17944 [20:41<00:47, 23.80it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.
The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  94%|█████████▍| 16841/17944 [20:41<00:48, 22.88it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  94%|█████████▍| 16849/17944 [20:42<00:47, 23.04it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  94%|█████████▍| 16857/17944 [20:42<00:46, 23.24it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  94%|█████████▍| 16865/17944 [20:43<00:52, 20.62it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  94%|█████████▍| 16873/17944 [20:50<05:25,  3.29it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  94%|█████████▍| 16881/17944 [20:51<04:10,  4.24it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  94%|█████████▍| 16889/17944 [20:51<03:17,  5.34it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  94%|█████████▍| 16897/17944 [20:52<02:27,  7.10it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  94%|█████████▍| 16905/17944 [20:52<01:59,  8.68it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  94%|█████████▍| 16913/17944 [20:53<01:41, 10.12it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  94%|█████████▍| 16921/17944 [20:53<01:27, 11.71it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  94%|█████████▍| 16929/17944 [20:53<01:14, 13.55it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  94%|█████████▍| 16937/17944 [20:54<01:09, 14.56it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  94%|█████████▍| 16945/17944 [20:55<01:26, 11.60it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  94%|█████████▍| 16953/17944 [20:55<01:07, 14.76it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  95%|█████████▍| 16961/17944 [20:55<01:00, 16.34it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  95%|█████████▍| 16969/17944 [20:56<00:55, 17.64it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  95%|█████████▍| 16977/17944 [20:56<01:04, 14.97it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  95%|█████████▍| 16985/17944 [20:57<00:56, 17.09it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  95%|█████████▍| 16993/17944 [20:57<00:44, 21.15it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  95%|█████████▍| 17001/17944 [20:57<00:46, 20.40it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  95%|█████████▍| 17009/17944 [20:58<00:58, 16.04it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  95%|█████████▍| 17017/17944 [20:59<01:20, 11.58it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  95%|█████████▍| 17025/17944 [21:00<01:19, 11.60it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  95%|█████████▍| 17033/17944 [21:01<01:24, 10.83it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  95%|█████████▍| 17041/17944 [21:01<01:07, 13.47it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  95%|█████████▌| 17049/17944 [21:01<00:54, 16.53it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  95%|█████████▌| 17057/17944 [21:02<00:44, 20.11it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  95%|█████████▌| 17065/17944 [21:02<00:37, 23.69it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  95%|█████████▌| 17073/17944 [21:02<00:31, 27.82it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  95%|█████████▌| 17081/17944 [21:02<00:36, 23.63it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  95%|█████████▌| 17089/17944 [21:03<00:31, 27.04it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  95%|█████████▌| 17097/17944 [21:04<00:58, 14.53it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  95%|█████████▌| 17105/17944 [21:04<00:53, 15.67it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  95%|█████████▌| 17113/17944 [21:05<00:51, 16.18it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  95%|█████████▌| 17121/17944 [21:05<00:48, 16.85it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  95%|█████████▌| 17129/17944 [21:05<00:48, 16.97it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  96%|█████████▌| 17137/17944 [21:06<00:47, 17.14it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  96%|█████████▌| 17145/17944 [21:06<00:46, 17.17it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  96%|█████████▌| 17153/17944 [21:07<00:39, 19.87it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  96%|█████████▌| 17161/17944 [21:07<00:34, 22.87it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  96%|█████████▌| 17169/17944 [21:08<00:48, 16.04it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  96%|█████████▌| 17177/17944 [21:08<00:37, 20.48it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  96%|█████████▌| 17185/17944 [21:08<00:34, 22.03it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  96%|█████████▌| 17193/17944 [21:09<00:34, 21.73it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  96%|█████████▌| 17201/17944 [21:09<00:31, 23.33it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  96%|█████████▌| 17209/17944 [21:09<00:31, 23.27it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  96%|█████████▌| 17217/17944 [21:10<00:32, 22.59it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  96%|█████████▌| 17225/17944 [21:10<00:37, 19.30it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  96%|█████████▌| 17233/17944 [21:11<00:40, 17.55it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  96%|█████████▌| 17241/17944 [21:11<00:38, 18.21it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  96%|█████████▌| 17249/17944 [21:13<01:12,  9.58it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  96%|█████████▌| 17257/17944 [21:13<00:57, 11.95it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  96%|█████████▌| 17265/17944 [21:13<00:49, 13.82it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  96%|█████████▋| 17273/17944 [21:14<00:41, 16.05it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  96%|█████████▋| 17281/17944 [21:14<00:37, 17.75it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  96%|█████████▋| 17289/17944 [21:14<00:35, 18.39it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  96%|█████████▋| 17297/17944 [21:15<00:32, 20.03it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  96%|█████████▋| 17305/17944 [21:15<00:34, 18.73it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  96%|█████████▋| 17313/17944 [21:15<00:27, 22.89it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  97%|█████████▋| 17321/17944 [21:17<01:02,  9.95it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  97%|█████████▋| 17329/17944 [21:18<00:51, 11.87it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  97%|█████████▋| 17337/17944 [21:18<00:45, 13.32it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  97%|█████████▋| 17345/17944 [21:19<00:44, 13.54it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  97%|█████████▋| 17353/17944 [21:19<00:38, 15.54it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  97%|█████████▋| 17361/17944 [21:20<00:45, 12.93it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  97%|█████████▋| 17369/17944 [21:20<00:39, 14.49it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  97%|█████████▋| 17377/17944 [21:21<00:34, 16.42it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  97%|█████████▋| 17385/17944 [21:21<00:31, 17.77it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  97%|█████████▋| 17393/17944 [21:21<00:30, 18.06it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  97%|█████████▋| 17401/17944 [21:24<01:07,  8.08it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  97%|█████████▋| 17409/17944 [21:24<00:52, 10.19it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  97%|█████████▋| 17417/17944 [21:24<00:45, 11.69it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  97%|█████████▋| 17425/17944 [21:26<00:52,  9.86it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  97%|█████████▋| 17433/17944 [21:26<00:46, 11.10it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  97%|█████████▋| 17441/17944 [21:26<00:38, 13.23it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  97%|█████████▋| 17449/17944 [21:27<00:32, 15.05it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  97%|█████████▋| 17457/17944 [21:29<01:02,  7.82it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  97%|█████████▋| 17465/17944 [21:31<01:21,  5.84it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  97%|█████████▋| 17473/17944 [21:31<00:59,  7.87it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  97%|█████████▋| 17481/17944 [21:32<00:45, 10.27it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  97%|█████████▋| 17489/17944 [21:32<00:38, 11.75it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  98%|█████████▊| 17497/17944 [21:35<01:10,  6.33it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  98%|█████████▊| 17505/17944 [21:35<00:54,  7.99it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  98%|█████████▊| 17513/17944 [21:35<00:45,  9.38it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  98%|█████████▊| 17521/17944 [21:36<00:39, 10.68it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  98%|█████████▊| 17529/17944 [21:36<00:29, 13.92it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  98%|█████████▊| 17537/17944 [21:37<00:30, 13.17it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  98%|█████████▊| 17545/17944 [21:37<00:24, 16.52it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  98%|█████████▊| 17553/17944 [21:38<00:23, 16.52it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  98%|█████████▊| 17561/17944 [21:38<00:21, 17.45it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  98%|█████████▊| 17569/17944 [21:38<00:21, 17.76it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  98%|█████████▊| 17577/17944 [21:39<00:18, 20.00it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  98%|█████████▊| 17585/17944 [21:39<00:15, 22.72it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  98%|█████████▊| 17593/17944 [21:39<00:14, 24.37it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  98%|█████████▊| 17601/17944 [21:40<00:21, 16.01it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  98%|█████████▊| 17609/17944 [21:41<00:21, 15.78it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  98%|█████████▊| 17617/17944 [21:41<00:17, 18.88it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  98%|█████████▊| 17625/17944 [21:41<00:15, 21.15it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  98%|█████████▊| 17633/17944 [21:41<00:12, 23.98it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  98%|█████████▊| 17641/17944 [21:42<00:12, 23.72it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  98%|█████████▊| 17649/17944 [21:42<00:11, 24.89it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  98%|█████████▊| 17657/17944 [21:42<00:12, 23.11it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  98%|█████████▊| 17665/17944 [21:43<00:11, 23.70it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  98%|█████████▊| 17673/17944 [21:43<00:12, 22.45it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  99%|█████████▊| 17681/17944 [21:43<00:10, 25.83it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  99%|█████████▊| 17689/17944 [21:45<00:27,  9.15it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  99%|█████████▊| 17697/17944 [21:46<00:22, 11.19it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  99%|█████████▊| 17705/17944 [21:46<00:18, 13.26it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  99%|█████████▊| 17713/17944 [21:47<00:16, 13.63it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  99%|█████████▉| 17721/17944 [21:49<00:27,  8.25it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  99%|█████████▉| 17729/17944 [21:49<00:21, 10.11it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  99%|█████████▉| 17737/17944 [21:49<00:17, 12.00it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  99%|█████████▉| 17745/17944 [21:50<00:14, 13.82it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  99%|█████████▉| 17753/17944 [21:50<00:12, 14.94it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  99%|█████████▉| 17761/17944 [21:50<00:10, 17.69it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  99%|█████████▉| 17769/17944 [21:51<00:08, 19.47it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  99%|█████████▉| 17777/17944 [21:51<00:07, 22.46it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  99%|█████████▉| 17785/17944 [21:52<00:11, 13.69it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  99%|█████████▉| 17793/17944 [21:52<00:08, 17.37it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  99%|█████████▉| 17801/17944 [21:53<00:07, 18.43it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  99%|█████████▉| 17809/17944 [21:53<00:06, 22.03it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  99%|█████████▉| 17817/17944 [21:53<00:04, 25.50it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  99%|█████████▉| 17825/17944 [21:53<00:04, 26.05it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  99%|█████████▉| 17833/17944 [21:54<00:04, 26.54it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  99%|█████████▉| 17841/17944 [21:54<00:03, 29.59it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests:  99%|█████████▉| 17849/17944 [21:54<00:04, 19.59it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests: 100%|█████████▉| 17857/17944 [21:55<00:04, 20.58it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests: 100%|█████████▉| 17865/17944 [21:56<00:05, 13.23it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests: 100%|█████████▉| 17873/17944 [21:57<00:06, 10.59it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests: 100%|█████████▉| 17881/17944 [21:58<00:05, 10.85it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests: 100%|█████████▉| 17889/17944 [21:58<00:04, 12.74it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests: 100%|█████████▉| 17897/17944 [21:58<00:03, 14.26it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests: 100%|█████████▉| 17905/17944 [22:06<00:13,  2.96it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests: 100%|█████████▉| 17913/17944 [22:06<00:07,  4.08it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests: 100%|█████████▉| 17921/17944 [22:07<00:04,  5.39it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests: 100%|█████████▉| 17929/17944 [22:08<00:02,  5.60it/s]The following generation flags are not valid and may be ignored: ['temperature', 'top_p']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Running generate_until requests: 100%|█████████▉| 17937/17944 [22:08<00:00,  7.50it/s]
Running generate_until requests: 100%|██████████| 17944/17944 [22:08<00:00, 13.50it/s]
2025-06-20:19:00:15 INFO     [loggers.evaluation_tracker:209] Saving results aggregated
hf (pretrained=/root/chenxr/models/Llama-2-7b-hf), gen_kwargs: (None), limit: None, num_fewshot: None, batch_size: 8
| Tasks  |Version|     Filter      |n-shot|  Metric   |   |Value |   |Stderr|
|--------|------:|-----------------|-----:|-----------|---|-----:|---|-----:|
|triviaqa|      3|remove_whitespace|     0|exact_match|↑  |0.5253|±  |0.0037|