runtime error

Exit code: 1. Reason: :00<?, ?B/s] model-00003-of-00003.safetensors: 0%| | 16.6M/4.55G [00:02<09:31, 7.93MB/s] model-00003-of-00003.safetensors: 2%|▏ | 76.5M/4.55G [00:04<04:05, 18.2MB/s] model-00003-of-00003.safetensors: 3%|▎ | 143M/4.55G [00:05<02:21, 31.1MB/s]  model-00003-of-00003.safetensors: 18%|█▊ | 814M/4.55G [00:06<00:18, 204MB/s]  model-00003-of-00003.safetensors: 31%|███ | 1.39G/4.55G [00:08<00:12, 248MB/s] model-00003-of-00003.safetensors: 38%|███▊ | 1.72G/4.55G [00:09<00:11, 250MB/s] model-00003-of-00003.safetensors: 63%|██████▎ | 2.87G/4.55G [00:10<00:03, 467MB/s] model-00003-of-00003.safetensors: 100%|██████████| 4.55G/4.55G [00:11<00:00, 389MB/s] Loading checkpoint shards: 0%| | 0/3 [00:00<?, ?it/s] Loading checkpoint shards: 100%|██████████| 3/3 [00:00<00:00, 15.48it/s] generation_config.json: 0%| | 0.00/116 [00:00<?, ?B/s] generation_config.json: 100%|██████████| 116/116 [00:00<00:00, 827kB/s] Some parameters are on the meta device because they were offloaded to the cpu and disk. You shouldn't move a model that is dispatched using accelerate hooks. Traceback (most recent call last): File "/app/app.py", line 274, in <module> preloaded_output = get_preload_output() File "/app/app.py", line 269, in get_preload_output html_output = extract_and_visualize(abstract) File "/app/app.py", line 141, in extract_and_visualize raw_output = run_mistral_extract(sentence) File "/app/app.py", line 81, in run_mistral_extract tokenizer, model, device = get_model() File "/app/app.py", line 75, in get_model model.to(device) File "/usr/local/lib/python3.10/site-packages/accelerate/big_modeling.py", line 462, in wrapper raise RuntimeError("You can't move a model that has some modules offloaded to cpu or disk.") RuntimeError: You can't move a model that has some modules offloaded to cpu or disk.

Container logs: