runtime error

Exit code: 1. Reason: l-00002-of-00004.safetensors: 8%|▊ | 379M/4.93G [00:08<01:22, 54.9MB/s] model-00002-of-00004.safetensors: 9%|▉ | 447M/4.93G [00:09<01:20, 55.7MB/s] model-00002-of-00004.safetensors: 17%|█▋ | 848M/4.93G [00:11<00:39, 104MB/s]  model-00002-of-00004.safetensors: 24%|██▍ | 1.18G/4.93G [00:14<00:35, 105MB/s] model-00002-of-00004.safetensors: 24%|██▍ | 1.18G/4.93G [00:16<00:53, 70.6MB/s] Downloading shards: 25%|██▌ | 1/4 [00:45<02:15, 45.05s/it] Traceback (most recent call last): File "/home/user/app/app.py", line 52, in <module> MODEL = MMadaModelLM.from_pretrained(DEFAULT_MODEL_PATH, trust_remote_code=True, torch_dtype=torch.bfloat16).to(DEVICE).eval() File "/usr/local/lib/python3.10/site-packages/transformers/modeling_utils.py", line 3973, in from_pretrained resolved_archive_file, sharded_metadata = get_checkpoint_shard_files( File "/usr/local/lib/python3.10/site-packages/transformers/utils/hub.py", line 1098, in get_checkpoint_shard_files cached_filename = cached_file( File "/usr/local/lib/python3.10/site-packages/transformers/utils/hub.py", line 403, in cached_file resolved_file = hf_hub_download( File "/usr/local/lib/python3.10/site-packages/huggingface_hub/utils/_validators.py", line 114, in _inner_fn return fn(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/huggingface_hub/file_download.py", line 1008, in hf_hub_download return _hf_hub_download_to_cache_dir( File "/usr/local/lib/python3.10/site-packages/huggingface_hub/file_download.py", line 1161, in _hf_hub_download_to_cache_dir _download_to_tmp_and_move( File "/usr/local/lib/python3.10/site-packages/huggingface_hub/file_download.py", line 1710, in _download_to_tmp_and_move xet_get( File "/usr/local/lib/python3.10/site-packages/huggingface_hub/file_download.py", line 627, in xet_get download_files( RuntimeError: Data processing error: CAS service error : IO Error: No space left on device (os error 28)

Container logs:

Fetching error logs...