runtime error

Exit code: 1. Reason: 00, 'total_steps': 100000, 'final_cosine': 1e-05}, 'TOKENIZER': {'max_shift_steps': 206, 'shift_step_ms': 10}} "task_manager": <utils.task_manager.TaskManager object at 0x7f8ec8f73c50> "test_optimal_octave_shift": False "test_pitch_shift_layer": None "weight_decay": 0.0 "write_output_dir": amt/logs/2024/mc13_256_g4_all_v7_mt3f_sqr_rms_moe_wf4_n8k2_silu_rope_rp_b36_nops "write_output_vocab": None Traceback (most recent call last): File "/app/app.py", line 58, in <module> model.to("cuda") ~~~~~~~~^^^^^^^^ File "/usr/local/lib/python3.13/site-packages/lightning_fabric/utilities/device_dtype_mixin.py", line 59, in to return super().to(*args, **kwargs) ~~~~~~~~~~^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.13/site-packages/torch/nn/modules/module.py", line 1381, in to return self._apply(convert) ~~~~~~~~~~~^^^^^^^^^ File "/usr/local/lib/python3.13/site-packages/torch/nn/modules/module.py", line 933, in _apply module._apply(fn) ~~~~~~~~~~~~~^^^^ File "/usr/local/lib/python3.13/site-packages/torch/nn/modules/module.py", line 933, in _apply module._apply(fn) ~~~~~~~~~~~~~^^^^ File "/usr/local/lib/python3.13/site-packages/torch/nn/modules/module.py", line 1031, in _apply self._buffers[key] = fn(buf) ~~^^^^^ File "/usr/local/lib/python3.13/site-packages/torch/nn/modules/module.py", line 1367, in convert return t.to( ~~~~^ device, ^^^^^^^ dtype if t.is_floating_point() or t.is_complex() else None, ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ non_blocking, ^^^^^^^^^^^^^ ) ^ File "/usr/local/lib/python3.13/site-packages/torch/cuda/__init__.py", line 424, in _lazy_init torch._C._cuda_init() ~~~~~~~~~~~~~~~~~~~^^ RuntimeError: Found no NVIDIA driver on your system. Please check that you have an NVIDIA GPU and installed a driver from http://www.nvidia.com/Download/index.aspx

Container logs: